Despite excellent performance in image generation, Generative Adversarial Networks (GANs) are notorious for its requirements of enormous storage and intensive computation. As an awesome “performance maker”, knowledge distillation is demonstrated to be particularly efficacious in exploring low-priced GANs. In this paper, we investigate the irreplaceability of teacher discriminator and present an inventive discriminator-cooperated distillation, abbreviated as DCD, towards refining better feature maps from the generator. In contrast to conventional pixel-to-pixel match methods in feature map distillation, our DCD utilizes teacher discriminator as a transformation to drive intermediate results of the student generator to be perceptually close to corresponding outputs of the teacher generator. Furthermore, in order to mitigate mode collapse in GAN compression, we construct a collaborative adversarial training paradigm where the teacher discriminator is from scratch established to co-train with student generator in company with our DCD. Our DCD shows superior results compared with existing GAN compression methods. For instance, after reducing over$40\times MACs$and$80\times$parameters of CycleGAN, we well decrease FID metric from 61.53 to 48.24 while the current SoTA method merely has 51.92. This work's source code has been made accessible at https://github.com/poopit/DCD-official.

This paper describes work we have done in developing an insertable surgical imaging device with multiple degrees-of-freedom for minimally invasive surgery. The device is fully insertable into the abdomen using standard 12 mm trocars. It consists of a modular camera and lens system which has pan and tilt capability provided by 2 small DC servo motors. It also has its own integrated lighting system that is part of the camera assembly. Once the camera is inserted into the abdomen, the insertion port is available for additional tooling, motivating the idea of single port surgery. A third zoom axis has been designed for the camera as well, allowing close-up and far-away imaging of surgical sites with a single camera unit. In animal tests with the device we have performed surgical procedures including cholecystectomy, appendectomy, running (measuring) the bowel, suturing, and nephrectomy. The tests show that the new device is: (1) Easier and more intuitive to use than a standard laparoscope. (2) Joystick operation requires no specialized operator training. (3) Field of view and access to relevant regions of the body were superior to a standard laparoscope using a single port. (4) Time to perform procedures was better or equivalent to a standard laparoscope. We believe these insertable platforms will be an integral part of future surgical systems. The platforms can be used with tooling as well as imaging systems, allowing many surgical procedures to be done using such a platform.

Endoscopic imaging is still dominated by the paradigm of pushing long sticks into small openings. This approach has a number of limitations for minimal access surgery, such as narrow angle imaging, limited workspace, counter-intuitive motions and additional incisions for the endoscpic instruments. Our intent is to go beyond this paradigm, and remotize sensors and effectors directly into the body cavity. To this end, we have developed a prototype of a novel insertable pan/tilt endoscopic camera with an integrated light source. The package has a size of 110 mm in length and 10 mm in diameter and can be inserted into the abdomen through a standard trocar and then anchored onto the abdominal wall, leaving the incision port open for access. The camera package contains three parts: an imaging module, an illumination module, and a pan/tilt motion platform. The imaging module includes a lens and CCD imaging sensor. The illumination module attaches to the imaging module and has an array of LED light sources. The pan/tilt platform provides the imaging module with pan of 120 degrees and tilt motion of 90 degrees using small servo motors. A fixing mechanism is designed to hold the device in the cavity. A standard joy stick can be used to control the motion of the camera in a natural way. The design allows for multiple camera packages to be inserted through a single incision as well.

The primary goal of this research is to develop effective haptic and visual servoing methods, with the eventual goal of eliminating the need for mechanical stabilizers in a coronary artery bypass graft procedure by presenting a stationary operative site to the surgeon performing the procedure using haptic and visual feedback. We present the results from our initial work in the area of tracking a deformable membrane using vision and providing haptic feedback to the user based on the vision information and the material properties of the membrane. In our first experiment, we track the deformation of a rubber membrane in real-time through stereo vision while providing haptic feedback to the user interacting with the reconstructed membrane through the PHANToM haptic device. In the second experiment, we verify the ability of our vision system to track a point on a surface undergoing a complex 3D motion.