Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.

Takeshi Takaki

dblp:94/6982 · DBLP profile ↗
← Back
40ranked-venue papers
7as first author
1since 2021 · last 2025
0000-0003-3213-9130ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 33 · 7 first-author · 1 since 2021Systems, architecture and hardware · 30 · 7 first-author · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 5Applied, interdisciplinary, general and emerging computing · 2

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
9 papers
Robot manipulation · 59% Motion planning and robot control · 28% 3D vision · 7%
Computer graphics and multimedia
8 papers
Image and video processing · 47% Computational photography and imaging · 38% Multimedia analysis and retrieval · 11%
Computer architecture, parallel and distributed computing, and storage systems
2 papers
Hardware accelerators and domain-specific architectures · 85% Reconfigurable computing and FPGAs · 15%
Interdisciplinary, comprehensive, and emerging computing
2 papers
Computational science and engineering · 66% Medical and health informatics · 34%

Topics — the 29 heaviest of 32, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Robotics › Robot manipulation
nonprehensile manipulation
0.522016
Control scheme of nongrasping manipulation based on virtual connecting constraint · ICRA 2016
A scheme for manipulating a passive object using an active plate · ICRA 2015
Robotics › Robot manipulation
grasping, dexterous and mobile manipulation
0.552014
Position/attitude control of an object by controlling a fluid field using a grid pattern air nozzle · ICRA 2014
High performance anthropomorphic robot hand with grasp force magnification mechanism · ICRA 2009
Grasp Force Magnifying Mechanism for Parallel Jaw Grippers · ICRA 2007
Computational photography and imaging › image acquisition › imaging system design › camera design
autofocus
0.312018
High-Speed Well-Focused Image-Capturing System for Moving Micro-Objects Based on Histograms of the Luminance · ICRA 2018
Image and video processing
image enhancement
0.312018
High-Speed Well-Focused Image-Capturing System for Moving Micro-Objects Based on Histograms of the Luminance · ICRA 2018
Computational photography and imaging
microscopy imaging
0.312018
High-Speed Well-Focused Image-Capturing System for Moving Micro-Objects Based on Histograms of the Luminance · ICRA 2018
Robotics › Robot manipulation › nonprehensile manipulation
juggling
0.212016
Control scheme of nongrasping manipulation based on virtual connecting constraint · ICRA 2016
Robotics › Motion planning and robot control
motion planning
0.212016
Control scheme of nongrasping manipulation based on virtual connecting constraint · ICRA 2016
Robotics › Motion planning and robot control › robot control › motion control
cyclic motion control
0.212015
A scheme for manipulating a passive object using an active plate · ICRA 2015
Robotics › Motion planning and robot control
robot control
0.212015
A scheme for manipulating a passive object using an active plate · ICRA 2015
Robotics › Robot manipulation › nonprehensile manipulation
non-contact manipulation
0.212014
Position/attitude control of an object by controlling a fluid field using a grid pattern air nozzle · ICRA 2014
Image and video processing
feature extraction
0.212014
Rapid vision-based shape and motion analysis system for fast-flowing cells in a microchannel · ICRA 2014
Computational photography and imaging
projection mapping
0.212014
Simultaneous projection mapping using high-frame-rate depth vision · ICRA 2014
Robotics › Legged, aerial and field robots
locomotion
0.212013
Development of inverted pendulum robot capable of climbing stairs using planetary wheel mechanism · ICRA 2013
Image and video processing › motion estimation
optical flow
0.112012
A real-time micro-PIV system using frame-straddling high-speed vision · ICRA 2012
Image and video processing
particle image velocimetry
0.112012
A real-time micro-PIV system using frame-straddling high-speed vision · ICRA 2012
Multimedia analysis and retrieval
object tracking
0.112011
1000-fps target tracking using vibration-based image features · ICRA 2011
Multimedia analysis and retrieval
video analysis
0.112011
Dynamics-based visual inspection through real-time modal analysis · ICRA 2011
Haptics and multimodal interaction › haptic interface
force display
0.112010
Force visualization mechanism using a Moiré fringe applied to endoscopic surgical instruments · ICRA 2010
Robotics › Robot manipulation › robotic hand
anthropomorphic robot hand
0.112009
High performance anthropomorphic robot hand with grasp force magnification mechanism · ICRA 2009
Computer vision › 3D vision
depth estimation
0.112009
Monocular stereo image processing using viewpoint switching iris · ICRA 2009
Computer vision › 3D vision › stereo vision
monocular stereo
0.112009
Monocular stereo image processing using viewpoint switching iris · ICRA 2009
Robotics › Robot manipulation › grasping
gripper design
0.112007
Grasp Force Magnifying Mechanism for Parallel Jaw Grippers · ICRA 2007
Virtual and augmented reality
augmented reality
0.112014
Simultaneous projection mapping using high-frame-rate depth vision · ICRA 2014
Robotics › Motion planning and robot control › robot control › stabilization control
inverted pendulum control
0.012013
Development of inverted pendulum robot capable of climbing stairs using planetary wheel mechanism · ICRA 2013
Image and video processing
vibration measurement
0.012011
Dynamics-based visual inspection through real-time modal analysis · ICRA 2011
Medical and health informatics › surgical robotics
endoscopic surgery
0.012010
Force visualization mechanism using a Moiré fringe applied to endoscopic surgical instruments · ICRA 2010
Medical and health informatics
surgical robotics
0.012010
Force visualization mechanism using a Moiré fringe applied to endoscopic surgical instruments · ICRA 2010
Reconfigurable computing and FPGAs › FPGA-based signal processing
FPGA-based vision system
0.012010
2000 fps real-time vision system with high-frame-rate video recording · ICRA 2010
Virtual and augmented reality › navigation
viewpoint switching
0.012009
Monocular stereo image processing using viewpoint switching iris · ICRA 2009

Methods — techniques the papers use, named apart from their topics

frame-straddling · 0.5stability analysis · 0.5poincaré map · 0.5multi-object feature extraction · 0.4vibration-based focus scanning · 0.3histogram-based algorithm · 0.3passive force visualization · 0.2nonlinear discrete system · 0.2moiré fringe · 0.2structured light · 0.2parallel link robot · 0.2feedback control · 0.2air jet control · 0.2GPU parallel processing · 0.2feed screw · 0.2planetary wheel mechanism · 0.2inverted pendulum control · 0.2gradient-based optical flow · 0.1
YearPublicationVenuePosition
2025 Vision-Based Force Feedback System Using Moiré Patterns
abstract
This paper proposes a novel force feedback system based on visual processing and Moiré patterns. The system uses a force sensor with a simple and efficient structure to eliminate the need for cables or other electronic components. A brass flexure plate was employed as the primary elastic element, leveraging the Moiré fringe principle for force measurements. High-speed cameras are used to capture real-time images that are then processed using advanced algorithms to accurately extract force data. Force feedback experiments were conducted to evaluate the performance of the proposed system, and the results were compared with those taken from conventional force sensors. The experimental results indicated that the proposed device consistently delivered precise target force outputs with outcomes that closely matched those obtained using traditional sensors. In addition, the system demonstrated robust performance in high-frequency measurements at 500 Hz, achieving an average force- feedback convergence time of approximately 0.1s.
Jinrun Zuo, Takeshi Takaki
IROS2
2020 Development of A Passive Skid for Multicopter Landing on Rough Terrain
abstract
Landing is an essential part of multicopter task operations. A multicopter has relatively stringent requirements for landing, particularly for achieving flatness. Currently, landing on rough terrain with normal skids is difficult. Therefore, research is being conducted to obtain skids capable of landing on rough terrain. In this paper, a passive skid for multicopter landing on rough terrain is proposed. The proposed device is based on an existing previous study of the multicopter carried with a electric robo-arm only for object manipulation. This innovative idea stems from the aim of giving the multicopter carried with a electric robo-arm the ability to land on various occasions and then the passive skid is designed. By using a slope to simulate a rough terrain, the range of available landing in which a multicopter can maintain its pose and the frictional torque of the passive joint are analyzed. Further, experiments are conducted to demonstrate that landing can be achieved using the skid proposed in our study.
Maozheng Xu, Naoto Sumida, Takeshi Takaki
IROS3
2019 Multiple DOF Platform with Multiple Air Jets
Shinya Kotani, Nobukado Abe, Satoshi Iwaki, Tetsushi Ikeda, Takeshi Takaki
ICINCO (2)5
2018 Pitching and Catching of an Object between a Pair of Air Jet
Nobukado Abe, Satoshi Iwaki, Kazuki Yoshinaga, Naoki Tsuchihashi, Tetsushi Ikeda, Toshiharu Kosaku, Takeshi Takaki
ICINCO (2)7
2018 A Spatial Motion Control to Transfer an Object between a Pair of Air Jet
Kazuki Yoshinaga, Satoshi Iwaki, Naoki Tsuchihashi, Nobukado Abe, Tetsushi Ikeda, Toshiharu Kosaku, Takeshi Takaki
ICINCO (2)7
2018 High-Speed Well-Focused Image-Capturing System for Moving Micro-Objects Based on Histograms of the Luminance
abstract
In recent years, vision-based analysis systems of micro-objects in a microchannel have been actively developed. However, it is difficult to focus on high-speed micro-objects in a microchannel because the general height of a microchannel is approximately 10-100 μm, whereas the depth of focus of the objective lens is approximately 1-4 μm. Therefore, we propose a high-speed well-focused image-capturing microscope, which is a system with an objective lens attached to a vibration machine that moves the focus position rapidly by oscillating it up and down to capture well-focused images using a histogram-based algorithm. The proposed microscope system is verified experimentally to capture well-focused images of moving micro- objects.
Tadayoshi Aoyama, Motoaki Hanabishi, Takeshi Takaki, Idaku Ishii, Yasuhisa Hasegawa
ICRA3
2018 High-frame-rate Target Tracking with CNN-based Object Recognition
abstract
This paper proposes an intelligent and fast tracking method for robust trackability against appearance changes. The method hybridizes a correlation-based tracking algorithm operating at hundreds of frames per second (fps) with a deep learning-based recognition algorithm operating at dozens of fps. A prototype intelligent mechanical tracking system was developed by implementing our hybridized tracking algorithm on a 500-fps vision platform. A complex-shaped target can be robustly tracked at the center of the camera view in real time by controlling a pan-tilt active vision system with 500 Hz visual feedback. The tracking performance of our proposed algorithm was verified by showing several experimental results for pre-learned objects, which were quickly manipulated against complex backgrounds.
Yihao Gu, Takeshi Takaki, Idaku Ishii
IROS3
2017 View expansion system for microscope photography based on viewpoint movement using Galvano mirror
abstract
Recent progress in LOC technology have made it possible to analyze cells in microfluidic devices in a microscopic environment. Vision-based cell analysis systems have a limitation in their analysis range owing to the small view area of the microscopic objective lens; thus, an expansion of the view area of microscopic observation is required. In this paper, we propose a view expansion system for photomicroscopy using the observing point movement of a Galvano mirror. We develop a prototype of the proposed view expansion system that consists of a microscope, Galvano mirror, and vision system. Then, the visual field of the developed microscopic view expansion system is derived experimentally. Finally, our system is demonstrated through panoramic image developing experiments. The effectiveness of the proposed system is verified by comparing it with a normal microscopic video shooting area.
Tadayoshi Aoyama, Mamoru Kaneishi, Takeshi Takaki, Idaku Ishii
IROS3
2017 Development of a 4-joint 3-DOF robotic arm with anti-reaction force mechanism for a multicopter
abstract
In this paper, we propose a design method for the mechanism of a robotic arm suitable for a multicopter. The motion of an arm attached to a multicopter can possibly disturb the multicopter attitude. Our aim is to suppress this attitude disturbance by mechanical methods. In the proposed design method, the arm has the following features for suppressing the disturbance of the multicopter attitude. 1. The robotic arm can adjust its center of gravity (COG). 2. In the simplified model, the sum of the angular momentum of the rotating parts constituting the robot arm is equal to zero. These features can compensate for both the displacement of the COG of the arm and the counter torque generated from rotating parts, which cause the disturbance to the multicopter attitude. Since the disturbance of the multicopter attitude can be suppressed mechanically, the robotic arm does not require a special flight control law. In other words, this robotic arm has the advantage of being attached to a multicopter using a common, off-the-shelf, multipurpose flight controller. Furthermore, we discuss the mass distribution, power transmission method, and the moment of inertia of rotating parts, such as the speed reducer, motor, and arm. Additionally, we fabricate a prototype robotic arm with four joints and three degrees of freedom (DOFs), based on the proposed design method. Finally, the experiments showed that the robotic arm suppressed the disturbance of the multicopter attitude caused by the arm motion.
Yoshinori Ohnishi, Takeshi Takaki, Tadayoshi Aoyama, Idaku Ishii
IROS2
2016 Control scheme of nongrasping manipulation based on virtual connecting constraint
abstract
The research field of nongrasping manipulation is a maturing area in robotic motion control. However, the common principles of motion planning for nongrasping manipulation systems have not yet been established. This paper proposes the concept of virtual connecting manipulation as a generalized motion planning framework for nongrasping manipulation systems. As a preliminary result, we had previously realized a flower-stick juggling task called “propeller motion” using an actual experimental system. In this paper, we apply the virtual connecting manipulation concept to a flower-stick juggling task and analyze the generated motion from the view point of analytical methodology. We conduct a stability analysis of the generated cyclic motion of the flower stick by using a Poincaré map, and the analytical results show that the generated cyclic motion is asymptotically stable.
Tadayoshi Aoyama, Takeshi Takaki, Qingyi Gu, Idaku Ishii
ICRA2
2015 A scheme for manipulating a passive object using an active plate
abstract
We propose a novel scheme for manipulating a passive object using an active plate. The objective of this study is to control an object's orientation with respect to the gravitational force direction by using an active plate for realizing hitherto unrealized object motion. In this context, motions of the object and active plate are designed to be cyclic. A state vector composed of the object's angle and angular velocity is defined, and the cyclic motion is expressed as a nonlinear discrete system. Fixed points of the state vector are searched for in the designed cyclic motion. A stability analysis around the fixed points is conducted using a Poincaré map. As a result, the fixed points are shown to be asymptotically stable. Finally, experimental results are used to verify that the object's angle can be manipulated with the designed cyclic motion using the plate.
Tadayoshi Aoyama, Yuji Harada, Qingyi Gu, Takeshi Takaki, Idaku Ishii
ICRA4
2015 Realization of flower stick rotation using robotic arm
abstract
Flower stick juggling is a dexterous task done by skillful jugglers. We aim to realize dexterous tasks done by humans using robotic systems. This work focuses on flower stick juggling and proposes a feedback control strategy for a flower stick juggling task called “propeller” as one of the robotic dexterous manipulations. The propeller motion is modeled by considering combined flower stick and a robotic manipulator. We developed a control strategy that allows stable cyclic rotation of the flower stick in the air. The control parametars in the control strategy are searched through numerical simulation. Finally, the flower stick propeller motion is realized using an actual robotic system.
Tadayoshi Aoyama, Takeshi Takaki, Takumi Miura, Qingyi Gu, Idaku Ishii
IROS2
2015 Simultaneous Vision-Based Shape and Motion Analysis of Cells Fast-Flowing in a Microchannel
abstract
This paper proposes a novel concept for simultaneous cell shape and motion analysis in fast microchannel flows by implementing a multiobject feature extraction algorithm on a frame-straddling high-speed vision platform. The system can synchronize two camera inputs with the same view with only a tiny time delay on the sub-microsecond timescale. Real-time video processing is performed in hardware logic by extracting the moment features of multiple cells in 512 × 256 images at 4000 fps for the two camera inputs and their frame-straddling time can be adjusted from 0 to 0.25 ms in 9.9 ns steps. By setting the frame-straddling time in a certain range to avoid large image displacements between the two camera inputs, our frame-straddling high-speed vision platform can perform simultaneous shape and motion analysis of cells in fast microchannel flows of 1 m/s or greater. The results of real-time experiments conducted to analyze the deformabilities and velocities of sea urchin egg cells fast-flowing in microchannels verify the efficacy of our vision-based cell analysis system.
Qingyi Gu, Tadayoshi Aoyama, Takeshi Takaki, Idaku Ishii
IEEE Trans Autom. Sci. Eng.3
2015 LOC-Based High-Throughput Cell Morphology Analysis System
abstract
We present a high-speed vision-based morphological analysis system for fast-flowing cells in a microchannel. Real-time video processing is performed in hardware logic by extracting the moment features and bounding boxes of multiple cells in 512 × 256-pixel images at 2000 fps. The extracted cell regions are pushed into a first-in-first-out (FIFO) buffer for real-time image-based morphological analysis after being shrunk proportionally to a certain size. By extracting the bounding boxes of the cell regions using hardware logic and shrinking the cell region to a certain size to reduce processing time, our high-speed vision system can perform fast morphological analysis of cells at 500 cells/s in fast microchannel flows. Moreover, snapshots of all passed cells under the microscope are stored for offline verification. The results of real-time experiments conducted to analyze the size, eccentricity, and transparency of sea urchin embryos flowing fast in microchannels verify the efficacy of our vision-based cell analysis system.
Qingyi Gu, Tomohiro Kawahara, Tadayoshi Aoyama, Takeshi Takaki, Idaku Ishii, Ayumi Takemoto, Naoaki Sakamoto
IEEE Trans Autom. Sci. Eng.4
2014 Simultaneous projection mapping using high-frame-rate depth vision
abstract
In this paper, we report on the development of a projection mapping system that can project RGB light patterns that are enhanced for three-dimensional (3-D) scenes using a GPU-based high-frame-rate (HFR) vision system synchronized with HFR projectors. Our system can acquire 512×512 depth images in real time at 500 fps. The depth image processing is accelerated by installing a GPU board for parallel processing of a gray-code structured light method using infrared (IR) light patterns projected from an IR projector. Using the computed depth images, suitable RGB light patterns to be projected are generated in real time for enhanced application tasks. They are projected from an RGB projector as augmented information onto a 3-D scene with pixel-wise correspondence even when the 3-D scene is time-varied. Experimental results obtained from enhanced application tasks for time-varying 3-D scenes such as (1) depth-based color mapping and (2) augmented reality (AR) spirit level, confirm the efficacy of our system.
Jun Chen 0017, Tadayoshi Aoyama, Takeshi Takaki, Idaku Ishii
ICRA4
2014 Rapid vision-based shape and motion analysis system for fast-flowing cells in a microchannel
abstract
This paper proposes a novel method for simultaneous cell shape and motion analysis in rapid microchannel flows based on a multi-object feature extraction algorithm with a frame-straddling high-speed vision platform. This system can synchronize two camera inputs that share the same view with only a very small sub-microsecond time delay. Real-time video processing is performed using the hardware logic by extracting the moment features of multiple cells at 2000 fps or more, which are obtained from the two camera inputs, and their frame-straddling time can be adjusted from 0 to 0.5 ms in 9.9 ns steps. After setting the frame-straddling time within a certain range to avoid large image displacements between the two camera inputs, the frame-straddling high-speed vision platform can perform simultaneous shape and motion analysis of cells in fast microchannel flows of 1 m/s or greater. The results of real-time experiments conducted to analyze the deformabilities, velocities, and shapes of fast-flowing sea urchin egg cells in straight and L-type microchannels verified the efficacy of our vision-based cell analysis system.
Qingyi Gu, Tadayoshi Aoyama, Takeshi Takaki, Idaku Ishii
ICRA3
2014 Position/attitude control of an object by controlling a fluid field using a grid pattern air nozzle
abstract
A manipulator which enables noncontact control of the position and attitude of an object on a plane by controlling a fluid field is proposed. The manipulator comprises 2 boards with grid pattern arrangements of holes and a parallel link robot which is capable of translational motion with 2 degrees of freedom and rotational motion with 1 degree of freedom in a plane. Air jets are discharged from the grid of holes. The direction of the air jets from the holes can be controlled by changing the positional relationship of the 2 boards by means of the parallel link robot. This makes it possible to form an air flow with a unidirectional fluid field or a vortex-like fluid field. When an object is placed in the fluid field, translational motion and rotational motion of the object are possible. If the position and attitude of the object are photographed and calculated using high speed camera and feedback control is performed, the position and attitude of the object can be controlled. The structure of the manipulator and the principle of control of the fluid field are described, and the possibility of controlling the translational motion and rotational motion of an object is demonstrated experimentally.
Takeshi Takaki, Satomi Tanaka, Tadayoshi Aoyama, Idaku Ishii
ICRA1
2014 Real-time LOC-based morphological cell analysis system using high-speed vision
abstract
In this paper, a high-speed vision-based morphological analysis system for fast-flowing cells in a microchannel implementing a multi-object feature extraction algorithm on a high-speed vision platform is proposed. Real-time video processing is performed in hardware logic by extracting the moment features and bounding boxes of multiple cells in 512×256-pixel images at 2000 fps. The extracted cell regions are pushed into a first-in-first-out (FIFO) buffer for real-time image-based morphological analysis after being shrunk proportionally to a certain size. By extracting the bounding boxes of the cell regions using hardware logic and shrinking the cell region to a certain size to reduce processing time, our high-speed vision system can perform fast morphological analysis of cells at 2 ms/cell in fast microchannel flows. The results of real-time experiments conducted to analyze the size, eccentricity, and transparency of fertilized sea urchin eggs fast flowing in microchannels verify the efficacy of our vision-based cell analysis system.
Qingyi Gu, Tadayoshi Aoyama, Takeshi Takaki, Idaku Ishii, Ayumi Takemoto, Naoaki Sakamoto
IROS3
2013 Development of inverted pendulum robot capable of climbing stairs using planetary wheel mechanism
abstract
Improved robot mobility is necessary in order to realize the expected uses of robots in the human life environment, which includes obstacles such as stairs and narrow passages. Because objects which humans require are often located on desks or tables, which are at some height above ground level, a long vertical dimension is also necessary in the robot design. To meet these requirements, this study focused on a type of mobile robot using an inverted pendulum, which enables a robot with a long vertical dimension to negotiate narrow passages. Since it is difficult for inverted pendulum robots to climb steps, this study proposes a planetary wheel mechanism which makes it possible for an inverted pendulum robot to ascend differences in level. This mechanism has an extremely simple structure, comprising a belt, pulley, and arm, and has the advantage of not requiring addition of a new actuator. This paper describes the composition of the proposed mechanism and its principle of operation, and also describes the control method. A prototype of the robot was produced, and it was shown experimentally that the robot was capable of climbing stairs with a height of 120 mm-130 mm at a rate of approximately 2.4 s per one step.
Takeshi Takaki, Tadayoshi Aoyama, Idaku Ishii
ICRA1
2013 Fast 3-D shape measurement using blink-dot projection
abstract
We propose a novel dot-pattern-projection three-dimensional (3-D) shape measurement method that can measure 3-D displacements of blink dots projected onto a measured object accurately even when it moves rapidly or is observed from a camera as moving rapidly. In our method, blinking dot patterns, in which each dot changes its size at different timings corresponding to its identification (ID) number, are projected from a projector at a high frame rate. 3-D shapes can be obtained without any miscorrespondence of the projected dots between frames by simultaneous tracking and identification of multiple dots projected onto a measured 3-D object in a camera view. Our method is implemented on a field-programmable gate array (FPGA)-based high-frame-rate (HFR) vision platform that can track and recognize as much as 15×15 blink-dot pattern in a 512×512 image in real time at 1000 fps, synchronized with an HFR projector. We demonstrate the performance of our system by showing real-time 3-D measurement results when our system is mounted on a parallel link manipulator as a sensing head.
Jun Chen 0017, Qingyi Gu, Tadayoshi Aoyama, Takeshi Takaki, Idaku Ishii
IROS5
2013 Real-time feature-based video mosaicing at 500 fps
abstract
We conducted high-frame-rate (HFR) video mosaicing for real-time synthesis of a panoramic image by implementing an improved feature-based video mosaicing algorithm on a field-programmable gate array (FPGA)-based high-speed vision platform. In the implementation of the mosaicing algorithm, feature point extraction was accelerated by implementing a parallel processing circuit module for Harris corner detection in the FPGA on the high-speed vision platform. Feature point correspondence matching can be executed for hundreds of selected feature points in the current frame by searching those in the previous frame in their neighbor ranges, assuming that frame-to-frame image displacement becomes considerably smaller in HFR vision. The system we developed can mosaic 512×512 images at 500 fps as a single synthesized image in real time by stitching the images based on their estimated frame-to-frame changes in displacement and orientation. The results of an experiment conducted, in which an outdoor scene was captured using a hand-held camera-head that was quickly moved by hand, verify the performance of our system.
Ken-ichi Okumura, Sushil Raut, Qingyi Gu, Tadayoshi Aoyama, Takeshi Takaki, Idaku Ishii
IROS5
2013 A fast multi-camera tracking system with heterogeneous lenses
abstract
We have developed a fast target tracking system that utilizes four cameras with lenses of different focal lengths to track an object without blurring images, even when the object moves in the depth direction away from the cameras in three-dimensional (3-D) space. This system can maintain a well-focused camera view by switching among the four input images, instead of using lens motor control. The multi-camera system was mounted on a two-axis mechanical active vision platform. The active vision control and camera-view switching are executed by processing color 512 × 512 images from the four camera inputs at 500 fps in real time on a high-speed vision platform. The performance of our system was verified by its tracking results for objects moving rapidly in 3-D space.
Xiaorong Zhao, Qingyi Gu, Tadayoshi Aoyama, Takeshi Takaki, Idaku Ishii
IROS4
2013 Fast FPGA-Based Multiobject Feature Extraction
abstract
This paper describes a high-frame-rate (HFR) vision system that can extract locations and features of multiple objects in an image at 2000 f/s for 512 × 512 images by implementing a cell-based multiobject feature extraction algorithm as hardware logic on a field-programmable gate array-based high-speed vision platform. In the hardware implementation of the algorithm, 25 higher-order local autocorrelation features of 1024 objects in an image can be simultaneously extracted for multiobject recognition by dividing the image into 8 × 8 cells concurrently with calculation of the zeroth and first-order moments to obtain the sizes and locations of multiple objects. Our developed HFR multiobject extraction system was verified by performing several experiments: tracking for multiple objects rotating at 16 r/s, recognition for multiple patterns projected at 1000 f/s, and recognition for human gestures with quick finger motion.
Qingyi Gu, Takeshi Takaki, Idaku Ishii
IEEE Trans. Circuits Syst. Video Technol.2
2012 A real-time micro-PIV system using frame-straddling high-speed vision
abstract
In this study, we introduce a novel concept of real-time microscopic particle image velocimetry (micro-PIV) for high-speed microchannel flows in a lab-on-a-chip using a frame-straddling high-speed vision system with two camera inputs; it can synchronize two camera inputs with the same view field with a time delay on a submicrosecond time scale. To improve the measurable range of velocity in microchannel flow observation, we propose a variable-frame-straddling optical flow (VFS-OF) algorithm that can simultaneously estimate the microchannel flow distribution as gradient-based optical flows using frame-straddled images from the two camera inputs; their frame-straddling time is determined by the amplitude of the estimated optical flow to avoid large image displacements between frames that often generate serious errors in optical flow estimation. We built a real-time micro-PIV system by software-implementing the VFS-OF algorithm in a high-speed vision system with two frame-straddled cameras; it can execute real-time video processing and recording of 512×512-pixel images at 2000 frames per second for the two cameras and control their frame-straddling time from 0 to 0.5 ms with 9.9-ns steps. Our micro-PIV system can estimate the velocity distribution of high-speed microchannel flows at 1 m/s or more in real time by controlling the frame-straddling time. Experimental results were performed for microfluidic flows on microchannels with widths of hundreds of micrometers to verify the performance of our micro-PIV system based on the VFS-OF algorithm.
Motofumi Kobatake, Takeshi Takaki, Idaku Ishii
ICRA2
2012 High-Frame-Rate Optical Flow System
abstract
In this paper, we develop a high-frame-rate (HFR) vision system that can estimate the optical flow in real time at 1000 f/s for 1024×1024 pixel images via the hardware implementation of an improved optical flow detection algorithm on a high-speed vision platform. Based on the Lucas-Kanade method, we adopt an improved gradient-based algorithm that can adaptively select a pseudo-variable frame rate according to the amplitude of the estimated optical flow to accurately detect the optical flow for objects moving at high and low speeds in the same image. The performance of our developed HFR optical flow system was verified through experimental results for high-speed movements such as a top's spinnning motion and a human's pitching motion.
Idaku Ishii, Taku Taniguchi, Kenichi Yamamoto, Takeshi Takaki
IEEE Trans. Circuits Syst. Video Technol.4
2011 GPU-based face tracking at 500 fps
abstract
Real-time face tracking at 500 fps was realized for an 8-bit 512×512 color image on a GPU-based high-speed vision platform by implementing a boosting-based face detection algorithm. This algorithm was developed by enhancing the Viola-Jones face detector. In the implementation, the size and position of a face pattern in an image can be efficiently extracted at high speed by reducing the number of window searches for Haar-like features and by combining skin color extraction with Haar classifiers, while assuming a property of high-frame-rate (HFR) vision, i.e., a small interframe image displacement. Several experiments were performed by using rapidly moving face patterns in order to verify the effectiveness of the proposed face tracking system.
Idaku Ishii, Hiroki Ichida, Takeshi Takaki
ICIP3
2011 1000-fps target tracking using vibration-based image features
abstract
In this paper, we propose a concept for the real time target tracking of vibrating objects to extract vibration image regions using digital filters at all the pixels in an image, assuming that periodic changes in image intensities exist at pixels around vibrating objects. By combining vibration-based processing with color extraction as a masking process, our algorithm can prevent the latency effect on a digital filter, which may degrade its tracking performance. Digital filters at a pixel level are implemented on a 1000-fps vision system that can measure vibration distribution over a wide range of frequencies. On our target tracking system, we can track a vibrating object at the center of the camera view by controlling a 2-DOF (Degree Of Freedom) active vision system with vibration-based image features. We have verified its effectiveness by presenting several experimental results using objects vibrating at high frequencies, which cannot be observed with the naked eye.
Idaku Ishii, Ikuya Ohara, Tetsuro Tatebe, Takeshi Takaki
ICRA4
2011 Behavior recognition in laboratory mice using HFR video analysis
abstract
Abstract-In this paper, we propose an automatic behavior recognition algorithm for laboratory mice to determine their typical model behaviors and hence detect the degrees of diseases via animal testings for behavioral pharmacology. The algorithm can quantify several model behaviors of mice by detecting the repetitive motions of fore or hind limbs at several hertz; these motions, too rapid for the naked eye and the NTSC cameras, are captured on a high-frame-rate video. Even when a mouse changes its position and orientation, the algorithm can always detect these repetitive motions as periodic frame differential image features on four segmented regions-head, left side, right side, and tail-because the silhouette image of a mouse is converted in the polar coordinate system as its shift and rotation-invariant shape by detecting the positions of its head and tail. The effectiveness of the algorithm is evaluated for six typical model behaviors, including scratching and grooming, by analyzing the experimental results for several laboratory mice, obtained by capturing long-term videos at 240 fps. We have provided the detection/correction ratios and compared the time durations of the model behaviors of these mice.
Yuman Nie, Takeshi Takaki, Idaku Ishii, Hiroshi Matsuda
ICRA2
2011 Dynamics-based visual inspection through real-time modal analysis
abstract
In this study, we propose the concept of dynamics-based visual inspection for the verification of structural dynamic properties of a vibrating object; the inspection method involves the analysis of the vibration distribution of the object by using a high-frame-rate video. Under unknown ambient excitation, modal parameters of an excited object are simultaneously estimated to determine its input-invariant dynamic properties by using a fast output-only modal analysis algorithm, SSI-CPAST. The algorithm was implemented on a 2000-fps vision platform, and it facilitates non-destructive monitoring of the structure of beam-shaped objects vibrating at dozens of hertz; the algorithm detects small changes in the dynamic properties of the objects caused by internal defects such as fatigue cracks. The modal parameters resonant frequency and mode shape were actually estimated for beam-shaped objects excited by human finger tapping to verify the performance of 2000-fps real-time dynamics-based visual inspection.
Takeshi Takaki, Idaku Ishii
ICRA2
2011 Visual machinery surveillance for high-speed periodic operations
abstract
Abnormal behavior detection in periodic operations and high-frame-rate (HFR) video logging were realized by introducing a visual machinery surveillance algorithm, which includes a phase-encoding process for periodic operations to match input images with pre-stored reference images efficientl. Assuming that the periodic machinery operations to be monitored are perfectly regular, the surveillance algorithm can encode the phase of a periodic operation just by inspecting temporal changes in the brightnesses at several significan pixels in an input image; abnormal behavior in the periodic operation can be detected by comparing the input image with a reference image synchronized with its encoded phase without the heavy computation needed to search all the reference images. This algorithm was software-implemented on a high-speed vision platform, IDP express, which can record input images of 512 × 512 pixels and process the results at 1000 fps. An experiment was performed using a sewing machine with periodic operation at a frequency of 12 Hz, and a vidio of the abnormal behavior was automatically recorded at 1000 fps to verify the effectiveness of HFR-video-based machinery surveillance.
Idaku Ishii, Takeshi Takaki
IROS3
2010 2000-fps multi-object extraction based on cell-based labeling
abstract
Real-time multi-object extraction at 2000 fps was realized by designing a cell-based labeling algorithm. The algorithm can label the divided cells in an image by scanning the image only once to obtain their moment features, and the computational complexity required for labeling can be remarkably reduced. The cell-based labeling algorithm for 8 × 8 pixel cells was implemented on a high-speed vision platform, and multiple objects in an image of 512 × 512 pixels could be extracted at 2000 fps. An experiment was performed using a quickly rotating object to verify the performance of our multi-object extraction system.
Qingyi Gu, Takeshi Takaki, Idaku Ishii
ICIP2
2010 An intelligent high-frame-rate video logging system with real-time image processing at 1000 fps
abstract
This paper introduces an intelligent high-frame-rate video logging system that can automatically detect high-speed unpredictable behavior and record video comprising images with dimensions of 512 × 512 pixels at 1000 fps. To capture high-frame-rate video of crucial moments of abnormal behavior in high-speed periodic motion, a real-time abnormal behavior detection algorithm is implemented on a highspeed vision platform, IDP Express, which can record both input images and processed results at 1000 fps for video logging. Several experiments were performed using a machine with repetitive operation at a frequency of 15 Hz and video of the abnormal behavior was automatically recorded to verify the effectiveness of our system.
Idaku Ishii, Takeshi Takaki
ICME3
2010 2000 fps real-time vision system with high-frame-rate video recording
abstract
This paper introduces a high-speed vision system called IDP Express, which can execute real-time image processing and high frame rate video recording simultaneously. In IDP Express, a dedicated FPGA (Field Programmable Gate Array) board processes 512 × 512 pixel images from two camera heads by implementing image processing algorithms as hardware logic; the input images and processed results are transferred to standard PC memory at a rate of 2000 fps or more. Owing to the simultaneous high-frame-rate video processing and recording, IDP Express can be used as an intelligent video logger for long-term high-speed phenomenon analysis even when the measured objects move quickly in a wide area. We applied IDP Express to a mechanical target tracking system to record a high-frame-rate video at high resolution for a crucial moment, which is magnified by tracking the measured objects with visual feedback control. Several experiments on moving objects that undergo sudden shape deformation were performed. The results of the experiments involving the explosion of a rotating balloon and the crash of falling custard pudding have been provided to verify the effectiveness of IDP Express.
Idaku Ishii, Tetsuro Tatebe, Qingyi Gu, Yuta Moriue, Takeshi Takaki, Kenji Tajima
ICRA5
2010 Force visualization mechanism using a Moiré fringe applied to endoscopic surgical instruments
abstract
This paper presents a force visualization mechanism for endoscopic surgical instruments using a Moirée fringe. This mechanism can display fringes or characters that correspond to the magnitude of a force between the surgical instruments and internal organs without the use of electronic elements, such as amplifiers and strain gauges. As this mechanism is simply attached to the surgical instruments, there is no need for additional devices in the operating room or wires to connect these devices. The structure is simple, and its fabrication is inexpensive. An example is shown with the mechanism mounted on a 10-mm forceps. We experimentally verified in vivo, using a pig, that it can display characters corresponding to the magnitude of the force, thus visually displaying the force even in endoscopic image.
Takeshi Takaki, Youhei Omasa, Idaku Ishii, Tomohiro Kawahara, Masazumi Okajima
ICRA1
2010 Development of a broad-view camera system for minimally invasive surgery
abstract
A big advantage of minimally invasive surgery is the quick recovery afforded by the minimal physical injury sustained by patients. However, the operative field provided by the endoscope camera is rather narrow. This paper discusses a new broad-view camera system, which is capable of providing a wider view of the internal organs during minimally invasive surgery. This system consists of a camera unit for capturing the image and a monitor for displaying the captured image. With the use of this system, the invasiveness of the procedure does not increase, and the other specifications of current minimally invasive surgery are maintained. Furthermore, it can function as a second camera (in addition to the one attached to the endoscope) and can help assess the overall state of the target area. In this paper, we present this a newly developed camera system, which is intended for use along with the proposed system. The camera system is composed of a miniature color CMOS camera, an indwelling needle, and an extra-thin connector. The specific design of the camera unit and the method for positioning it are shown here. The performance of this camera system has been confirmed through basic and laparoscopic surgery on animals.
Tomohiro Kawahara, Takeshi Takaki, Idaku Ishii, Masazumi Okajima
IROS2
2009 Monocular stereo image processing using viewpoint switching iris
abstract
In the recent years, intensive studies have been carried out on the measurement of distance by using stereo camera systems. However, image systems with multiple image sensors are usually very complex and are inconvenient to use. In this paper, we present a new method that is based on the fact that the viewpoint depends on the position of aperture. We show images from different viewpoints can be obtained by using a monocular system. In the proposed method, stereo image analysis is carried out by using a viewpoint switching iris. A prototype of the viewpoint switching iris has be developed, which can be used along with a monocular camera for distance measurement. Furthermore, we have verified that this system can be used to a moving object by using a compensation method.
Yuta Moriue, Takeshi Takaki, Kenichi Yamamoto, Idaku Ishii
ICRA2
2009 High performance anthropomorphic robot hand with grasp force magnification mechanism
abstract
This paper presents a lightweight 328 g anthropomorphic robot hand that can exert a large grasp force. We propose a combination mechanism of a flexion-drive and a force-magnification-drive for a cable driven multifingered robot hand. The flexion-drive consisting of a feed screw enables quick motion of its fingers and the force-magnification-drive consisting of an eccentric cam, a bearing and a pulley enables a firm grasp. This paper also proposes a three-dimensional linkage for the thumb. This linkage consists of four links and is driven by a feed screw. It can oppose to a large force exerted by the other fingers with the force-magnification-drive. These mechanisms are compact enough to be installed in the developed lightweight hand. We experimentally verify that the maximum fingertip force of the hand exceeds 20 N and that the thumb can hold a large force of 100 N. The time to fully close the hand by using the flexion-drives is 0.47 s. After the fingers make contact with an object, the time to achieve a firm grasp by using the grasp-magnification-drive is approximately 1 s.
Takeshi Takaki, Toru Omata
ICRA1
2007 Grasp Force Magnifying Mechanism for Parallel Jaw Grippers
abstract
This paper proposes a force magnifying mechanism for a parallel jaw gripper that can exert a large grasp force. A parallel jaw gripper requires speed when opening and closing its jaws, and force when grasping an object. The proposed force magnifying mechanism consists of a slider, feed screws, gears, a lever, etc. It runs sequentially with only one DC-motor. Basically the motor rotates a feed screw to move its output jaw quickly to an object with a gear. When the output jaw makes contact with an object, the gear is loosened from a stopper and starts to move axially along the feed screw. Then it pushes a lever, which generates a large fingertip force. We have developed an 86g gripper with this mechanism and experimentally verified that it can grasp objects of various sizes with a large grasp force over 200N. It is also experimentally verified that the gripper can grasp and ungrasp an object reliably over 4500 times if machine lubricant is properly supplied.
Takeshi Takaki, Toru Omata
ICRA1
2006 100g-100N Finger Joint with Load-sensitive Continuously Variable Transmission
abstract
This paper presents a 99 g finger joint that can exert a very strong fingertip force of more than 100 N. We have shown that a simple five-bar linkage can be used as a load-sensitive continuously variable transmission (CVT) for a finger joint. The maximum fingertip force of our previous finger was limited by the mechanical strength of its links and bearings, not by the power of its DC motor. If the machine strength can be improved, a much greater fingertip force can be expected. To design a lightweight CVT with sufficient mechanical strength, we analyze the internal force of the CVT and select light plain bearings. We also analyze the stress by using the finite element method and select the materials of its links. Experimental results verify that the maximum fingertip force is more than 100 N near the singular configuration of the CVT and the maximum angular velocity is more than 550 deg/s. These motions are impossible without the CVT. We also developed a very light shape memory alloy brake of 0.56 g. The CVT with the brake can hold a fingertip force of more than 100 N not only near the singular configuration. The electric energy consumed by the brake is much less than that by the DC motor
Takeshi Takaki, Toru Omata
ICRA1
2004 Load-sensitive Continuously Variable Transmission for Robot Hands
abstract
This paper presents a load-sensitive continuously variable transmission (CVT) for finger joints. The fingers of a robot hand require power when grasping an object and speed when opening and closing. Therefore a CVT is ideal to improve the power transmission of a finger joint. Existing friction CVTs are too big and heavy to be installed in a finger joint. By focusing on the fact that finger joints do not necessarily rotate 360 degrees, a remarkably simple and small load-sensitive CVT can be developed based on a crank CVT. The mechanism consists of a five-bar linkage and a torsion coiled spring. We have developed one joint with the CVT and have experimentally verified that the CVT can increase its reduction ratio from 0.5 to 3.3 in response to a load.
Takeshi Takaki, Toru Omata
ICRA1