Konstantinos Karydis

dblp:117/2150 · DBLP profile ↗
← Back
35ranked-venue papers
5as first author
24since 2021 · last 2026
0000-0002-1144-8260ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 30 · 4 first-author · 20 since 2021Systems, architecture and hardware · 22 · 4 first-author · 14 since 2021Applied, interdisciplinary, general and emerging computing · 7 · 1 first-author · 6 since 2021Graphics, computer vision, multimedia, augmented reality and games · 4 · 4 since 2021Human-computer interaction and ubiquitous computing · 4 · 4 since 2021
YearPublicationVenuePosition
2026 Visibility guided Self-Supervised Occlusion-Resilient Human Pose Estimation
abstract
Occlusion remains a significant challenge for existing human pose estimation algorithms, often resulting in inaccurate and anatomically implausible predictions. Although recent occlusion-robust methods report strong performance, they typically rely heavily on supervised learning and privileged information, such as multiview data or temporal sequences. Furthermore, these models often fail under domain changes. Domain-adaptive human pose estimation seeks to mitigate this issue; however, when occlusions are present in the target domain, a common occurrence in real-world applications, performance of these algorithms deteriorates significantly. To address these challenges, we propose VisOR, a novel Visibility guided Self-Supervised algorithm for Occlusion-Resilient Human Pose Estimation. VisOR achieves robustness to both domain shifts and occlusions by integrating contextual reasoning with iterative pseudo-label refinement. It mitigates the overfitting to noisy labels from occluded regions via a visibility-driven curriculum learning strategy, which progressively introduces the model to increasingly occluded training samples. Additionally, VisOR is regularized by a learned human pose prior that maintains anatomical plausibility throughout the adaptation process. Recognizing the scarcity of human pose datasets with realistic occlusions, we introduce BOW Blended Occlusions in-the-Wild, a rigorously constructed context-aware synthetic benchmark designed to evaluate the occlusion resilience of human pose estimation algorithms. BOW offers a diverse range of context-aware occlusions across both indoor and outdoor environments, simulating real-world conditions. Through extensive experiments, we demonstrate that VisOR outperforms current state-of-the-art methods by ∼ 7% in challenging occluded human pose estimation benchmarks and provides a baseline performance on BOW, against existing algorithms.
Arindam Dutta, Sarosij Bose, Rohit Kundu, Calvin-Khang Ta, Saketh Bachu, Konstantinos Karydis, Amit K. Roy-Chowdhury
WACV6
2026 Koopman Operators in Robot Learning
abstract
Koopman operator theory offers a rigorous treatment of dynamics, emerging as a robust alternative for learning-based control in robotics. By representing nonlinear dynamics as a linear, higher-dimensional operator, it provides a fresh lens for modeling complex systems. Its ability to support incremental updates and low computational cost makes it particularly appealing for real-time applications and online learning. This review delves deeply into the foundations, systematically bridging theoretical principles to practical robotic applications. We explain mathematical underpinnings, approximation approaches for inputs, data collection strategies, and lifting function design. We explore how Koopman models unify tasks like model-based control, state estimation, and motion planning. The review surveys cutting-edge research across domains ranging from aerial and legged platforms to manipulators, soft robots, and multi-agent networks. We also present advanced theoretical topics and reflect on open challenges and future research directions. To support adoption, we provide a hands-on tutorial with code athttps://github.com/sunnyshi0310/KoopmanRobo/tree/main.
Lu Shi 0007, Masih Haseli, Giorgos Mamakoukas, Daniel Bruder, Ian Abraham, Todd D. Murphey, Jorge Cortés 0001, Konstantinos Karydis
IEEE Trans. Robotics8
2025 Uncertainty-Aware Diffusion-Guided Refinement of 3D Scenes
abstract
Reconstructing 3D scenes from a single image is a fundamentally ill-posed task due to the severely under-constrained nature of the problem. Consequently, when the scene is rendered from novel camera views, existing single image to 3D reconstruction methods render incoherent and blurry views. This problem is exacerbated when the unseen regions are far away from the input camera. In this work, we address these inherent limitations in existing single image-to-3D scene feedforward networks. To alleviate the poor performance due to insufficient information beyond the input image's view, we leverage a strong generative prior in the form of a pre-trained latent video diffusion model, for iterative refinement of a coarse scene represented by optimizable Gaussian parameters. To ensure that the style and texture of the generated images align with that of the input image, we incorporate on-the-fly Fourier-style transfer between the generated images and the input image. Additionally, we design a semantic uncertainty quantification module that calculates the per-pixel entropy and yields uncertainty maps used to guide the refinement process from the most confident pixels while discarding the remaining highly uncertain ones. We conduct extensive experiments on real-world scene datasets, including in-domain RealEstate-10K and out-of-domain KITTI-v2, showing that our approach can provide more realistic and high-fidelity novel view synthesis results compared to existing state-of-the-art methods.
Sarosij Bose, Arindam Dutta, Sayak Nag, Junge Zhang, Konstantinos Karydis, Amit K. Roy-Chowdhury
ICCV6
2025 Hierarchical Tri-Manual Planning for Vision-Assisted Fruit Harvesting with Quadrupedal Robots
abstract
This paper addresses the challenge of developing a multi-arm quadrupedal robot capable of efficiently harvesting fruit in complex, natural environments. To overcome the inherent limitations of traditional bimanual manipulation, we introduce the first three-arm quadrupedal robot LocoHarv3, that builds on top of the Spot quadruped, and propose a novel hierarchical tri-manual planning approach for automated fruit harvesting with collision-free trajectories between the built-in end-effector of Spot and our custom-made bimanual manipulator. Our comprehensive semi-autonomous framework integrates teleoperation, supported by LiDAR-based odometry and mapping, with learning-based visual perception for accurate fruit detection and pose estimation. Validation is conducted through a series of controlled indoor experiments using motion capture and extensive field tests in natural settings. Results demonstrate a 90 % success rate in in-lab settings with a single attempt, and field trials further verify the system's robustness and efficiency in more challenging real-world environments.
Jingzong Zhou, Konstantinos Karydis
ICRA3
2025 Deformable Multibody Modeling for Model Predictive Control in Legged Locomotion with Embodied Compliance
abstract
The paper presents a method to stabilize dynamic gait for a legged robot with embodied compliance. Our approach introduces a unified description for rigid and compliant bodies to approximate their deformation and a formulation for deformable multibody systems. We develop the centroidal composite predictive deformed inertia (CCPDI) tensor of a deformable multibody system and show how to integrate it with the standard-of-practice model predictive controller (MPC). Simulation shows that the resultant control framework can stabilize trot stepping on a quadrupedal robot with both rigid and compliant spines under the same MPC configurations. Compared to standard MPC, the developed CCPDI-enabled MPC distributes the ground reactive forces closer to the heuristics for body balance, and it is thus more likely to stabilize the gaits of the compliant robot. A parametric study shows that our method preserves some level of robustness within a suitable envelope of key parameter values.
Keran Ye, Konstantinos Karydis
ICRA2
2024 Design and Central Pattern Generator Control of a New Transformable Wheel-Legged Robot
abstract
This paper introduces a new wheel-legged robot and develops motion controllers based on central pattern generators (CPGs) for the robot to navigate over a range of terrains. A transformable leg-wheel design is considered and characterized in terms of key locomotion characteristics as a function of the design. Kinematic analysis is conducted based on a generalized four-bar mechanism driven by a coaxial hub arrangement. The analysis is used to inform the design of a central pattern generator to control the robot by mapping oscillator states to wheel-leg trajectories and implementing differential steering within the oscillator network. Three oscillator models are used as the basis of the CPGs, and their performance is compared over a range of inputs. The CPG-based controller is used to drive the developed robot prototype on level ground and over obstacles. Additional simulated tests are performed for uneven terrain negotiation and obstacle climbing. Results demonstrate the effectiveness of CPG control in transformable wheel-legged robots.
Tyler Bishop, Keran Ye, Konstantinos Karydis
ICRA3
2024 On-the-Go Tree Detection and Geometric Traits Estimation with Ground Mobile Robots in Fruit Tree Groves
abstract
By-tree information gathering is an essential task in precision agriculture achieved by ground mobile sensors, but it can be time- and labor-intensive. In this paper we present an algorithmic framework to perform real-time and on-the-go detection of trees and key geometric characteristics (namely, width and height) with wheeled mobile robots in the field. Our method is based on the fusion of 2D domain-specific data (normalized difference vegetation index [NDVI] acquired via a red-green-near-infrared [RGN] camera) and 3D LiDAR point clouds, via a customized tree landmark association and parameter estimation algorithm. The proposed system features a multi-modal and entropy-based landmark correspondences approach, integrated into an underlying Kalman filter system to recognize the surrounding trees and jointly estimate their spatial and vegetation-based characteristics. Realistic simulated tests are used to evaluate our proposed algorithm’s behavior in a variety of settings. Physical experiments in agricultural fields help validate our method’s efficacy in acquiring accurate by-tree information on-the-go and in real-time by employing only onboard computational and sensing resources.
Dimitrios Chatziparaschis, Hanzhe Teng, Yipeng Wang 0020, Pamodya Peiris, Elia Scudiero, Konstantinos Karydis
ICRA6
2024 Adaptive Environment-Aware Robotic Arm Reaching Based on a Bio-Inspired Neurodynamical Computational Framework
abstract
Bio-inspired robotic systems are capable of adaptive learning, scalable control, and efficient information processing. Enabling real-time decision-making for such systems is critical to respond to dynamic changes in the environment. We focus on dynamic target tracking in open areas using a robotic six-degree-of-freedom manipulator with a bird-eye view camera for visual feedback, and by deploying the Neurodynamical Computational Framework (NeuCF). NeuCF is a recently developed bio-inspired model for target tracking based on Dynamic Neural Fields (DNFs) and Stochastic Optimal Control (SOC) theory. It has been trained for reaching actions on a planar surface toward localized visual beacons, and it can retarget or generate stop signals on the fly based on changes in the environment (e.g., a new target has emerged, or an existing one has been removed). We evaluated our system over various target-reaching scenarios. In all experiments, NeuCF had high end-effector positional accuracy, generated smooth trajectories, and provided reduced path lengths compared with a baseline cubic polynomial trajectory generator. In all, the developed system offers a robust and dynamic-aware robotic manipulation approach that affords real-time decision-making.
Dimitrios Chatziparaschis, Vasileios Christopoulos, Konstantinos Karydis
RO-MAN4
2023 SUMMIT: Source-Free Adaptation of Uni-Modal Models to Multi-Modal Targets
abstract
Scene understanding using multi-modal data is necessary in many applications, e.g., autonomous navigation. To achieve this in a variety of situations, existing models must be able to adapt to shifting data distributions without arduous data annotation. Current approaches assume that the source data is available during adaptation and that the source consists of paired multi-modal data. Both these assumptions may be problematic for many applications. Source data may not be available due to privacy, security, or economic concerns. Assuming the existence of paired multi-modal data for training also entails significant data collection costs and fails to take advantage of widely available freely distributed pre-trained uni-modal models. In this work, we relax both of these assumptions by addressing the problem of adapting a set of models trained independently on uni-modal data to a target domain consisting of unlabeled multi-modal data, without having access to the original source dataset. Our proposed approach solves this problem through a switching framework which automatically chooses between two complementary methods of cross-modal pseudo-label fusion – agreement filtering and entropy weighting – based on the estimated domain gap. We demonstrate our work on the semantic segmentation problem. Experiments across seven challenging adaptation scenarios verify the efficacy of our approach, achieving results comparable to, and in some cases outperforming, methods which assume access to source data. Our method achieves an improvement in mIoU of up to 12% over competing baselines. Our code is publicly available at https://github.com/csimo005/SUMMIT.
Cody Simons, Dripta S. Raychaudhuri, Sk Miraj Ahmed, Suya You, Konstantinos Karydis, Amit K. Roy-Chowdhury
ICCV5
2023 Evaluation of Legged Robot Landing Capability Under Aggressive Linear and Angular Velocities
abstract
This paper proposes a method to evaluate the capability of aggressive legged robot landing under significant touchdown linear and angular velocities upon impact. Our approach builds upon the Planar Inverted Pendulum with Flywheel (PIPF) model and introduces a landing framework for the first stance step on a non-dimensional basis. We develop a nonlinear framework with iterative constrained trajectory optimization to stabilize the first stance step prior to N-step Capturability analysis. Performance maps across many different initial conditions reveal approximately linear boundaries as well as the effect of inertia, body incidence angle and leg attacking angle on the boundary shape. Our method also yields the engineering insight that body inertia affects the performance map the most, hence its optimization can be prioritized when the target is to improve robot landing efficacy.
Keran Ye, Konstantinos Karydis
ICRA2
2023 Dynamic Modeling and Analysis of Impact-Resilient MAVs Undergoing High-Speed and Large-Angle Collisions with the Environment
abstract
Micro Aerial Vehicles (MAVs) often face a high risk of collision during autonomous flight, particularly in cluttered and unstructured environments. To mitigate the collision impact on sensitive onboard devices, resilient MAVs with mechanical protective cages and reinforced frames are commonly used. However, compliant and impact-resilient MAVs offer a promising alternative by reducing the potential damage caused by impacts. In this study, we present novel findings on the impact-resilient capabilities of MAVs equipped with passive springs in their compliant arms. We analyze the effect of compliance through dynamic modeling and demonstrate that the inclusion of passive springs enhances impact resilience. The impact resilience is extensively tested to stabilize the MAV following wall collisions under high-speed and large-angle conditions. Additionally, we provide comprehensive comparisons with rigid MAVs to better determine the tradeoffs in flight by embedding compliance onto the robot's frame.
Konstantinos Karydis
IROS2
2023 Robust Generalized Proportional Integral Control for Trajectory Tracking of Soft Actuators in a Pediatric Wearable Assistive Device
abstract
Soft robotics hold promise in the development of safe yet powered assistive wearable devices for infants. Key to this is the development of closed-loop controllers that can help regulate pneumatic pressure in the device's actuators in an effort to induce controlled motion at the user's limbs and be able to track different types of trajectories. This work develops a controller for soft pneumatic actuators aimed to power a pediatric soft wearable robotic device prototype for upper extremity motion assistance. The controller tracks desired trajectories for a system of soft pneumatic actuators supporting two-degree-of-freedom shoulder joint motion on an infant-sized engineered mannequin. The degrees of freedom assisted by the actuators are equivalent to shoulder motion (abduction/adduction and flexion/extension). Embedded inertial measurement unit sensors provide real-time joint feedback. Experimental data from performing reaching tasks using the engineered mannequin are obtained and compared against ground truth to evaluate the performance of the developed controller. Results reveal the proposed controller leads to accurate trajectory tracking performance across a variety of shoulder joint motions.
Caio Mucchiani, Ipsita Sahin, Elena Kokkoni, Konstantinos Karydis
IROS5
2023 A Novel Lockable Spring-Loaded Prismatic Spine to Support Agile Quadrupedal Locomotion
abstract
This paper introduces a way to systematically investigate the effect of compliant prismatic spines in quadrupedal robot locomotion. We develop a novel spring-loaded lockable spine module, together with a new Spinal Compliance-Integrated Quadruped (SCIQ) platform for both empirical and numerical research. Individual spine tests reveal beneficial spinal characteristics like a degressive spring, and validate the efficacy of a proposed compact locking/unlocking mechanism for the spine. Benchmark vertical jumping and landing tests with our robot show comparable jumping performance between the rigid and compliant spines. An observed advantage of the compliant spine module is that it can alleviate more challenging landing conditions by absorbing impact energy and dissipating the remainder via feet slipping through much in cat-like stretching fashion.
Keran Ye, Kenneth Chung, Konstantinos Karydis
IROS3
2023 Centroid Distance Keypoint Detector for Colored Point Clouds
abstract
Keypoint detection serves as the basis for many computer vision and robotics applications. Despite the fact that colored point clouds can be readily obtained, most existing keypoint detectors extract only geometry-salient keypoints, which can impede the overall performance of systems that intend to (or have the potential to) leverage color information. To promote advances in such systems, we propose an efficient multi-modal keypoint detector that can extract both geometry-salient and color-salient keypoints in colored point clouds. The proposed CEntroid Distance (CED) key- point detector comprises an intuitive and effective saliency measure, the centroid distance, that can be used in both 3D space and color space, and a multi-modal non-maximum suppression algorithm that can select keypoints with high saliency in two or more modalities. The proposed saliency measure leverages directly the distribution of points in a local neighborhood and does not require normal estimation or eigenvalue decomposition. We evaluate the proposed method in terms of repeatability and computational efficiency (i.e. running time) against state-of-the-art key- point detectors on both synthetic and real-world datasets. Results demonstrate that our proposed CED keypoint detector requires minimal computational time while attaining high repeatability. To showcase one of the potential applications of the proposed method, we further investigate the task of colored point cloud registration. Results suggest that our proposed CED detector outperforms state-of- the-art handcrafted and learning-based keypoint detectors in the evaluated scenes. The C++ implementation of the proposed method is made publicly available at https://github.com/UCR-Robotics/CED_Detector.
Hanzhe Teng, Dimitrios Chatziparaschis, Xinyue Kan, Amit K. Roy-Chowdhury, Konstantinos Karydis
WACV5
2023 Online Search-Based Collision-Inclusive Motion Planning and Control for Impact-Resilient Mobile Robots
abstract
This article focuses on the emerging paradigm shift of collision-inclusive motion planning and control for impact-resilient mobile robots, and develops a unified hierarchical framework for navigation in unknown and partially observable cluttered spaces. At the lower level, we develop a deformation recovery control and trajectory replanning strategy that handles collisions that may occur at run time, locally. The low-level system actively detects collisions (via embedded Hall effect sensors on a mobile robot built in-house), enables the robot to recover from them, and locally adjusts the postimpact trajectory. Then, at the higher level, we propose a search-based planning algorithm to determine how to best utilize potential collisions to improve certain metrics, such as control energy and computational time. Our method builds upon A* with jump points. We generate a novel heuristic function, and a collision checking and adjustment technique, thus making the A* algorithm converge faster to reach the goal by exploiting and utilizing possible collisions. The overall hierarchical framework generated by combining the global A* algorithm and the local deformation recovery and replanning strategy, as well as individual components of this framework, are tested extensively both in simulation and experimentally. An ablation study draws links to related state-of-the-art search-based collision-avoidance planners (for the overall framework), as well as search-based collision-avoidance and sampling-based collision-inclusive global planners (for the higher level). Results demonstrate our method's efficacy for collision-inclusive motion planning and control in unknown environments with isolated obstacles for a class of impact-resilient robots operating in 2-D.
Zhouyu Lu, Merrick Campbell, Konstantinos Karydis
IEEE Trans. Robotics4
2022 An Integrated Actuation-Perception Framework for Robotic Leaf Retrieval: Detection, Localization, and Cutting
abstract
Contemporary robots in precision agriculture focus primarily on automated harvesting or remote sensing to monitor crop health. Comparatively less work has been performed with respect to collecting physical leaf samples in the field and retaining them for further analysis. Typically, orchard growers manually collect sample leaves and utilize them for stem water potential measurements to analyze tree health and determine irrigation routines. While this technique benefits orchard management, the process of collecting, assessing, and interpreting measurements requires significant human labor and often leads to infrequent sampling. Automated sampling can provide highly accurate and timely information to growers. The first step in such automated in-situ leaf analysis is identifying and cutting a leaf from a tree. This retrieval process requires new methods for actuation and perception. We present a technique for detecting and localizing candidate leaves using point cloud data from a depth camera. This technique is tested on both indoor and outdoor point clouds from avocado trees. We then use a custom-built leaf-cutting end-effector on a 6-DOF robotic arm to test the proposed detection and localization technique by cutting leaves from an avocado tree. Experimental testing with a real avocado tree demonstrates our proposed approach can enable our mobile manipulator and custom end-effector system to successfully detect, localize, and cut leaves.
Merrick Campbell, Amel Dechemi, Konstantinos Karydis
IROS3
2022 Closed-loop Position Control of a Pediatric Soft Robotic Wearable Device for Upper Extremity Assistance
abstract
This work focuses on closed-loop control based on proprioceptive feedback for a pneumatically-actuated soft wearable device aimed at future support of infant reaching tasks. The device comprises two soft pneumatic actuators (one textile-based and one silicone-casted) actively controlling two degrees-of-freedom per arm (shoulder adduction/abduction and elbow flexion/extension, respectively). Inertial measurement units (IMUs) attached to the wearable device provide real-time joint angle feedback. Device kinematics analysis is informed by anthropometric data from infants (arm lengths) reported in the literature. Range of motion and muscle co-activation patterns in infant reaching are considered to derive desired trajectories for the device’s end-effector. Then, a proportional-derivative controller is developed to regulate the pressure inside the actuators and in turn move the arm along desired setpoints within the reachable workspace. Experimental results on tracking desired arm trajectories using an engineered mannequin are presented, demonstrating that the proposed controller can help guide the mannequin’s wrist to the desired setpoints.
Caio Mucchiani, Ipsita Sahin, Jared Dube, Linh Vu, Elena Kokkoni, Konstantinos Karydis
RO-MAN7
2022 A Bidirectional Fabric-based Pneumatic Actuator for the Infant Shoulder: Design and Comparative Kinematic Analysis
abstract
This paper presents the design and assessment of a fabric-based soft pneumatic actuator with low pressurization requirements for actuation making it suitable for upper extremity assistive devices for infants. The goal is to support shoulder abduction and adduction without prohibiting motion in other planes or obstructing elbow joint motion. First, the performance of a family of actuator designs with internal air cells is explored via simulation. The actuators are parameterized by the number of cells and their width. Physically viable actuator variants identified through the simulation are further tested via hardware experiments. Two designs are selected and tested on a custom-built physical model based on an infant’s body anthropometrics. Comparisons between force exerted to lift the arm, movement smoothness, path length and maximum shoulder angle reached inform which design is better suited for its use as an actuator for pediatric wearable assistive devices, along with other insights for future work.
Ipsita Sahin, Jared Dube, Caio Mucchiani, Konstantinos Karydis, Elena Kokkoni
RO-MAN4
2021 Toward Impact-resilient Quadrotor Design, Collision Characterization and Recovery Control to Sustain Flight after Collisions
abstract
Collision detection and recovery for aerial robots remain a challenge because of the limited space for sensors and local stability of the flight controller. We introduce a novel collision-resilient quadrotor that features a compliant arm design to enable free flight while allowing for one passive degree of freedom to absorb shocks. We further propose a novel collision detection and characterization method based on Hall sensors, as well as a new recovery control method to generate and track a smooth trajectory after a collision occurs. Experimental results demonstrate that the robot can detect and recover from high-speed collisions with various obstacles such as walls and poles. Moreover, it can survive collisions that are hard to detect with existing methods based on IMU data and contact models, for example, when colliding with unstructured surfaces, or being hit by a moving obstacle while hovering.
Konstantinos Karydis
ICRA2
2021 Enhancement for Robustness of Koopman Operator-based Data-driven Mobile Robotic Systems
abstract
Koopman operator theory has served as the basis to extract dynamics for nonlinear system modeling and control across settings, including non-holonomic mobile robot control. There is a growing interest in research to derive robustness (and/or safety) guarantees for systems the dynamics of which are extracted via the Koopman operator. In this paper, we propose a way to quantify the prediction error because of noisy measurements when the Koopman operator is approximated via Extended Dynamic Mode Decomposition. We further develop an enhanced robot control strategy to endow robustness to a class of data-driven (robotic) systems that rely on Koopman operator theory, and we show how part of the strategy can happen offline in an effort to make our algorithm capable of real-time implementation. We perform a parametric study to evaluate the (theoretical) performance of the algorithm using a Van der Pol oscillator, and conduct a series of simulated experiments in Gazebo using a non-holonomic wheeled robot.
Lu Shi 0007, Konstantinos Karydis
ICRA2
2021 Position Control and Variable-Height Trajectory Tracking of a Soft Pneumatic Legged Robot
abstract
Soft pneumatic legged robots show promise in their ability to traverse a range of different types of terrain, including natural unstructured terrain met in applications like precision agriculture. They can adapt their body morphology to the intricacies of the terrain at hand, thus enabling robust and resilient locomotion. In this paper we capitalize upon recent developments on soft pneumatic legged robots to introduce a closed-loop trajectory tracking control scheme for operation over flat ground. Closed-loop pneumatic actuation feedback is achieved via a compact and portable pneumatic regulation board. Experimental results reveal that our soft legged robot can precisely control its body height and orientation while in quasi-static operation based on a geometric model. The robot can track both straight line and curved trajectories as well as variable-height trajectories. This work lays the basis to enable autonomous navigation for soft legged robots.
Konstantinos Karydis
IROS2
2021 Deformation Recovery Control and Post-Impact Trajectory Replanning for Collision-Resilient Mobile Robots
abstract
The paper focuses on collision-inclusive motion planning for impact-resilient mobile robots. We propose a new deformation recovery and replanning strategy to handle collisions that may occur at run-time. Contrary to collision avoidance methods that generate trajectories only in conservative local space or require collision checking that has high computational cost, our method directly generates (local) trajectories with imposing only waypoint constraints. If a collision occurs, our method then estimates the post-impact state and computes from there an intermediate waypoint to recover from the collision. To achieve so, we develop two novel components: 1) a deformation recovery controller that optimizes the robot’s states during post-impact recovery phase, and 2) a post-impact trajectory replanner that adjusts the next waypoint with the information from the collision for the robot to pass through and generates a polynomial-based minimum effort trajectory. The proposed strategy is evaluated experimentally with an omnidirectional impact-resilient wheeled robot. The robot is designed in house, and it can perceive collisions with the aid of Hall effect sensors embodied between the robot’s main chassis and a surrounding deflection ring-like structure.
Zhouyu Lu, Konstantinos Karydis
IROS3
2021 Modeling and Trajectory Optimization for Standing Long Jumping of a Quadruped with A Preloaded Elastic Prismatic Spine
abstract
This paper presents a novel methodology to model and optimize trajectories of a quadrupedal robot with spinal compliance to improve standing jump performance compared to quadrupeds with a rigid spine. We introduce an elastic model for a prismatic robotic spine that is actively preloaded and mechanically lock-enabled at initial and maximum length, and develop a constrained trajectory optimization method to cooptimize the elastic parameters and motion trajectories toward enhanced jumping distance. Results reveal that a less stiff spring is likely to facilitate jumping performance not as a direct propelling source but as a means to unleash more motor power for propelling by trading-off overall energy efficiency. We also visualize the impact of spring coefficients on the overall optimization routine from energetic perspectives to identify the suitable parameter region.
Keran Ye, Konstantinos Karydis
IROS2
2021 BabyNet: A Lightweight Network for Infant Reaching Action Recognition in Unconstrained Environments to Support Future Pediatric Rehabilitation Applications
abstract
Action recognition is an important component to improve autonomy of physical rehabilitation devices, such as wearable robotic exoskeletons. Existing human action recognition algorithms focus on adult applications rather than pediatric ones. In this paper, we introduce BabyNet, a light-weight (in terms of trainable parameters) network structure to recognize infant reaching action from off-body stationary cameras. We develop an annotated dataset that includes diverse reaches performed while in a sitting posture by different infants in unconstrained environments (e.g., in home settings, etc.). Our approach uses the spatial and temporal connection of annotated bounding boxes to interpret onset and offset of reaching, and to detect a complete reaching action. We evaluate the efficiency of our proposed approach and compare its performance against other learning-based network structures in terms of capability of capturing temporal inter-dependencies and accuracy of detection of reaching onset and offset. Results indicate our BabyNet can attain solid performance in terms of (average) testing accuracy that exceeds that of other larger networks, and can hence serve as a light-weight data-driven framework for video-based infant reaching action recognition.
Amel Dechemi, Vikarn Bhakri, Ipsita Sahin, Arjun Modi, Julya Mestas, Pamodya Peiris, Dannya Enriquez Barrundia, Elena Kokkoni, Konstantinos Karydis
RO-MAN9
2020 SoRX: A Soft Pneumatic Hexapedal Robot to Traverse Rough, Steep, and Unstable Terrain
abstract
Soft robotics technology creates new ways for legged robots to interact with and adapt to their environment. In this paper we develop i) a new 2-degree-of-freedom soft pneumatic actuator, and ii) a novel soft robotic hexapedal robot called SoRX that leverages the new actuators. Simulation and physical testing confirm that the proposed actuator can generate cyclic foot trajectories that are appropriate for legged locomotion. Consistent with other hexapedal robots (and animals), SoRX employs an alternating tripod gait to propel itself forward. Experiments reveal that SoRX can reach forward speeds of up to 0.44 body lengths per second, or equivalently 101 mm/s. With a size of 230 mm length, 140 mm width and 100 mm height, and weight of 650 grams, SoRX is among the fastest tethered soft pneumatically-actuated legged robots to date. The motion capabilities of SoRX are evaluated through five experiments: running, step climbing, and traversing rough terrain, steep terrain, and unstable terrain. Experimental results show that SoRX is able to operate over challenging terrains in open-loop control and by following the same alternating tripod gait across all experimental cases.
Zhouyu Lu, Konstantinos Karydis
ICRA3
2020 Motion Planning for Collision-resilient Mobile Robots in Obstacle-cluttered Unknown Environments with Risk Reward Trade-offs
abstract
Collision avoidance in unknown obstacle-cluttered environments may not always be feasible. This paper focuses on an emerging paradigm shift in which potential collisions with the environment can be harnessed instead of being avoided altogether. To this end, we introduce a new sampling-based online planning algorithm that can explicitly handle the risk of colliding with the environment and can switch between collision avoidance and collision exploitation. Central to the planner's capabilities is a novel joint optimization function that evaluates the effect of possible collisions using a reflection model. This way, the planner can make deliberate decisions to collide with the environment if such collision is expected to help the robot make progress toward its goal. To make the algorithm online, we present a state expansion pruning technique that significantly reduces the search space while ensuring completeness. The proposed algorithm is evaluated experimentally with a built-in-house holonomic wheeled robot that can withstand collisions. We perform an extensive parametric study to investigate trade-offs between (user-tuned) levels of risk, deliberate collision decision making, and trajectory statistics such as time to reach the goal and path length.
Zhouyu Lu, Gustavo Correa, Konstantinos Karydis
IROS4
2019 OpenRoACH: A Durable Open-Source Hexapedal Platform with Onboard Robot Operating System (ROS)
abstract
OpenRoACH is a 15-cm 200-gram self-contained hexapedal robot with an onboard single-board computer. To our knowledge, it is the smallest legged robot with the capability of running the Robot Operating System (ROS) onboard. The robot is fully open sourced, uses accessible materials and off-the-shelf electronic components, can be fabricated with benchtop fast-prototyping machines such as a laser cutter and a 3D printer, and can be assembled by one person within two hours. Its sensory capacity has been tested with gyroscopes, accelerometers, Beacon sensors, color vision sensors, linescan sensors and cameras. It is low-cost within $150 including structure materials, motors, electronics, and a battery. The capabilities of OpenRoACH are demonstrated with multi-surface walking and running, 24-hour continuous walking burn-ins, carrying 200-gram dynamic payloads and 800-gram static payloads, and ROS control of steering based on camera feedback. Information and files related to mechanical design, fabrication, assembly, electronics, and control algorithms are all publicly available on https://wiki.eecs.berkeley.edu/biomimetics/Main/OpenRoACH.
Liyu Wang, Gustavo Correa, Konstantinos Karydis, Ronald S. Fearing
ICRA4
2018 Memory Augmented Control Networks
Arbaaz Khan, Clark Zhang, Nikolay Atanasov 0001, Konstantinos Karydis, Vijay Kumar 0001, Daniel D. Lee
ICLR (Poster)4
2017 A Navigation and Control Strategy for Miniature Legged Robots
abstract
This paper reports on a model-based control strategy for miniature legged robots tasked with navigation in cluttered environments. Our approach uses a new model for crawling locomotion to derive closed-form expressions of state propagation. The latter enable the development of a feedback control navigation strategy. The strategy consists of a waypoint tracking controller that steers the system along desired paths and an outer control loop that updates the reference path to account for uncertainty. This strategy allows noise-resilient navigation for miniature legged robots and is experimentally validated on an eight-legged robot that navigates in obstacle-cluttered environments.
Konstantinos Karydis, Ioannis Poulakakis, Herbert G. Tanner
IEEE Trans. Robotics1
2015 A passively sprawling miniature legged robot
abstract
The paper reports on the design and preliminary experimental testing of a novel 3D-printed miniature legged robot. It is called Passively Sprawling Robot (PSR), and it features a mechanism that achieves passive adjustment of the sprawl angle of the robot's legs. Passive sprawling in this robot exhibits compliance by design, yet it can be controlled indirectly by regulating the yaw rate. Spring-loaded assemblies on the left and right side of the robot function independently, allowing the vehicle to overcome asymmetrical obstacles with improved lateral stability, and withstand falls from moderate heights without sustaining structural damage. The regulation of the sprawling angle by means of varying yaw rates, as well as the improved motion characteristics have been experimentally observed and verified, and open-loop motion accuracy along straight and constant curvature paths was tested on a number of repeated trials.
Adam Stager, Konstantinos Karydis, Herbert G. Tanner
ICRA2
2015 Symbolic planning and control using game theory and grammatical inference
Jie Fu 0002, Herbert G. Tanner, Jeffrey Heinz, Konstantinos Karydis, Jane Chandlee, Cesar Koirala
Eng. Appl. Artif. Intell.4
2014 Planning with the STAR(s)
abstract
We present our findings on the first application of motion planning methodologies to the recently introduced Sprawl Tuned Autonomous Robot (STAR). The reported results provide a first glimpse on the capabilities of this novel, 3D-printed robot in performing autonomously non-trivial motion planning tasks in environments populated with obstacles. We employ methods from sampling-based motion planning under nonholonomic constraints, and implement in open loop the generated path on the physical robot for various environments of increasing complexity.
Konstantinos Karydis, David Zarrouk, Ioannis Poulakakis, Ronald S. Fearing, Herbert G. Tanner
IROS1
2013 Probabilistic validation of a stochastic kinematic model for an eight-legged robot
abstract
The paper suggests a new method for statistically validating, and selecting the parameters of a model for a miniature eight-legged robot. It is based on a novel adaptation of concepts and techniques originally developed in the context of robust control design using randomized algorithms. The proposed approach is data driven and offers probabilistic guarantees of model fidelity and descriptive capacity, checking models against experimental data. In principle, this method applies to a large class of physical processes, the available models of which may be in a variety of forms including sets of differential equations.
Konstantinos Karydis, Ioannis Poulakakis, Herbert G. Tanner
ICRA1
2012 Model predictive navigation for position and orientation control of nonholonomic vehicles
abstract
In this paper we consider a nonholonomic system in the form of a unicycle and steer it to the origin so that both position and orientation converge to zero while avoiding obstacles. We introduce an artificial reference field, propose a discontinuous control policy consisting of a receding horizon strategy and implement the resulting field-based controller in a way that theoretically guarantees for collision avoidance; convergence of both position and orientation can also be established. The analysis integrates an invariance principle for differential inclusions with model predictive control. In this approach there is no need for the terminal cost in receding horizon optimization to be a positive definite function.
Konstantinos Karydis, Luis Valbuena, Herbert G. Tanner
ICRA1
2012 A switching kinematic model for an octapedal robot
abstract
We propose a new model to describe the horizontal motion of an eight-legged bio-inspired miniature robot. The model does not include compliance, and can capture the kinematics of the observed locomotion behavior that corresponds to an alternating tetrapod gait. We exploit symmetries and synergies to reduce the eight-legged robot to a mechanism that is composed by two switching four-bar linkages, each representing the collective effect of a tetrapod in contact with the ground. Notwithstanding its apparent simplicity, the resulting model reproduces on average the motion of the robot. In addition, by properly tuning a family of physically-relevant parameters - including touchdown and sweep angles - different motion primitives corresponding to circular and forward motions can be realized. This model represents a first step toward developing reduced-order kinematic representations of legged robots that can be used for motion planning and feedback control purposes.
Konstantinos Karydis, Ioannis Poulakakis, Herbert G. Tanner
IROS1