This work aims at facilitating the integration of industrial robots and other devices such as their gripper tools at small and medium-sized enterprises (SMEs). For this purpose, an intuitive user interface for the skill-based instruction of robot systems is combined with standardized opc UA-based skill interfaces that support various hardware and software resources from different manufacturers. Special emphasis is laid on supporting different user groups with varying levels of expertise. Production system engineers are provided with a detailed graphical user interface (GUI) for hierarchically defining new skills by combining preexisting ones. System operators receive a simplified view with limited complexity for process instruction and changing high-level task parameterizations. The skills and relevant semantic context knowledge about products, processes, and resources (PPR) are formally represented in OWL ontologies to enable hardware-agnostic process descriptions that can be deployed to different production environments, while automatically deriving parameterizations for skill invocations. The proposed concept has been qualitatively evaluated in two real-world robot workcells based on a smartphone accessory packaging use case.

Heterogeneous teams of multiple mobile robots will be important for future scientific explorations of extraterrestrial surfaces or hazardous areas. Mission operation in such harsh, unknown environments poses diverse challenges. Robots need to cooperate autonomously due to the large network latency to the ground station while operators need to adapt the ongoing mission flexibly based on new discoveries obtained during execution. Furthermore, shared situational awareness between operators and roboticists is highly required to deal with execution failures promptly. To overcome these challenges, this paper proposes the high-level mission operation framework ROSMC. The concept of mission synchronization to robots enables continuous mission adaptations and future planning by operators while robots execute the mission autonomously. The ROS-based GUIs enable operators to intuitively create and monitor the mission for robots as well as to communicate with roboticists smoothly. The proposed framework was evaluated by a pilot study with a simulator and demonstrated at a Moon-analogue field on Mt. Etna in Sicily, Italy, involving 3 robots and around 70 researchers for 4 weeks.

Robotic tasks are becoming increasingly complex, and with this also the robotic systems. This requires new tools to manage this complexity and to orchestrate the systems to fulfill demanding autonomous tasks. For this purpose, we developed a new graphical tool targeting at the creation and execution of robotic tasks, called RAFCON. These tasks are described in hierarchical state machines supporting concurrency. A formal notation of this concept is given. The tool provides many debugging mechanisms and a GUI with a graphical editor, allowing for intuitive visual programming and fast prototyping. The application of RAFCON for an autonomous mobile robot in the SpaceBotCamp competition has already proved to be successful.