Size reconfigurable robots have been introduced for coverage applications to improve performance. The size reconfiguration ability allows a robot to access narrow areas in a smaller size while covering open spaces in a larger size, improving productivity. This paper proposes a novel CPP method consisting of an Overlapping Reduction Criterion (ORC) and a Reconfiguration Reduction Criterion (RRC) for a size-reconfigurable robot to improve performance in dynamic workspaces. A Glasius Bio-inspired Neural Network (GBNN) is adapted to guide the robot toward unvisited cells considering neural activity variation. The size variation is managed by utilizing a collection of grid maps generated for various size configurations of the robot. The RRC and ORC penalize the movements requiring size reconfigurations or creating isolated unvisited regions in the decision-making process of next movement selection yielding to reduce reconfigurations and overlapping. According to the results, the proposed CPP method surpasses state of the art in terms of performance indexes reconfiguration count, overlapping, path distance, and coverage time by significant margins.

While agricultural robotics has made great strides in recent years, manipulation of plants for tasks such as staking and harvesting remains highly challenging due to the high variability in dynamics and deformable nature of plants. To address the challenges created by dynamics uncertainty, we develop a system applying an occupancy-belief planning concept to plant manipulation for staking. We first train a dynamics model that predicts a per-pixel probability that the plant occupies the corresponding slice in space after a drag action using a large set of simulators. This model is then used to plan a manipulation action that maximizes the probability areas swept by the stake tying tool’s operating region are occupied by the plant, and minimize the probability areas swept by the non-operating side regions of the tool are occupied. We demonstrate our method both in simulation and with zero-shot sim-to-real transfer to a physical implementation. We show that adding consideration of belief through use of occupancy-belief allows our method to outperform both the visual foresight type approaches it is based on and other baselines and ablations, especially in the real-world case.

Complete coverage path planning (CCPP) is a trending research area in floor cleaning robotics. CCPP is often approached as an optimization problem, typically solved by considering factors, such as power consumption and time as key objectives. In recent years, the safety of cleaning robots has become a major concern, which can critically limit the performance and lifetime of the robots. However, so far, optimizing safety has rarely been addressed in CCPP. Most of the path-planning algorithms in literature tend to identify and avoid the hazards detected by the robot’s perception. However, these systems can limit the area coverage of the robot or pose a risk of failing when the robot is near a hazard. Therefore, this article proposes a novel CCPP method with the awareness of risk levels for a robot to minimize possible hazards to the robot during a coverage task. The proposed CCPP strategy uses reinforcement learning (RL) to obtain a safety-ensured path plan that evaluates and when necessary, avoid the hazardous components in their environment in real time. Furthermore, the failure mode and effect analysis (FMEA) method has been adopted to classify the hazards identified in the environment of the robot and suitably modified to evaluate the risk levels. These risk levels are used in the reward architecture of the RL. Thus, the robot can cross the low-risk hazardous environments if it is necessary to obtain complete coverage. Experimental results showed a noticeable reduction in overall risk faced by a robot compared to the existing methods, while also effectively achieving complete coverage.

Floor cleaning robots have been developed to cater to building maintenance needs. Complete area coverage is crucial for a floor cleaning robot, and its morphology design plays a vital role in realizing complete area coverage. However, floor cleaning robots with fixed morphologies have difficulty in achieving a high area coverage performance. Mass customization of a robot’s morphology would improve its productivity in terms of area coverage. This paper proposes a novel system that can be used for mass customizing the morphology of a robot to improve area coverage performance in an environment of interest. The customized morphology is determined through an optimization technique by considering an environment of interest and design constraints. The area coverage of a candidate morphology design is evaluated by simulating the robot navigation in an environment of interest. Generalized pattern search, particle swarm optimization, and surrogate optimization are independently considered optimization techniques. Experiments have been conducted considering the cases of robot deployments. The statistical conclusions on experimental results validate that the proposed system can synthesize a morphology that significantly improves the area coverage performance in an environment of interest.

Resource sharing is a crucial part of a multi-robot system. We propose a Boolean satisfiability problem (SAT) based approach to resource sharing. Our key contributions are an algorithm for converting any constrained assignment to a weighted-SAT based optimization. We propose a theorem that allows optimal resource assignment problems to be solved via repeated application of a SAT solver. Additionally we show a way to encode continuous time ordering constraints using Conjunctive Normal Form (CNF). We benchmark our new algorithms and show that they can be used in an ad-hoc setting. We test our algorithms on a fleet of simulated and real world robots and show that the algorithms are able to handle real world situations. Our algorithms and test harnesses are open source and build on Open-RMF’s fleet management system.

Achieving complete area coverage in robotics is an essential aspect for applications such as cleaning and patrolling. While multi-agent frameworks have been implemented to address the challenge of complete coverage, the area coverage performances are hindered by physical constraints and dynamic obstacles that cause inaccessibility to certain areas of the environment. Reconfigurable robots have been adopted to mitigate this issue as the independent alteration of the morphologies during deployments enables overcoming tight spaces to access obstructed areas. Hence, this paper proposes a Multi-Agent Reinforcement Learning (MARL) framework leveraging the Decentralized Partially Observable Markov Decision Process (Dec-POMDP) to enable a team of reconfigurable robots to achieve complete coverage under the presence of dynamic obstacles. The framework is modelled to allow the robots to coordinate and plan their motions effectively while using shape adaptability to access narrow spaces while avoiding dynamic obstacles. Experimental results demonstrated the framework’s ability to be generalised even when scaled up to a different number of agents across larger environments.

Path planning is crucial in numerous robotic applications. Reconfigurable robots possess the capability to alter their shape, enabling access to confined spaces, a task challenging for fixed-shape robots. However, existing path planners for reconfigurable robots are typically designed with predefined motion patterns for reconfiguration, lacking adaptation to space availability and executing reconfiguration only when the robot is static. This reliance on predefined patterns limits the potential of reconfigurable robots to navigate through confined spaces. This paper proposes a novel path-planning approach based on dynamic reconfiguration to address this limitation. The proposed method employs two nested A* algorithms modified to handle reconfiguration and efficient search, termed Dynamic Reconfiguration integrated Nested A* (DRiNA*). Experimental results demonstrate the proposed method’s ability to find feasible paths for robot navigation using dynamic reconfigurations in confined spaces, surpassing the capabilities of existing path planners. The scalability of the proposed method to reconfigurable robots with varying numbers of blocks is also confirmed. Additionally, DRiNA* significantly reduces energy consumption compared to existing path planners.

Reconfigurable robots are deployed for applications demanding area coverage, such as cleaning and inspections. Reconfiguration per context, considering beyond a small set of predefined shapes, is crucial for area coverage performance. However, the existing area coverage methods of reconfigurable robots are not always effective and require improvements for ascertaining the intended goal. Therefore, this article proposes a novel coverage strategy based on internal rehearsals to improve the area coverage performance of a reconfigurable robot. In this regard, a reconfigurable robot is embodied with the cognitive ability to predict the outcomes of its actions before executing them. A genetic algorithm uses the results of the internal rehearsals to determine a set of the robot’s coverage parameters, including positioning, heading, and reconfiguration, to maximize coverage in an obstacle cluster encountered by the robot. The experimental results confirm that the proposed method can significantly improve the area coverage performance of a reconfigurable robot.

Coverage Path Planning (CPP) is an essential feature of robots deployed for applications such as lawn mowing, cleaning, painting, and exploration. However, most of the state-of-the-art CPP methods are proposed for fixed-morphology robots, and the coverage performance is limited by physical constraints such as the inaccessibility of narrow spaces. Apart from area coverage, productivity depends on coverage time and energy usage. A robot capable of varying its footprint size could be a solution for improving productivity in these aspects. In addition to that, the environments, where robots are deployed for coverage, are often subjected to changes causing uncertainties. Therefore, this paper proposes an online CPP scheme for a size-variable robot to improve coverage productivity. The navigation planning of the proposed Size-Variable CPP (VSCPP) scheme has been implemented by adapting a Glasius bio-inspired neural network that guides a robot in an efficient path for coverage while coping with dynamic changes. The size variation required for a situation is determined by analyzing a set of occupancy grid maps corresponding to the size steps of the robot. According to the results, the proposed VSCPP can ascertain coverage while coping with dynamic changes in an environment. The reduction of the coverage time due to the size variability is significant compared to a robot with no VSCPP scheme.

Area coverage is essential for robots used in cleaning, painting, and exploration applications. Reconfigurable robots have been introduced to solve the area coverage limitation of fixed-shape robots. The existing global coverage algorithms of reconfigurable robots are limited to consideration of a limited set of predefined shapes for the reconfiguration and do not consider the exact geometrical shape of obstacles. Therefore, degraded coverage performance could be observed from the existing methods. On the other hand, the coverage methods that consider reconfiguring beyond a limited set of predefined shapes are limited to local coverage. Furthermore, these methods only consider a single reconfiguration for the coverage. Therefore, this paper proposes a novel coverage method for a reconfigurable robot consisting of both global and local path planners. The global path planner uses boustrophedon motion combined with the A * algorithm. The optimum grid positioning that maximizes the global coverage is determined through a Genetic Algorithm (GA). The local coverage planner performs continuous reconfig-uration of the robot to adequately cover obstacle zones while navigating through narrow spaces without collisions. A GA is used to determine the reconfiguration parameters of the robot at each instance of the local coverage. Simulation results confirm that the proposed method is effective in performing both global and local coverage path planning for improving the area coverage performance.

In recent years, a rising trend of floor cleaning robots could be observed in the consumer electronic market. Area coverage performance is a crucial factor that determines the overall productivity of a floor cleaning robot. Nevertheless, the area coverage performance of commercially available floor cleaning robots is limited due to narrow spaces resulting from complex furniture arrangements. Traditionally, new robot designs (both hardware and algorithmic) are explored to over-come the coverage limitations. Developments of reconfiguration mechanisms and path planning algorithms for floor cleaning robots could be considered as examples. This paper proposes a novel concept called “design by robot,” enabling a floor cleaning robot to make suggestions on workspace modifications to maximize its area coverage performance in a given workspace. In this regard, the robot analyzes a workspace to be cleaned through internal simulations based on the metric map of the workspace. A metaheuristic optimization technique determines the optimum placings of objects. Particle Swarm Optimization (PSO), Surrogate Optimization (SO), and Generalized Pattern Search (GPS) are individually used in this regard. Experiments, including scenarios of robot deployments, have been considered for validation. The statistical outcomes of the experimental results validate that the area coverage performance of a floor cleaning robot could be significantly improved by considering the workspace modifications suggested by the robot. Moreover, the proposed concept “design by robot” enables users to gain significantly improved performance from floor cleaning robots through collaboration.

Autonomous vehicles are designed to elevate the efficiency of assigned tasks and ensure the safety of the environment in which they operate. This paper presents a research study focused on shared autonomy using a multi-layer fuzzy logic framework to build a relationship between an autonomous self-reconfigurable robot and a human user by switching control to the teleoperator to assist the robot when it faces challenging scenarios while keeping a good performance and maintaining a safe environment. A novel multi-layer fuzzy logic decision process with shared autonomy for a safety framework is proposed. It evaluates safety based on the robot's multi-sensor inputs, the teleoperator's attention level, and the configuration state of the self-reconfigurable robot and switches the operation mode, robot speed gain, and configuration state for performance and safety without compromises. The experimental outcome successfully demonstrates the self-reconfigurable robot's capability to navigate safely using shared autonomy in real-world pavement scenarios using the proposed algorithm during autonomous navigation.

Vacuum-adhesion-based climbing robots have been developed to cater to the demands in the cleaning and inspection work of airplanes. A robot intended to clean and inspect an airplane faces a Risk of Adhesion (RoA) based on the robot and the surface conditions, such as worn-out suction cups. These sorts of underlying conditions are not easily noticeable for an operator of a robot and might lead to catastrophic events. Therefore, the ability of a robot to self-assess the RoA in a scenario and notify the operator is crucial for ensuring safety. Particularly, an aircraft inspection robot should have adhesion awareness. This paper proposes a novel method to self-assess the RoA of a vacuum-adhesion-based robot intended to clean and inspect airplanes. The RoA is assessed by a fuzzy inference system that analyzes the present pressure difference and the current duty setting of the vacuum pump of a robot. The robot operator can collaborate with the robot to take precautions based on the assessed RoA to ensure safety. The outcomes of the experiment conducted on an airplane skin validate the ability of the proposed method to assess the RoA associated with heterogeneous operating conditions effectively. Thus, the utilization of the proposed method would improve the safety of a vacuum-adhesion-based robot intended to clean and inspect airplanes.

Area coverage is crucial for robotics applications such as cleaning, painting, exploration, and inspections. Hinged reconfigurable robots have been introduced for these application domains to improve the area coverage performance. However, the existing coverage algorithms of hinged reconfigurable robots require improvements in the aspects; consideration of beyond a limited set of reconfigurable shapes, coordinated reconfiguration and navigation, and online decision-making. Therefore, this paper proposes a novel online Complete Coverage Path Planning (CCPP) method for a hinged reconfigurable robot. The proposed CCPP method is designed with two sub-methods, the Global Coverage Path Planning (GCPP) and Local Coverage Path Planning (LCPP). The GCPP method has been implemented, adapting a Glasius Bio-inspired Neural Network (GBNN) that performs online path planning considering a fixed shape for the robot. Obstacle regions that the GCPP would not adequately cover due to access constraints are covered by the LCPP method that considers concurrent reconfiguration and navigation of the robot. A genetic algorithm determines the reconfiguration parameters that ascertain collision-free coverage and access of obstacle regions. Experimental results validate that the proposed online CCPP method is effective in ascertaining the complete area coverage in heterogeneous environments, including dynamic workspaces. Furthermore, the deployment of the LCPP method can considerably improve the coverage.

Area coverage is demanded from the robots utilized in application domains such as floor cleaning. Even though many advanced coverage algorithms have been developed, the area coverage performance is limited due to the inaccessibility of narrow spaces caused by physical constraints. Reconfigurable robots have been introduced to overcome this limitation where reconfigurability could help in assessing narrow spaces. Nevertheless, the state-of-the-art reconfigurable robots are not capable of changing the morphology size and shape as a single entity. Therefore, this paper proposes a novel design of a reconfigurable robot with a size-adaptive coverage strategy. The reconfiguration mechanism is designed in such a way that the robot can independently expand or shrink its size along the principal planar axes, where the behavior allows the change of size and shape. The coverage strategy is based on boustrophedon motion and the A* algorithm modified for accessing narrow areas using the size adaptability. The design of the robot is detailed in the paper, including electro-mechanical aspects, design considerations, and the coverage path planning method. Experiments have been conducted using a prototype of the proposed design to analyze and evaluate the characteristics and the performance of the robot. The results show that the proposed robot design can improve the productivity of a floor cleaning robot in terms of area coverage and coverage time.

Cleaning requirements of glass façades of high-rise buildings have been significantly increased in recent years due to the growth of the construction industry. The conventional cleaning methods for high-rise buildings require human labor where efficiency, cost, and safety are major concerns. Therefore, robotic systems that can climb and clean glass fagades in high-rise buildings have been developed. Capability to attach to a façade surface is one of the critical requirements of a glass façade cleaning robot. Diverse approaches have been proposed for adhesion of cleaning robots to a glass façade. Active vacuum suction mechanisms are widely used for these robots since they provide better controllability to move the robots smartly on the surface. Notably, those are decent for a reconfigurable robot that can transit between window frames. The suction mechanism of a glass façade cleaning robot must provide a reliable suction force to make the robot stay safely and move smartly on a façade. Nevertheless, these suction mechanisms can be failed due to improper fastening between a façade and the mechanism, which may lead to safety and operational issues. Therefore, this paper proposes a novel method to realize the adhesion-awareness of a glass façade cleaning robot. The adhesion-awareness is realized by analyzing The current drawn by the motors attached to the impellers of the vacuum mechanisms. Experiment results validate the capability of the proposed approach in raising the adhesion-awareness of a façade cleaning robot.

Service robots that possess social interactive capabilities are vital to cater to the demand in emerging domains of robotic applications. A service robot frequently needs to interact with users when performing service tasks. The comfortability of users depends on the human-robot proxemics during these interactions. Hence, a service robot should be capable of maintaining proper proxemics that improves the comfort of users. The proxemics preferences of users might depend on diverse attributes of a robot, such as emotional state, noise level, and physical appearance. Therefore, it is vital to gain a better understanding of a robot's attributes which influence human-robot proxemics behavior. This paper contributes to an exploratory study to analyze the effects on human-robot proxemics preferences due to a robot's attributes; facial and vocal emotions, level of internal noises, and the physical appearance. Four sub-studies have been conducted to gather the required human-robot proxemics data. The gathered data have been analyzed through statistical tests. The test statistics reveal that facial and vocal emotions, internal noise level, and the physical appearance of a robot have significant effects on proxemics preferences of humans. The outcomes of this exploratory study would be useful in designing and developing human-robot proxemics strategies of a service robot that would enhance social interaction.

Humans prefer to use voice commands to guide their peer companions in daily assistive tasks. In human perspective, they expect same behavior from assistive robot companions as well. The paper presents an approach towards using such voice instructions based on uncertain and qualitative information to describe object placements. Consider a case in which a set of objects has to be arranged on a table in a particular spatial area. In such a situation, humans will prefer to use a single command regarding overall arrangement rather than repeating the same command for each and every object placement. In such scenarios, people will be comfortable with commands which are simple and with non-technical words. Most of such commands include uncertain spatial terms such as “Left”, “Middle”, “Right” and uncertain qualitative terms such as “Together”, “Little separately”, “Separately” to describe the arrangement. For example “Keep all objects together in the middle of the table” and “Keep objects separately on the right side of the table” can be considered. But in some situations, these commands will not give a direct idea about the placement location of the objects. For instance, “Keep the middle of the table free” can be cited. Therefore, the robot must be able to understand precisely such information in commands before executing them. The experiments are conducted in a simulated domestic environment. Results of the experiment are presented and discussed.

Intelligent service robots are used at a significant level to uplift the living standards of domestic users. These robots are expected to possess human-friendly interactive features. Service robots should be able to provide a variety of tasks to support independent living of users in domestic environments. Therefore, a service robot often needs to approach users to execute these services and the approach toward the users should be human friendly. In order to achieve this, proxemics planner of a service robot should be cable of deciding the approaching proxemics based on user behavior. This paper proposes a method to decide the approaching proxemics based on the behavior of the user. A fuzzy interference system has been designed to decide the proxemics based on the user behavior identified through body parameters. This leads to an effective interaction mechanism initiated by a robot in such a way that the approaching scenario looks more humanlike. The proposed concept has been implemented on MIRob platform and experiments were conducted in an artificially created domestic environment. The experimental results of the proposed system have been compared with results of a human study to evaluate the performance of the system.

Assistive robots are developed for supporting the daily activities of human beings to uplift the living standards. Assistive robots should be friendly, reliable, active, comprehensible and capable of creating interactive conversations with users in order to be a friendly companion for the human. Humans tend to include uncertain terms related to directions and distances to describe or express ideas. Furthermore, an assistive robot should be capable of analyzing and understanding the numerical meaning of uncertain terms for the purpose of creating a cognitive map in order to build friendly interactions between the user and the robot. Moreover, this paper proposes a method to identify the spatial relation between the objects in a given environment and describes such environments using uncertain terms related to spatial information based on a cognitive map created by the proposed system while having interactive conversations with the user. Conversation Management Module (CMM) and Spatial Information Processor (ISP) and Cognitive Map Creator (CMC) have been introduced in order to create interactive conversations while processing the uncertain information based on a cognitive map. Capabilities of the robot has been demonstrated and validated from the experimental result.

Service robots have been developed to enhance the living standard of people. Users of these service robots are not experts in robotic domain. Hence, they prefer to have human-friendly features in these service robots. These service robots often need to navigate toward their users when accomplishing service tasks demanded by the users. Therefore, the ability of a service robot to approach a user in a human-friendly manner would increase the rapport between the user and the robot. This paper proposes a method for human-friendly approaching of a service robot toward a user who is having a conversation with another person. The algorithm behind the proposed approaching method has been designed in such a way that the robot can replicate the natural human tendencies to a greater extent. Natural approaching behavior of humans identified from a previously conducted human study has been utilized for this purpose. The proposed approaching method has been implemented on MIRob platform and a user study has been conducted to validate the capabilities of the proposed concept. The experimental results validate that the proposed approaching method of the robot is capable of maintaining the satisfaction of the users during approaches.

Service robots have become a widely used tool in human-friendly assistive tasks in many aspects including social environments. Maintaining a sustainable interaction with humans is essential in performing assistive tasks in this regard. Therefore, a robot must be equipped with intelligent cognitive skills in decision making as well as in making friendly relationships with its human user. Human-like capabilities such as initiating a conversation at the right moment without distracting and maintaining an appropriate interaction are important cues in this context. This paper presents a human study conducted by means of a wizard-of-oz (WoZ) experiment to identify the behavioral features in humans that can be utilized by an assistive robot in a domestic environment to assess the situation prior to an interaction. Both verbal and nonverbal responses of participants towards an interaction initiated by a robot were recorded and analyzed to identify human behavioral changes that portray an interest towards interaction. The experiment was conducted in a simulated domestic environment and findings of the experiment are presented and discussed so that these findings could be made use of when designing human-like social robots in future. Furthermore, human behavioral changes observed during the study are analyzed and critical observations are highlighted.

Assistive robots are developed to uplift living standards of human being. An assistive robot needs to be friendly, reliable, and understandable in order to be a human like companion. A robot should be able to understand its user effectively and the robot should be able to expand its knowledge based on experience gain from activities or conversations. Therefore the assistive robot should have a memory and a knowledge base regarding objects that it comes across in daily activities. It should be able to process data and understand relationships between attributes of objects to self-understand the need of a user. Therefore this paper propose a method to create an object memory and a knowledge base to understand relations between objects attributes and create a cognitive map to enhance interaction between human and robot which will help to make a robot more human-friendly. Conversation Management Module (CMM), Attribute Analyzing Module (AMM) and Object Knowledge Base (OKB) have been introduced in order to create a cognitive map of objects. Capabilities of the robot have been demonstrated and evaluated from experimental results.

Development of intelligent service robots is a growing research area within the field of robotics. Users of these service robots expect human-like interaction abilities from the robots. These service robots must be capable of navigating in human populated environments by considering the comfort of the people for having smooth interaction with the users since many of the daily routine tasks involve the navigation. Therefore, a robot's way of approaching to users during interactions must be human-friendly in order to enhance the rapport between the human users and the robot. However, the natural approaching behavior of humans has to be studied in order to implement such human-like navigation abilities in service robots. Therefore, this paper contributes in a human study conducted for identifying the approaching behavior of a third person toward two persons who are having a conversation. The study has been conducted as three sub studies to identify the parameters that alter the approaching behavior. The key aspects of the approaching behavior of humans have been identified by analyzing the experimental scenarios. The capabilities required for a service robot for implementing a human-like approaching mechanism are discussed based on the outcomes of the human study. Furthermore, the directions for future investigation of human approaching behavior through human studies are also provided.

Human friendly service robots should possess human like interaction and reasoning capabilities. Humans prefer to use voice instructions in order to communicate with peers. Those voice instructions often include linguistic notions and descriptors that are fuzzy in nature. Therefore, the human friendly robots should be capable of understanding the fuzzy information in user instructions. This paper proposes a method in order to interpret directional information in navigational user commands by considering the environment dependent fuzziness associated with the directional linguistic notions. A module called Direction Interpreter has been introduced for handling the fuzzy nature of directional linguistic notions. The module has been implemented with a fuzzy logic system that is capable of modifying the perception of the robot about the directional information according to the surrounding environment of the robot. This modification is done by weighting the output membership function with the distribution of the free space around the robot. According to the experimental results, the proposed system is capable of replicating the natural directional perception of humans that depends on the environment to a greater extent than the existing approaches.

Human-robot interaction mechanisms are being developed to cater to growing elderly and disabled population. There are still voids in achieving human-likeness before initiation of an interaction. Interaction scenario could be made interesting and effective by engraving basic cognitive skills into the robot's intelligence. Skills related to human-like interaction depends on cognitive skills and interpretation of the existing situation. Most robot users encounter a common problem with their robots. That is robot trying to interact with the user when he's engaged. In robot's perspective, the robot is not fully capable of deciding when to interact with the user. This paper presents a model to decide when to interact with the user, minimizing such failures. The proposed model has separate functional units for decision making on a user's nonverbal interaction demanding. User's availability for interaction is deduced through extracted information. The system observes a user for his bodily movements and behavior for a specified time duration. The extracted information is analyzed and then put through a module called Interaction Demanding Pose Identifier to interpret the interaction demanding of the user. The identified pose and other calculated parameters are fed into the Fuzzy Interaction Decision Making Module in order to interpret the degree of interaction demanding of the user. Interaction demanding is taken into consideration before going for direct interaction with the user. This method is implemented and tested in a simulated domestic environment with users in a broad age gap. Implementation of the method and results of the experiment are presented.

In the recent past, domestic service robots have come under close scrutiny among researchers. When collaborating with humans, robots should be able to clearly understand the instructions conveyed by the human users. Voice interfaces are frequently used as a mean of interaction interface between users and robots, as it requires minimum amount of work overhead from the users. However, the information conveyed through the voice instructions are often ambiguous and cumbersome due to the inclusion of imprecise information. The voice instructions are often accompanied with gestures especially when referring objects, locations, directions etc. in the environment. However, the information conveyed solely through these gestures is also imprecise. Therefore, it is more effective to consider a multimodal interface rather than a unimodal interface in order to understand the user instructions. Moreover, the information conveyed through the gestures can be used to improve the understanding of the user instructions related to object placements. This paper proposes a method to enhance the interpretation of user instructions related to the object placements by interpreting the information conveyed through voice and gestures. Furthermore, the proposed system is capable of adapting the understanding, according to the spatial arrangement of the workspace of the robot. Fuzzy logic system is proposed in order to evaluate the information conveyed through these two modalities while considering the arrangement of the workspace. Experiments have been carried out in order to evaluate the performance of the proposed system. The experimental results validate the performance gain of the proposed multimodal system over the unimodal systems.

Service robots are being developed as a solution for the implications associated with the aging population. They are intended to be operated by non-expert users and hence human friendly interaction abilities are preferred. Humans prefer to use voice instructions that include uncertain information, lexical symbols and notions instead of instructions with precise quantitative values. Hence, service robots must be capable of interpreting such instructions in human like manner. This paper proposes a method in order to navigate a service robot inside a domestic environment in human friendly manner by using voice instructions that include phrases with uncertain information associated with relative references such as “large table”, “table left of the door” and “table close to the door”. A module called Relative Uncertainty Interpretation (RUI) module has been introduced in order to evaluate the relative references related uncertainties. The RUI module has been implemented by considering the natural tendencies of humans. Experiments have been carried out in an artificially created domestic environment and the results of the proposed system have been compared with the results of a user study in order to evaluate the performance of the proposed system.

Assistive robots can support activities of elderly people to uplift the living standard. The assistive robots should possess the ability to interact with the human peers in a human friendly manner because those systems are intended to be used by non-experts. Humans prefer to use voice instructions that include uncertain information and lexical symbols. Hence, the ability to understand uncertain information is mandatory for developing natural interaction capabilities in robots. This paper proposes a method to understand uncertain information such as “close”, “near” and “far” in navigational user commands based on the current environment and the experience of the robot. A robot experience model (REM) has been introduced to understand the lexical representations in user commands and to adapt the perception of the robot on uncertain information in heterogeneous domestic environments. The user commands are not bounded by a strict grammar model and this enables the users to operate the robot in a more natural way. The proposed method has been implemented on the assistive robot platform. The experiments have been carried out in an artificially created domestic environment and the results have been analyzed to identify the behaviors of the proposed concept.

Service robots are being developed as a supportive aid for elderly people. Those robots are operated by non-expert users in heterogeneous domestic environments. Hence, the ability of a robot to be operated in a more natural human friendly manner enhances the overall satisfaction of the user. Humans prefer to use voice in order to convey instructions. Those voice instructions often include uncertain terms such as “little” and “far”. Therefore, the robotic assistants should possess the competency to appropriately interpret the quantitative meanings of such terms. The quantitative meaning of uncertain terms related to the spatial information depends on the spatial arrangement of the environment. This paper proposes a method in order to evaluate the uncertain information in user commands by replicating the natural tendencies of humans about the spatial arrangement of the environment. A module called Occupied Density analyzer has been deployed to analyze the occupied density distribution. A function has been defined to estimate the perceptive distance based on the occupied density distribution. The perception of the uncertain terms is adjusted according to the perceptive distance of that particular scenario. Particulars on rationale behind the proposed method are explained with due attention to the natural human tendencies. Experiments have been carried out in order to evaluate the performance and the behaviors of the proposed system.