VLDB 2026 Research / reviewers in the wild / expert
Francesco Rea
dblp:04/11033
· DBLP profile ↗
33ranked-venue papers
0as first author
18since 2021 · last 2026
0000-0001-8535-223XORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Human-computer interaction and ubiquitous computing · 23 · 11 since 2021Artificial intelligence and machine learning · 22 · 12 since 2021Applied, interdisciplinary, general and emerging computing · 11 · 3 since 2021Systems, architecture and hardware · 7 · 5 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Curiosity and Affect-Driven Cognitive Architecture for HRIabstractThis study explores how humans and cognitive robots with different value systems and motivations understand each other's needs in free-form interactions. We developed a cognitive architecture that links sensing and perception to internal motivation and an intrinsic value system for determining actions. Inspired by young children's needs, this architecture includes three drives: learning, interaction, and recharging, each with varying dependence on the human partner. We aimed to assess how experimentally changing the importance of these drives within a fixed architecture affects interaction dynamics with human partners (acting as caregivers) and their understanding of the robot's needs. By adjusting the learning and interaction drives, we created two robot profiles: Playful, which prioritizes environmental exploration and playfulness to reduce boredom, and Social, which focuses on social interaction through touch and visual contact to increase comfort. Our findings show that changing the importance of these drives produces distinct behaviors and human perceptions. Robot behaviors matched their profiles, and participants adapted their responses accordingly. Participants identified and attributed distinct traits to each robot without knowing the specific profiles. Despite variability among human partners, the robots, especially the playful one, were generally well understood by most participants. Letícia M. Berto, Ana Tanevska, Azamor Cirne, Paula Dornhofer Paro Costa, Alexandre da Silva Simões, Ricardo R. Gudwin, Francesco Rea, Esther Luna Colombini, Alessandra Sciutti |
IEEE Trans. Affect. Comput. | 7 |
| 2025 | One Robot, Many Minds: Factors Shaping Visitors' Evaluation of an Autonomous Museum Robot GuideabstractRobots are no longer just tools—they are becoming social agents that can shape how we engage with culture. This study examines what influences visitors’ perceptions of an autonomous museum guide robot, focusing not only on technical capabilities but also on human-centered factors. In a maritime exhibition, 34 participants interacted with a fully autonomous, LLM-powered robot acting as a museum guide. Using self-report questionnaires, we explored how individual differences - age and prior experience with robots — interacted with experimental conditions to shape participants’ impressions of the robot. Our findings suggest that these personal factors significantly affect how visitors evaluate the robot, suggesting that effective design must reflect the diversity of users’ experiences and expectations. By acknowledging the complexity of human-robot interaction, we move closer to creating robotic guides that are not only functional but also socially attuned. Luca Garello, Francesca Cocchella, Manuel G. Catalano, Alessandra Sciutti, Francesco Rea |
HAI | 5 |
| 2025 | Building Knowledge from Interactions: An LLM-Based Architecture for Adaptive Tutoring and Social ReasoningabstractIntegrating robotics into everyday scenarios like tutoring or physical training requires robots capable of adaptive, socially engaging, and goal-oriented interactions. While Large Language Models show promise in human-like communication, their standalone use is hindered by memory constraints and contextual incoherence. This work presents a multimodal, cognitively inspired framework that enhances LLM-based autonomous decision-making in social and task-oriented Human-Robot Interaction. Specifically, we develop an LLM-based agent for a robot trainer, balancing social conversation with task guidance and goal-driven motivation. To further enhance autonomy and personalization, we introduce a memory system for selecting, storing and retrieving experiences, facilitating generalized reasoning based on knowledge built across different interactions. A preliminary HRI user study and offline experiments with a synthetic dataset validate our approach, demonstrating the system’s ability to manage complex interactions, autonomously drive training tasks, and build and retrieve contextual memories, advancing socially intelligent robotics. Luca Garello, Giulia Belgiovine, Gabriele Russo, Francesco Rea, Alessandra Sciutti |
IROS | 4 |
| 2023 | That's not a Good Idea: A Robot Changes Your Behavior Against Social EngineeringabstractDangers in modern human society are commonly attributed to the safety of online activities. In the domain of cybersecurity, Social Engineering (SE) relates to how attackers manipulate and coerce their targets into divulging sensitive information. One major problem in designing social engineering defenses is making users aware they are being targeted. In the context of fostering human empowerment and building an inclusive society, we explore the possibility of leveraging social robot companions to provide improved protection for individuals and companies against cybersecurity attacks, specifically focusing on the realm of social engineering (SE) tactics. We asked participants to play an immersive interactive storytelling game, challenging them with risky and social-engineering-related decisions and monitoring their explicit (i.e., decisions) and implicit (i.e., mouse trajectories and facial expressions) behavior. After each decision, the Furhat tabletop robot intervened, always suggesting the not-selected option. We compared two Compliance Gaining Behaviors (CGBs) the robot could use, either leveraging affection with the participants or logical thinking. Overall, Furhat’s interventions increased the acceptance of risky and SE proposals. However, comparing the situations in which the robot tried to convince participants to avoid a social engineering request to those in which it tried to persuade them to accept it, the former was significantly more successful. Also, participants struggled with ignoring Furhat’s advice, as shown by their more uncertain mouse trajectories and negative emotional valence. From the latter results, we trained a Decision Tree model, based on mouse trajectory features only, to predict if participants would change their minds with an accuracy of 64.9%. Such defense mechanisms could help better understand users’ decision-making process in cybersecurity and social engineering, designing more helpful and supportive robot companions. Dario Pasquali, Austin Kothig, Alexander Mois Aroyo, John Edison Muñoz, Kerstin Dautenhahn, Stefano Bencetti, Francesco Rea, Alessandra Sciutti |
HAI | 7 |
| 2023 | Ex(plainable) Machina: how social-implicit XAI affects complex human-robot teaming tasksabstractIn this paper, we investigated how shared experience-based counterfactual explanations affected people's performance and robots' persuasiveness during a decision-making task in a social HRI context. We used the Connect 4 game as a complex decision-making task where participants and the robot had to play as a team against the computer. We compared two strategies of explanation generation (classical vs shared experience-based) and investigated their differences in terms of team performance, the robot's persuasive power, and participants' perception of the robot and self. Our results showed that the two explanation strategies led to comparable performances. Moreover, shared experience-based explanations - based on the team's previous games - gave higher persuasiveness to the robot's suggestions than classical ones. Finally, we noted that low-performers tend to follow the robot more than high-performers, providing insights into the potential danger for non-expert users interacting with expert explainable robots. Marco Matarese, Francesca Cocchella, Francesco Rea, Alessandra Sciutti |
ICRA | 3 |
| 2023 | To Whom are You Talking? A Deep Learning Model to Endow Social Robots with Addressee Estimation SkillsabstractCommunicating shapes our social word. For a robot to be considered social and being consequently integrated in our social environment it is fundamental to understand some of the dynamics that rule human-human communication. In this work, we tackle the problem of Addressee Estimation, the ability to understand an utterance's addressee, by interpreting and exploiting non-verbal bodily cues from the speaker. We do so by implementing an hybrid deep learning model composed of convolutional layers and LSTM cells taking as input images portraying the face of the speaker and 2D vectors of the speaker's body posture. Our implementation choices were guided by the aim to develop a model that could be deployed on social robots and be efficient in ecological scenarios. We demonstrate that our model is able to solve the Addressee Estimation problem in terms of addressee localisation in space, from a robot ego-centric point of view. Carlo Mazzola, Marta Romeo, Francesco Rea, Alessandra Sciutti, Angelo Cangelosi |
IJCNN | 3 |
| 2023 | Expressing and Inferring Action Carefulness in Human-to-Robot HandoversabstractImplicit communication plays such a crucial role during social exchanges that it must be considered for a good experience in human-robot interaction. This work addresses implicit communication associated with the detection of physical properties, transport, and manipulation of objects. We propose an ecological approach to infer object characteristics from subtle modulations of the natural kinematics occurring during human object manipulation. Similarly, we take inspiration from human strategies to shape robot movements to be communica-tive of the object properties while pursuing the action goals. In a realistic HRI scenario, participants handed over cups - filled with water or empty - to a robotic manipulator that sorted them. We implemented an online classifier to differentiate careful/not careful human movements, associated with the cups' content. We compared our proposed “expressive” controller, which modulates the movements according to the cup filling, against a neutral motion controller. Results show that human kinematics is adjusted during the task, as a function of the cup content, even in reach-to-grasp motion. Moreover, the carefulness during the handover of full cups can be reliably inferred online, well before action completion. Finally, although questionnaires did not reveal explicit preferences from partici-pants, the expressive robot condition improved task efficiency. Linda Lastrico, Nuno Ferreira Duarte, Alessandro Carfì, Francesco Rea, Alessandra Sciutti, Fulvio Mastrogiovanni, José Santos-Victor |
IROS | 4 |
| 2023 | At school with a robot: Italian students' perception of robotics during an educational programabstractSocial robots are expected to become more and more used in the education field. However, in the interaction between children and social robots, how robots are perceived in social contexts is still under investigation. In this exploratory study, we aimed to investigate how children’s expectations and demographical characteristics (N= 53, 9-14 years old) influence their perception of robot NAO during an education training program in schools. MANCOVA analysis conducted over questionnaire data indicates a positive correlation between the acceptance of the robot and the enjoyment of interacting with it. We found evidence that the more students accepted the robot, the more they perceived the group environment positively. Through a Correspondence Analysis, we investigate which are the preferred features of a robot according to the age of participants. The study suggests that a better opinion of robotics is a factor that can improve the learning environment in this specific context. Our exploratory study encourages conducting studies in-the-wild using self-reported measures to understand the implication of Child-Robot Interaction better. Francesca Cocchella, Giulia Pusceddu, Giulia Belgiovine, Michela Bogliolo, Linda Lastrico, Maura Casadio, Francesco Rea, Alessandra Sciutti |
RO-MAN | 7 |
| 2023 | Working Memory-Based Architecture for Human-Aware Navigation in Industrial SettingsabstractTo enable a smooth co-existence between robots and human workers in an industrial setting, we implemented two robot working memory configurations onto a mobile manipulator RB-KAIROS+ robot (Robotnik): A GRU-based one and a bioinspired alternative called WorkMATe which enabled the robot to adapt its navigation strategy depending on the presence of human workers. To evaluate the two working memory configurations against a non adaptive behavior, we tested a possible co-working scenario between two ostensible workers and the RB- KAIROS+ robot navigating in two mocked industrial set-ups. The application of behavioral adaptation through a working memory component was highly beneficial as it led to reduced energy consumption and, more importantly, to fewer acceleration anomalies in robot navigation than the non adaptive one. This suggests that a robot’s adaptive navigation through working memory can increase workers’ safety and improve the efficiency of the human-robot system as a whole in industrial applications. Lorenzo Landolfi, Dario Pasquali, Alice Nardelli, Jasmin Bernotat, Francesco Rea |
RO-MAN | 5 |
| 2023 | Natural Born Explainees: how users' personality traits shape the human-robot interaction with explainable robotsabstractIn this work, we performed a user study in which participants had to solve a human-robot teaming decision-making task (the Connect 4 game) with an explainable vs non-explainable robot. During the task, the robot provided suggestions and, depending on the experimental condition, explanations to justify those suggestions. We compared participants’ behaviours in interacting with both types of robots. In particular, we investigated how participants’ personality dimensions and previous experiences with the iCub robot impacted participants’ decision-making. We also studied how participants aligned with iCub’s playing style as the interaction continued. Our results show that participants’ negative agency and agreeableness substantially impacted how they accepted the robot’s suggestions when it provided example-based counterfactual explanations. We also observed a learning effect: participants tended to align with the robot’s playing style during the interaction. However, the participants’ learning depended not only on the presence of the explanations, but also on the time spent with the robot. Moreover, the human-robot team’s victories were mainly attributable to the robot’s persuasiveness rather than the participants’ skills in the game. Marco Matarese, Francesca Cocchella, Francesco Rea, Alessandra Sciutti |
RO-MAN | 3 |
| 2022 | Are Robots That Assess Their Partner's Attachment Style Better At Autonomous Adaptive Behaviour?abstractInteracting with partners that understand our desire of closeness or space and adapt their behavior accordingly is an important factor in social interaction, since the perception of others is a fundamental prerequisite for reliable interaction. In human-human interaction (HHI), this information can be inferred by a person's attachment style - a person's characteristic way of forming relationships, modulating behavior (i.e ways to give or seek support) and, on a biological level, their hormone dynamics. Enabling robots to understand their partners' attachment style could enhance robot's perception of partners and help them on how adapt behaviors during an interaction. In this direction, we wish to use the relationship between attachment style and cortisol, to equip the humanoid robot iCub with an internal cortisol-inspired framework that allows it to infer the participant's attachment style and drives it to adapt its behavior accordingly. Sara Mongile, Ana Tanevska, Francesco Rea, Alessandra Sciutti |
HRI | 3 |
| 2022 | Comfortability Recognition from Visual Non-verbal CuesabstractAs social agents, we experience situations in which sometimes we enjoy being involved and others where we desire to withdraw from. Being aware of others’ “comfort towards the interaction” help us enhance our communications, thus this becomes a fundamental skill for any interactive agent (either a robot or an Embodied Conversational Agent (ECA)). For this reason, the current paper considers Comfortability, the internal state that focuses on the person’s desire to maintain or withdraw from an interaction, exploring whether it is possible to recognize it from human non-verbal behaviour. To this aim, videos collected during real Human-Robot Interactions (HRI) were segmented, manually annotated and used to train four standard classifiers. Concretely, different combinations of various facial and upper-body movements (i.e., Action Units, Head Pose, Upper-body Pose and Gaze) were fed to the following feature-based Machine Learning (ML) algorithms: Naive Bayes, Neural Networks, Random Forest and Support Vector Machines. The results indicate that the best model, obtaining a 75% recognition accuracy, is trained with all the aforementioned cues together and based on Random Forest. These findings indicate, for the first time, that Comfortability can be automatically recognized, paving the way to its future integration into interactive agents. Maria Elena Lechuga Redondo, Radoslaw Niewiadomski, Francesco Rea, Alessandra Sciutti |
ICMI | 3 |
| 2022 | A Novel Wire-driven 3D Eyebrow Design for Communication with Humanoid Robot iCubabstractThe purpose of this research is to contribute to social communication between humans and robots in scenes that have been considered difficult due to the limited facial expression capabilities of robots. In order to provide more detailed facial expressions, we designed a novel wire-driven 3D eyebrow using a soft material with a bending structure. We then demonstrated the mechanical properties of the eyebrow design and developed a prototype that could be implemented on the humanoid robot iCub to verify its operation. Lastly, we confirmed that the new design enables the production of more slight changes in facial expressions by allowing the eyebrows to change their shape at more delicate angles and continuity than the LED eyebrows of the conventional iCub. Motonobu Aoki, Karthikeyan Kalyanasundaram Balasubramanian, Diego Torazza, Francesco Rea, Doreen Jirak, Giulio Sandini, Takura Yanagi, Atsushi Takamatsu, Stephane Bouet, Tomohiro Yamamura |
IROS | 4 |
| 2022 | HRI Framework for Continual Learning in Face RecognitionabstractRecognizing human partners is an essential social skill for building personalized and long-term human-robot interactions. However, robots deployed in complex, real-world environments have to face several challenges, such as managing unstructured interactions with multiple users, limited computational resources, and intrinsic and continuous variability of their sensory evidence. To cope with these challenges, we propose a framework to perform autonomous incremental learning for open-set face recognition suitable for unconstrained HRI scenarios. We validated the proposed framework in a real-world experiment, demonstrating its suitability to let the robot autonomously interact with multiple people while creating a labeled database of their faces across various encounters. Furthermore, we evaluated how an off-the-shelf model performed with data gathered from the HRI setting and proposed a fine-tuned model obtained with a transfer learning technique. Analyses about automatic threshold determination and rehearsal methods for memory sampling were also proposed. Our preliminary results suggest that exploiting the first-hand robot's experience could be crucial to ensure better models' performance and, therefore, could be advantageous for the acceptance and effectiveness of social robots in the long run. With this work, we aim to provide insights on continual learning approaches in the HRI field to promote autonomous and personalized solutions meaningful for real-world applications. Giulia Belgiovine, Jonas Gonzalez-Billandon, Alessandra Sciutti, Giulio Sandini, Francesco Rea |
IROS | 5 |
| 2022 | A Humanoid Robot's Effortful Adaptation Boosts Partners' Commitment to an Interactive Teaching TaskabstractWe tested the hypothesis that, if a robot apparently invests effort in teaching a new skill to a human participant, the human participant will reciprocate by investing more effort in teaching the robot a new skill, too. To this end, we devised a scenario in which the iCub and a human participant alternated in teaching each other new skills. In the Adaptive condition of the robot teaching phase , the iCub slowed down its movements when repeating a demonstration for the human learner, whereas in the Unadaptive condition it sped the movements up when repeating the demonstration. In a subsequent participant teaching phase , human participants were asked to give the iCub a demonstration, and then to repeat it if the iCub had not understood. We predicted that in the Adaptive condition , participants would reciprocate the iCub’s adaptivity by investing more effort to slow down their movements and to increase segmentation when repeating their demonstration. The results showed that this was true when participants experienced the Adaptive condition after the Unadaptive condition and not when the order was inverted, indicating that participants were particularly sensitive to the changes in the iCub’s level of commitment over the course of the experiment. Alessia Vignolo, Henry Powell, Francesco Rea, Alessandra Sciutti, Luke McEllin, John Michael |
ACM Trans. Hum. Robot Interact. | 3 |
| 2021 | Towards a Cognitive Framework for Multimodal Person Recognition in Multiparty HRIabstractThe ability to recognize human partners is an important social skill to build personalized and long-term Human-Robot Interactions (HRI). However, in HRI contexts, unfolding in ever-changing and realistic environments, the identification problem presents still significant challenges. Possible solutions consist of relying on a multimodal approach and making robots learn from their first-hand sensory data. To this aim, we propose a framework to allow robots to autonomously organize their sensory experience into a structured dataset suitable for person recognition during a multiparty interaction. Our results demonstrate the effectiveness of our approach and show that it is a promising solution in the quest of making robots more autonomous in their learning process. Jonas Gonzalez-Billandon, Giulia Belgiovine, Alessandra Sciutti, Giulio Sandini, Francesco Rea |
HAI | 5 |
| 2021 | Magic iCub: A Humanoid Robot Autonomously Catching your Lies in a Card GameabstractGames are often used to foster human partners' engagement and natural behavior, even when they are played with or against robots. Therefore, beyond their entertainment value, games represent ideal interaction paradigms where to investigate natural human-robot interaction and to foster robots' diffusion in the society. However, most of the state-of-the-art games involving robots, are driven with a Wizard of Oz approach. To address this limitation, we present an end-to-end (E2E) architecture to enable the iCub robotic platform to autonomously lead an entertaining magic card trick with human partners. We demonstrate that with this architecture a robot is capable of autonomously directing the game from beginning to end. In particular, the robot could detect in real-time when the players lied in the description of one card in their hands (the secret card). In a validation experiment the robot achieved an accuracy of 88.2% (against a chance level of 16.6%) in detecting the secret card while the social interaction naturally unfolded. The results demonstrate the feasibility of our approach and its effectiveness in entertaining the players and maintaining their engagement. Additionally, we provide evidence on the possibility to detect important measures of the human partner`s inner state such as cognitive load related to lie creation with pupillometry in a short and ecological game-like interaction with a robot. Dario Pasquali, Jonas Gonzalez-Billandon, Francesco Rea, Giulio Sandini, Alessandra Sciutti |
HRI | 3 |
| 2021 | Toward Robots' Behavioral Transparency of Temporal Difference Reinforcement Learning With a Human TeacherabstractThe high request for autonomous human–robot interaction (HRI), combined with the potential of machine learning (ML) techniques, allow us to deploy ML mechanisms in robot control. However, the use of ML can make robots’ behavior unclear to the observer during the learning phase. Recently, transparency in HRI has been investigated to make such interactions more comprehensible. In this work, we propose a model to improve the transparency during reinforcement learning (RL) tasks for HRI scenarios: the model supports transparency by having the robot show nonverbal emotional-behavioral cues. Our model considered human feedback as the reward of the RL algorithm and it presents emotional-behavioral responses based on the progress of the robot learning. The model is managed only by the temporal-difference error. We tested the architecture in a teaching scenario with the iCub humanoid robot. The results highlight that when the robot expresses its emotional-behavioral response, the human teacher is able to understand its learning process better. Furthermore, people prefer to interact with an expressive robot as compared to a mechanical one. Movement-based signals proved to be more effective in revealing the internal state of the robot than facial expressions. In particular, gaze movements were effective in showing the robot's next intentions. In contrast, communicating uncertainty through robot movements sometimes led to action misinterpretation, highlighting the importance of balancing transparency and the legibility of the robot goal. We also found a reliable temporal window in which to register teachers’ feedback that can be used by the robot as a reward. Marco Matarese, Alessandra Sciutti, Francesco Rea, Silvia Rossi 0002 |
IEEE Trans. Hum. Mach. Syst. | 3 |
| 2020 | Interacting with a Social Robot Affects Visual Perception of SpaceabstractHuman partners are very effective at coordinating in space and time. Such ability is particular remarkable considering that visual perception of space is a complex inferential process, which is affected by individual prior experience (e.g. the history of previous stimuli). As a result, two partners might perceive differently the same stimulus. Yet, they find a way to align their perception, as demonstrated by the high degree of coordination observed in sports or even in everyday gestures as shaking hands. Robots would need a similar ability to align with their partner's perception. However, to date there is no knowledge of how the inferential mechanism supporting visual perception operates during social interaction. In the current work, we use a humanoid robot to address this question. We replicate a standard protocol for the quantification of perceptual inference in a HRI setting. Participants estimated the length of a set of segments presented by the humanoid robot iCub. The robot behaved in one condition as a mechanical arm driven by a computer and in another condition as an interactive, social partner. Even if the stimuli presented were the same in the two conditions, length perception was different when the robot was judged as an interactive agent rather than a mechanical tool. When playing with the social robot, participants relied significantly less on stimulus history. This result suggests that the brain changes optimization strategies during interaction and lay the foundations to design human-aware robot visual perception. Carlo Mazzola, Alexander Mois Aroyo, Francesco Rea, Alessandra Sciutti |
HRI | 3 |
| 2020 | Audiovisual cognitive architecture for autonomous learning of face localisation by a Humanoid RobotabstractNewborn infants are naturally attracted to human faces, a crucial source of information for social interaction. In robotics, acquisition of such information is crucial and social robots should also learn to exhibit such social skill. Deep learning algorithms are valid candidates to address the problem of face localisation. However, a major drawback of these methods is the large amount of data and human supervision needed in the training procedure. In this work, we propose a cognitive architecture to address autonomous learning from raw sensory signals without supervision. We demonstrate the success of our cognitive framework for the task of face localisation. The proposed cognitive architecture builds on existing work and uses audiovisual attention and a proactive stereo vision mechanism to autonomously direct a robot’s attentive focus towards human faces. The gathered information is used to incrementally generate a dataset that can be used to train a state-of-the-art deep network. The learning system imitates the typical learning process of infants and enhances the learning generalization process by leveraging on the interaction experience with people. The integration of HRI with machine learning, inspired by early development in humans, constitutes an innovative approach for improving autonomous learning in robots. Jonas Gonzalez-Billandon, Alessandra Sciutti, Matthew S. Tata, Giulio Sandini, Francesco Rea |
ICRA | 5 |
| 2020 | A Humanoid Social Agent Embodying Physical Assistance Enhances Motor Training ExperienceabstractSkilled motor behavior is critical in many human daily life activities and professions. The design of robots that can effectively teach motor skills is an important challenge in the robotics field. In particular, it is important to understand whether the involvement in the training of a robot exhibiting social behaviors impacts on the learning and the experience of the human pupils. In this study, we addressed this question and we asked participants to learn a complex task - stabilizing an inverted pendulum - by training with physical assistance provided by a robotic manipulandum, the Wristbot. One group of participants performed the training only using the Wristbot, whereas for another group the same physical assistance was attributed to the humanoid robot iCub, who played the role of an expert trainer and exhibited also some social behaviors. The results obtained show that participants of both groups effectively acquired the skill by leveraging the physical assistance, as they significantly improved their stabilization performance even when the assistance was removed. Moreover, learning in a context of interaction with a humanoid robot assistant led subjects to increased motivation and more enjoyable training experience, without negative effects on attention and perceived effort. With the experimental approach presented in this study, it is possible to investigate the relative contribution of haptic and social signals in the context of motor learning mediated by human-robot interaction, with the aim of developing effective robot trainers. Giulia Belgiovine, Francesco Rea, Jacopo Zenzeri, Alessandra Sciutti |
RO-MAN | 2 |
| 2019 | Multi-Component Spatiotemporal Attention and its Application to Object Detection in Surveillance VideosabstractThis paper describes multi-component spatiotemporal attention mechanisms in application to object detection in videos. The detection of objects of interest relies on the analysis of feature-point areas (FPAs), which correspond to the object-relevant focus-of-attention (FoA) points extracted by the proposed spatiotemporal mechanisms of attention focusing. The attention mechanisms give detection priority to object-relevant FPAs with spatial saliency, spatiotemporal coherence, and area temporal change including motion. The preliminary test results of the proposed attention focusing mechanisms for object detection and tracking have confirmed its advantage in terms of robustness over existing visual attention-based detectors with comparable run-times. Roman Palenychka, Rami S. Abielmona, Francesco Rea, Emil M. Petriu |
AVSS | 3 |
| 2019 | An adaptive robot teacher boosts a human partner's learning performance in joint actionabstractOne important challenge for roboticists in the coming years will be to design robots to teach humans new skills or to lead humans in activities which require sustained motivation (e.g. physiotherapy, skills training). In the current study, we tested the hypothesis that if a robot teacher invests physical effort in adapting to a human learner in a context in which the robot is teaching the human a new skill, this would facilitate the human's learning. We also hypothesized that the robot teacher's effortful adaptation would lead the human learner to experience greater rapport in the interaction. To this end, we devised a scenario in which the iCub and a human participant alternated in teaching each other new skills. In the high effort condition, the iCub slowed down his movements when repeating a demonstration for the human learner, whereas in the low effort condition he sped the movements up when repeating the demonstration. The results indicate that participants indeed learned more effectively when the iCub adapted its demonstrations, and that the iCub's apparently effortful adaptation led participants to experience him as more helpful. Alessia Vignolo, Henry Powell, Luke McEllin, Francesco Rea, Alessandra Sciutti, John Michael |
RO-MAN | 4 |
| 2019 | Eager to Learn vs. Quick to Complain? How a socially adaptive robot architecture performs with different robot personalitiesabstractA social robot that is aware of our needs and continuously adapts its behaviour to them has the potential of creating a complex, personalized, human-like interaction of the kind we are used to have with our peers in our everyday lives. We are interested in exploring how would an adaptive architecture function and personalize to different users when given different initial values of its variables, i.e. when implementing the same adaptive framework with different robot personalities. Would an architecture that learns very quickly outperform a slower but steadier learning profile? To further explore this, we propose a cognitive architecture for the humanoid robot iCub supporting adaptability and we attempt to validate its functionality and test different robot profiles. Ana Tanevska, Francesco Rea, Giulio Sandini, Lola Cañamero, Alessandra Sciutti |
SMC | 2 |
| 2018 | Will People Morally Crack Under the Authority of a Famous Wicked Robot?abstractAuthority and obedience are key regulatory elements in a society. Robots are becoming important part of our world, and are starting to interact in domains in which authority is an important aspect, as healthcare, teaching or law enforcement. Yet, there is little research on how people behave when robots show authority. In particular, although extensive investigations have been carried out on how authority can circumvent people's morality with experiments such as Milgram's or Stanford Prison, almost no research evaluated the effect of robots pushing the limits of people's own morality. This experiment tries to study this aspect by using a robot (geminoid) with the appearance, and thus authority of a famous person, and by pushing the boundaries asking morally controversial requests. The results show that, even though most people hesitate and recognize the requests as socially inappropriate, they obey to robots with authority. This suggests that the authority of the robot can push people to perform tasks usually considered as inappropriate. Alexander Mois Aroyo, T. Kyohei, Tora Koyama, Hideyuki Takahashi, Francesco Rea, Alessandra Sciutti, Yuichiro Yoshikawa, Hiroshi Ishiguro, Giulio Sandini |
RO-MAN | 5 |
| 2017 | Adaptation to a humanoid robot in a collaborative joint taskabstractMutual synchronization plays a decisive role in effective collaborations in human joint tasks. Interaction between humans and robots need to show similar emergent coordination. To this aim models of human synchronization have recently been ported on collaborative robots with success [1]. However, it is also important to consider under which conditions the human partner is willing to adapt to the robot while performing a joint task. The main research goal of this study is to understand whether the temporal adaptation usually observed during human-human interaction occurs also during human-robot cooperation. We present a collaborative joint task engaging both human subjects and the humanoid robot iCub in pursuing an identical common goal: putting blocks into a box. We examine human action timing, evinced from motion capture data, in order to investigate whether humans adapt their behavior to the robot. We compare a quantitative measure of such adaptation with the subjective evaluation extracted from questionnaires. We observe that on average participants tend to adapt to their robotic partner. Nevertheless, by looking at individual behaviors, only few showed a clear adaptation to its timing, despite the vast majority of the subjects reported to have been influenced by the robot. We conclude discussing the potential factors influencing human adaptability, with the suggestion that the speed of execution of the robot is determinant in the coordination. Fabio Vannucci, Alessandra Sciutti, Marco Jacono, Giulio Sandini, Francesco Rea |
RO-MAN | 5 |
| 2016 | Eye tracking for human robot interactionabstractHumans use eye gaze in their daily interaction with other humans. Humanoid robots, on the other hand, have not yet taken full advantage of this form of implicit communication. We designed a passive monocular gaze tracking system implemented on the iCub humanoid robot [Metta et al. 2008]. The validation of the system proved that it is a viable low-cost, calibration-free gaze tracking solution for humanoid platforms, with a mean absolute error of about 5 degrees on horizontal angle estimates. We also demonstrated the applicability of our system to human-robot collaborative tasks, showing that the eye gaze reading ability can enable successful implicit communication between humans and the robot. Oskar Palinko, Francesco Rea, Giulio Sandini, Alessandra Sciutti |
ETRA | 2 |
| 2016 | Robot reading human gaze: Why eye tracking is better than head tracking for human-robot collaborationabstractRobots are at the position to become our everyday companions in the near future. Still, many hurdles need to be cleared to achieve this goal. One of them is the fact that robots are still not able to perceive some important communication cues naturally used by humans, e.g. gaze. In the recent past, eye gaze in robot perception was substituted by its proxy, head orientation. Such an approach is still adopted in many applications today. In this paper we introduce performance improvements to an eye tracking system we previously developed and use it to explore if this approximation is appropriate. More precisely, we compare the impact of the use of eye- or head-based gaze estimation in a human robot interaction experiment with the iCub robot and naïve subjects. We find that the possibility to exploit the richer information carried by eye gaze has a significant impact on the interaction. As a result, our eye tracking system allows for a more efficient human-robot collaboration than a comparable head tracking approach, according to both quantitative measures and subjective evaluation by the human participants. Oskar Palinko, Francesco Rea, Giulio Sandini, Alessandra Sciutti |
IROS | 2 |
| 2015 | Gaze contingency in turn-taking for human robot interaction: Advantages and drawbacksabstractIt is generally accepted that a robot should exhibit a contingent behavior, adaptable to the needs of each individual user, to achieve a more natural and pleasant interaction. In this paper we have evaluated whether this general rule applies also when the robot plays a leading role and needs to motivate the human partner to keep a certain pace, as during training or teaching. Also among humans, in schools or factories, structured interaction is often guided by a predefined rhythm, which facilitates the coordination of the partners involved and is thought to maximize their efficiency. On the other hand, a pre-established timing forces all participants to adjust their natural speed to the external, sometimes not appropriate, timing requirement. Where does the optimal trade-off between these two paradigms lie? We have addressed this question in a dictation scenario where the humanoid robot iCub plays the role of a teacher and dictates brief English or Italian sentences to the participants. In particular we compare a condition in which the dictation is performed at a fixed timing with a condition in which iCub monitors subjects' gaze to adjust its dictation speed. The results are discussed both in terms of participants' subjective evaluation and their objective performance, by highlighting the advantages and drawbacks of the choice of contingent robot behavior. Oskar Palinko, Alessandra Sciutti, Lars Schillingmann, Francesco Rea, Yukie Nagai, Giulio Sandini |
RO-MAN | 4 |
| 2014 | Weight-aware robot motion planning for lift-to-pass actionabstractPassing an object between two humans is a very natural and seamless operation, mainly thanks to non-verbal cues which facilitate the process. Just from action observation, humans can easily anticipate where and when a passing movement will end and how heavy the transported object is. But how could this natural understanding be ported to non-human agents? We introduce a simple robotic architecture to enable the iCub humanoid robot to visually recognize the weight of an object and select a lift-to-pass motion which implicitly communicates such information to the action partner. In this work we mainly focus on the building and training of the procedural memory module needed to store the association between the mass of an object and its visual appearance, and we propose how such a model can be used to successively select communicative lifting motions. Oskar Palinko, Alessandra Sciutti, Francesco Rea, Giulio Sandini |
HAI | 3 |
| 2014 | Towards better eye tracking in human robot interaction using an affordable active vision systemabstractKnowing where a person is looking is an important parameter of every human-human interaction. Detecting a person's gaze could significantly improve the interaction capabilities of today's robotic agents. But many robots' visual systems are limited by data bandwidth and optical hardware. We propose a low-cost high-def pan/tilt/zoom active vision system that could significantly improve the robot's eye tracking capabilities. We tested the proposed system for improving mutual gaze detection in a human-robot interaction scenario and found significant results compared to systems without zoom capability. Oskar Palinko, Alessandra Sciutti, Francesco Rea, Giulio Sandini |
HAI | 3 |
| 2014 | When you are young, (robot's) looks matter. Developmental changes in the desired properties of a robot friendabstractSeeing the world through the eyes of a child is always difficult. Designing a robot that might be liked and accepted by young users is therefore particularly complicated. We have investigated children's opinions on which features are most important in an interactive robot during a popular scientific event where we exhibited the iCub humanoid robot to a mixed public of various ages. From the observation of the participants' reactions to various robot demonstrations and from a dedicated ranking game, we found that children's requirements for a robot companion change sensibly with age. Before 9 years of age children give more relevance to a human-like appearance, while older kids and adults pay more attention to robot action skills. Additionally, the possibility to see and interact with a robot has an impact on children's judgments, especially convincing the youngest to consider also perceptual and motor abilities in a robot, rather than just its shape. These results suggest that robot design needs to take into account the different prior beliefs that children and adults might have when they see a robot with a human-like shape. Alessandra Sciutti, Francesco Rea, Giulio Sandini |
RO-MAN | 2 |
| 2013 | Can a robotic attention system simulate infant gazing behavior?abstractIn this paper, we are presenting a human robot interaction study, which is targeting the question, how the attention system of the iCub robot is performing in comparison with infants. To answer this, we have studied a task presentation, towards infants, the iCub simulator and the iCub robot. We compared the gazing behavior of the recipients. In developmental robotics, as well as in tutoring situations, the gazing behavior of the recipient plays an important role for the following interaction. Katrin S. Lohan, Francesco Rea, Giorgio Metta |
RO-MAN | 2 |