Tony J. Prescott

dblp:95/5797 · DBLP profile ↗
← Back
44ranked-venue papers
9as first author
5since 2021 · last 2025
0000-0003-4927-5390ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 29 · 8 first-author · 2 since 2021Systems, architecture and hardware · 12 · 1 since 2021Human-computer interaction and ubiquitous computing · 10 · 1 first-author · 3 since 2021Applied, interdisciplinary, general and emerging computing · 6 · 1 since 2021Databases, data management, data science and information retrieval · 1Graphics, computer vision, multimedia, augmented reality and games · 1
YearPublicationVenuePosition
2025 Hey Miro! Multimodal Interaction with an Animal-Like Robot Companion with Conversational Abilities
abstract
To make best use of large-language models (LLMs) in social robotics it is critical that verbal interaction capabilities are suitably integrated with robot perceptual and behavioral systems, including non-verbal and emotional signaling, such that the robot can use language in a grounded and context-appropriate way. This demonstration shows the integration of a LLM with the layered control architecture of the animal-like robot platform Miro-e alongside deep network models for perception and spoken language recognition and generation. This system is currently being developed as a prototype companion robot for research on robot-assisted therapy.
Aung Htet, Kinga Bernacka, Omar Marei, Jake N. Holden, Tony J. Prescott
HRI5
2025 Advancing Affective Intelligence in Virtual Agents Using Affect Control Theory
Evdoxia Eirini Lithoxoidou, George Eleftherakis, Konstantinos Votis, Tony J. Prescott
IUI4
2025 Exploring the influence of perceived extroversion in embodied virtual agents on trust and likability
abstract
Abstract Embodied virtual agents (EVAs) are beginning to be researched to improve human–computer interaction. As EVAs become increasingly integrated into various aspects of daily life, understanding how to optimize their design to foster trust and likability among users is paramount. Leveraging insights from social psychology, particularly the concept of homophily, this study investigates the impact of perceived personality traits on user perceptions of EVAs. Specifically, we explore whether aligning the personality traits of EVAs with those of users increases engagement and fosters positive interactions. Drawing on a sample of 382 participants recruited through Amazon Mechanical Turk, we assessed participants' personality traits using the Big Five Inventory—2S, while the perceived extroversion of the agent was manipulated through facial expressions and body posture. Our findings suggest that participants were able to accurately identify the perceived extroversion of the agent (p = .014), and significant results indicate a homophily effect on trust, with participants exhibiting greater trust in agents perceived as having a similar level of extroversion (p < .01). However, no significant effect on likability was detected, suggesting a more nuanced relationship between perceived personality traits and user preferences. These findings highlight the potential of leveraging homophily in designing more engaging EVAs and underscore the importance of considering user–agent compatibility in human–computer interaction.
Evdoxia Eirini Lithoxoidou, Angelos Stamos, Andreas Triantafyllidis, Charalampos Georgiadis, Efthymios Altsitsiadis, Dimitrios Giakoumis, Konstantinos Votis, Siegfried Dewitte, Dimitrios Tzovaras, George Eleftherakis, Tony J. Prescott
User Model. User Adapt. Interact.11
2021 Robust and Long-term Monocular Teach and Repeat Navigation using a Single-experience Map
abstract
This paper presents a robust monocular visual teach-and-repeat (VT&R) navigation system for long-term operation in outdoor environments. The approach leverages deep-learned descriptors to deal with the high illumination variance of the real world. In particular, a tailored self-supervised descriptor, DarkPoint, is proposed for autonomous navigation in outdoor environments. We seamlessly integrate the localisation with control, in which proportional–integral control is used to eliminate the visual error with the pitfall of the unknown depth. Consequently, our approach achieves day-to-night navigation using a single-experience map and is able to repeat complex and fast manoeuvres. To verify our approach, we performed a vast array of navigation experiments in various outdoor environments, where both navigation accuracy and robustness of the proposed system are investigated. The experimental results show that our approach is superior to the baseline method with regards to accuracy and robustness.
Li Sun 0005, Marwan Taher, Christopher Wild, Cheng Zhao 0002, Yu Zhang 0091, Filip Majer, Zhi Yan 0001, Tomás Krajník, Tony J. Prescott, Tom Duckett
IROS9
2021 Collinear Mecanum Drive: Modeling, Analysis, Partial Feedback Linearization, and Nonlinear Control
abstract
The collinear Mecanum drive (CMD) is a novel robot locomotion system, capable of generating omnidirectional motion while simultaneously dynamically balancing, achieved using a collinear arrangement of three or more Mecanum wheels. The CMD has a significantly thinner ground footprint than existing omnidirectional locomotion methods, which does not need to be enlarged with increasing robot height as to avoid toppling during acceleration or external disturbance. This combination of omnidirectional manoeuvrability and a thin ground footprint allows for the creation of tall robots that are able to navigate through much narrower gaps between obstacles than existing omnidirectional locomotion methods. This allows for greater manoeuvrability in confined and cluttered environments, such as that encountered in the personal service and automated warehousing robotics sectors. This article derives the kinematics and dynamics models of the CMD, analyzes controllability and accessibility, and determines the degree to which a CMD can be linearized by feedback. A partial feedback linearization is then performed, and three practically useful nonlinear controllers are derived using a backstepping design approach, all with convergence and stability guarantees for the fully coupled nonlinear model. These are demonstrated both in simulation and on a real-world CMD experimental prototype.
Matthew Thomas Watson, Dan Gladwin, Tony J. Prescott
IEEE Trans. Robotics3
2020 Learning from sensory predictions for autonomous and adaptive exploration of object shape with a tactile robot
Uriel Martinez-Hernandez, Adrian Rubio Solis, Tony J. Prescott
Neurocomputing3
2019 Velocity Constrained Trajectory Generation for a Collinear Mecanum Wheeled Robot
abstract
While much research has been conducted into the generation of smooth trajectories for underactuated unstable aerial vehicles such as quadrotors, less attention has been paid to the application of the same techniques to ground based omnidirectional dynamically balancing robots. These systems have more control authority over their linear accelerations than aerial vehicles, meaning trajectory smoothness is less of a critical design parameter. However, when operating in indoor environments these systems must often adhere to relatively low velocity constraints, resulting in very conservative trajectories when enforced using existing trajectory optimisation methods. This paper makes two contributions; this gap is bridged by the extension of these existing methods to create a fast velocity constrained trajectory planner, with trajectory timing characteristics derived from the optimal minimum-time solution of a simplified acceleration and velocity constrained model. Next, a differentially flat model of an omnidirectional balancing robot utilizing a collinear Mecanum drive is derived, which is used to allow an experimental prototype of this configuration to smoothly follow these velocity constrained trajectories.
Matthew Thomas Watson, Dan Gladwin, Tony J. Prescott, Sebastian Conran
ICRA3
2018 The effects of robot facial emotional expressions and gender on child-robot interaction in a field study
abstract
Emotions, and emotional expression, have a broad influence on social interactions and are thus a key factor to consider in developing social robots. This study examined the impact of life-like affective facial expressions, in the humanoid robot Zeno, on children’s behaviour and attitudes towards the robot. Results indicate that robot expressions have mixed effects depending on participant gender. Male participants interacting with a responsive facially expressive robot showed a positive affective response and indicated greater liking towards the robot, compared to those interacting with the same robot maintaining a neutral expression. Female participants showed no marked difference across the conditions. We discuss the broader implications of these findings in terms of gender differences in human–robot interaction, noting the importance of the gender appearance in robots (in this case, male) and in relation to advancing the understanding of how interactions with expressive robots could lead to task-appropriate symbiotic relationships.
David Cameron, Abigail Millings, Samuel Fernando, Emily C. Collins 0001, Roger K. Moore, Amanda J. C. Sharkey, Vanessa Evers, Tony J. Prescott
Connect. Sci.8
2018 Feeling the Shape: Active Exploration Behaviors for Object Recognition With a Robotic Hand
abstract
Autonomous exploration in robotics is a crucial feature to achieve robust and safe systems capable to interact with and recognize their surrounding environment. In this paper, we present a method for object recognition using a three-fingered robotic hand actively exploring interesting object locations to reduce uncertainty. We present a novel probabilistic perception approach with a Bayesian formulation to iteratively accumulate evidence from robot touch. Exploration of better locations for perception is performed by familiarity and novelty exploration behaviors, which intelligently control the robot hand to move toward locations with low and high levels of interestingness, respectively. These are active behaviors that, similar to the exploratory procedures observed in humans, allow robots to autonomously explore locations they believe that contain interesting information for recognition. Active behaviors are validated with object recognition experiments in both offline and real-time modes. Furthermore, the effects of inhibiting the active behaviors are analyzed with a passive exploration strategy. The results from the experiments demonstrate the accuracy of our proposed methods, but also their benefits for active robot control to intelligently explore and interact with the environment.
Uriel Martinez-Hernandez, Tony J. Dodd, Tony J. Prescott
IEEE Trans. Syst. Man Cybern. Syst.3
2017 Adaptive perception: Learning from sensory predictions to extract object shape with a biomimetic fingertip
abstract
In this work, we present an adaptive perception method to improve the performance in accuracy and speed of a tactile exploration task. This work extends our previous studies on sensorimotor control strategies for active tactile perception in robotics. First, we present the active Bayesian perception method to actively reposition a robot to accumulate evidence from better locations to reduce uncertainty. Second, we describe the adaptive perception method that, based on a forward model and a predicted information gain approach, allows to the robot to analyse `what would have happened' if a different decision `would have been made' at previous decision time. This approach permits to adapt the active Bayesian perception process to improve the performance in accuracy and reaction time of an exploration task. Our methods are validated with a contour following exploratory procedure with a touch sensor. The results show that the adaptive perception method allows the robot to make sensory predictions and autonomously adapt, improving the performance of the exploration task.
Uriel Martinez-Hernandez, Tony J. Prescott
IROS2
2017 Robots are not just tools
abstract
The EPSRC principles of robotics make a number of commitments about the ontological status of robots such as that robots are “just tools” or can give only “an impression or real intelligence”. This commentary proposes that this assumes, all too easily, that we know the boundary conditions of future robotics development, and argues that progress towards a more useful set of principles could begin by thinking carefully about the ontological status of robots. Whilst most robots are currently little more than tools, we are entering an era where there will be new kinds of entities that combine some of the properties of tools with psychological capacities that we had previously thought were reserved for complex biological organisms such as humans. The ontological status of robots might be best described as liminal – neither living nor simply mechanical. There is also evidence that people will treat robots as more than just tools regardless of the extent to which their machine nature is transparent. Ethical principles need to be developed that recognise these ontological and psychological issues around the nature of robots and how they are perceived.
Tony J. Prescott
Connect. Sci.1
2017 Ethical principles of robotics
abstract
This Connection Science special issue, published in two parts as volume 29/2 and 29/3, addresses ethical and societal issues in robotics. In this editorial, we explain the background to the special...
Tony J. Prescott, Michael Szollosy
Connect. Sci.1
2017 Editorial: Ethical Principles of Robotics
abstract
This Connection Science special issue, published in two parts as volume 29/2 and 29/3, addresses ethical and societal issues in robotics. The background to the special issue was explained in the ed...
Tony J. Prescott, Michael Szollosy
Connect. Sci.1
2016 Bayesian perception of touch for control of robot emotion
abstract
In this paper, we present a Bayesian approach for perception of touch and control of robot emotion. Touch is an important sensing modality for the development of social robots, and it is used in this work as stimulus through a human-robot interaction. A Bayesian framework is proposed for perception of various types of touch. This method together with a sequential analysis approach allow the robot to accumulate evidence from the interaction with humans to achieve accurate touch perception for adaptable control of robot emotions. Facial expressions are used to represent the emotions of the iCub humanoid. Emotions in the robotic platform, based on facial expressions, are handled by a control architecture that works with the output from the touch perception process. We validate the accuracy of our system with simulated and real robot touch experiments. Results from this work show that our method is suitable and accurate for perception of touch to control robot emotions, which is essential for the development of sociable robots.
Uriel Martinez-Hernandez, Adrian Rubio Solis, Tony J. Prescott
IJCNN3
2016 Expressive touch: Control of robot emotional expression by touch
abstract
In this paper, we present a work on control of robot emotional expression using touch sensing. A tactile Bayesian framework is proposed for recognition of different types of touch gestures. We include a sequential analysis method that, based on the accumulation of evidence from tactile interaction, allows to achieve accurate results for recognition of touch. Input data to our method is obtained from touch sensing, which is an important modality for social robotics. Here, emotion in the robot platform are represented by facial expressions, that are handled by a developed control architecture. We validate our method with experiments on tactile interaction in simulated and real robot environments. Results demonstrate that our proposed method is suitable and accurate for control of robot emotions through interaction with humans using touch sensing. Furthermore, it is demonstrated the potential that touch provides as a non-verbal communication channel for the development of social robots capable to interact with humans.
Uriel Martinez-Hernandez, Tony J. Prescott
RO-MAN2
2015 MIRO: a versatile biomimetic edutainment robot
abstract
Here we present MIRO, a companion robot designed to engage users in science and robotics via edutainment. MIRO is a robot that is biomimetic in aesthetics, morphology, behaviour, and control architecture. In this paper, we review how these design choices affect its suitability for a companionship role. In particular, we consider how MIRO's emulation of familiar mammalian body language as one component of a broader biomimetic expressive system provides effective communication of emotional state and intent. We go on to discuss how these features contribute to MIRO's potential in other domains such as healthcare, education, and research.
Emily C. Collins 0001, Tony J. Prescott, Benjamin Mitchinson, Sebastian Conran
Advances in Computer Entertainment2
2015 Active haptic shape recognition by intrinsic motivation with a robot hand
abstract
In this paper, we present an intrinsic motivation approach applied to haptics in robotics for tactile object exploration and recognition. Here, touch is used as the sensation process for contact detection, whilst proprioceptive information is used for the perception process. First, a probabilistic method is employed to reduce uncertainty present in tactile measurements. Second, the object exploration process is actively controlled by intelligently moving the robot hand towards interesting locations. The active behaviour performed with the robotic hand is achieved by an intrinsic motivation approach, which permitted to improve the accuracy for object recognition over the results obtained by a fixed sequence of exploration movements. The proposed method was validated in a simulated environment with a Monte Carlo method, whilst for the real environment a three-fingered robotic hand and various object shapes were employed. The results demonstrate that our method is robust and suitable for haptic perception in autonomous robotics.
Uriel Martinez-Hernandez, Nathan F. Lepora, Tony J. Prescott
World Haptics3
2015 Editorial
abstract
Dear Readers,I am delighted to have completed my first year as the Editor-in-chief of Connection Science. At the beginning of the year, we revised our aims and scope to give greater relevance to cu...
Tony J. Prescott
Connect. Sci.1
2015 Tactile Superresolution and Biomimetic Hyperacuity
abstract
Motivated by the impact of superresolution methods for imaging, we undertake a detailed and systematic analysis of localization acuity for a biomimetic fingertip and a flat region of tactile skin. We identify three key factors underlying superresolution that enable the perceptual acuity to surpass the sensor resolution: 1) the sensor is constructed with multiple overlapping, broad but sensitive receptive fields; 2) the tactile perception method interpolates between receptors (taxels) to attain subtaxel acuity; and 3) active perception ensures robustness to unknown initial contact location. All factors follow from active Bayesian perception applied to biomimetic tactile sensors with an elastomeric covering that spreads the contact over multiple taxels. In consequence, we attain extreme superresolution with a 35-fold improvement of localization acuity (0.12 mm) over sensor resolution (4 mm). We envisage that these principles will enable cheap high-acuity tactile sensors that are highly customizable to suit their robotic use. Practical applications encompass any scenario where an end-effector must be placed accurately via the sense of touch.
Nathan F. Lepora, Uriel Martinez-Hernandez, Mathew H. Evans, Lorenzo Natale, Giorgio Metta, Tony J. Prescott
IEEE Trans. Robotics6
2014 Editorial
abstract
Connection Science has just completed its 25th year of publication, a remarkable milestone and a tribute to the vision of its founding editor Noel Sharkey, and to its past and current editorial boa...
Tony J. Prescott
Connect. Sci.1
2013 Cerebellum-based adaptation for fine haptic control over the space of uncertain surfaces
abstract
This work aims to augment the capacities for haptic perception in the iCub robot to generate a controller for surface exploration. The main task involves moving the hand over an irregular surface with uncertain slope, by concurrently regulating the pressure of the contact. Providing this ability will enable the autonomous extraction of important haptic features, such as texture and shape. We propose a hand controller whose operational space is defined over the surface of contact. The surface is estimated using a robust probabilistic estimator, which is then used for path planning. The motor commands are generated using a feedback controller, taking advantage of the kinematic information available by proprioception. Finally, the effectiveness of this controller is extended using a cerebellar-like adapter that generates reliable pressure tracking over the finger and results in a trajectory with less vulnerability to perturbations. The results of this work are consistent with insights about the role of the cerebellum on haptic perception in humans.
Hector Barron-Gonzalez, John Porrill, Nathan F. Lepora, Eris Chinellato, Giorgio Metta, Tony J. Prescott
World Haptics6
2013 Active contour following to explore object shape with robot touch
abstract
In this work, we present an active tactile perception approach for contour following based on a probabilistic framework. Tactile data were collected using a biomimetic fingertip sensor. We propose a control architecture that implements a perception-action cycle for the exploratory procedure, which allows the fingertip to react to tactile contact whilst regulating the applied contact force. In addition' the fingertip is actively repositioned to an optimal position to ensure accurate perception. The method is trained off-line and then the testing performed on-line based on contour following around several different test shapes. We then implement object recognition based on the extracted shapes. Our active approach is compared with a passive approach, demonstrating that active perception is necessary for successful contour following and hence shape recognition.
Uriel Martinez-Hernandez, Giorgio Metta, Tony J. Dodd, Tony J. Prescott, Lorenzo Natale, Nathan F. Lepora
World Haptics4
2013 Plenary talks: From whiskers to fingertips - A biomimetic approach to active touch sensing
abstract
How do animals understand the physical world they live in? One answer, due to Gibson, is that their sensory systems are tuned to pick up relevant affordances for behavior, but how is it that the brain and the sensory apparatus become suitably adapted to perform this feat? To cast light on this question we have been investigating active touch sensing in mammals, including humans, and developing biomimetic robots that can help us understand these biological systems whilst also developing useful haptic technologies. An important focus has been on the vibrissal (whisker) system of rodents, and its emergence through evolution and development, which we have investigated through a combination of (i) ethological studies of behaving animals, (ii) computational neuroscience models of the neural circuits involved in vibrissal processing, and (iii) biomimetic robots embodying many of the characteristics of whiskered animals in their design and control. This work has resulted in a series of whiskered robots, the most recent of which, Shrewbot, is able to construct tactile maps of its environment and recognize and track moving objects. We are also studying humanoid touch, focusing on the development of Bayesian strategies for active tactile sensing with robot hands. Here our results have provided the first demonstration of hyperacuity in robot touch whilst also indicating that tactile perception is improved in unstructured environments by appropriate active control. The active sensing framework can also be applied to the development of haptic interfaces for human users that can augment our existing sensory capability. For instance, we are developing a head-mounted “remote touch” system that links distance sensors (ultrasound arrays) with vibrotactile displays. Here an interesting question is how the signals that are delivered through the displays should be modulated to take into account the intentional head and body movements of the user and in order to provide a meaningful and intuitive experience. The talk will present converging lines of evidence, from these different research strands, for the importance of active control in haptics. Our results will also be used to illustrate how experimental, computational, and robotic approaches can operate together to advance our understanding of sensorimotor cognition in behaving systems.
Tony J. Prescott, Masahiko Inami, Abdulmotaleb El Saddik, Wayne J. Book
World Haptics1
2013 Active touch for robust perception under position uncertainty
abstract
In this paper, we propose that active perception will help attain autonomous robotics in unstructured environments by giving robust perception. We test this claim with a biomimetic fingertip that senses surface texture under a range of contact depths. We compare the performance of passive Bayesian perception with a novel approach for active perception that includes a sensorimotor loop for controlling sensor position. Passive perception at a single depth gave poor results, with just 0.2mm uncertainty impairing performance. Extending passive perception over a range of depths gave non-robust performance. Only active perception could give robust, accurate performance, with the sensorimotor feedback compensating the position uncertainty. We expect that these results will extend to other stimuli, so that active perception will offer a general approach to robust perception in unstructured environments.
Nathan F. Lepora, Uriel Martinez-Hernandez, Tony J. Prescott
ICRA3
2013 Simultaneous localisation and mapping on a multi-degree of freedom biomimetic whiskered robot
abstract
A biomimetic mobile robot called “Shrewbot” has been built as part of a neuroethological study of the mammalian facial whisker sensory system. This platform has been used to further evaluate the problem space of whisker based tactile Simultaneous Localisation And Mapping (tSLAM). Shrewbot uses a biomorphic 3-dimensional array of active whiskers and a model of action selection based on tactile sensory attention to explore a circular walled arena sparsely populated with simple geometric shapes. Datasets taken during this exploration have been used to parameterise an approach to localisation and mapping based on probabilistic occupancy grids. We present the results of this work and conclude that simultaneous localisation and mapping is possible given only noisy odometry and tactile information from a 3-dimensional array of active biomimetic whiskers and no prior information of features in the environment.
Martin J. Pearson, Charles W. Fox, J. Charles Sullivan, Tony J. Prescott, Anthony G. Pipe, Benjamin Mitchinson
ICRA4
2013 Active Bayesian perception and reinforcement learning
abstract
In a series of papers, we have formalized an active Bayesian perception approach for robotics based on recent progress in understanding animal perception. However, an issue for applied robot perception is how to tune this method to a task, using: (i) a belief threshold that adjusts the speed-accuracy tradeoff; and (ii) an active control strategy for relocating the sensor e.g. to a preset fixation point. Here we propose that these two variables should be learnt by reinforcement from a reward signal evaluating the decision outcome. We test this claim with a biomimetic fingertip that senses surface curvature under uncertainty about contact location. Appropriate formulation of the problem allows use of multi-armed bandit methods to optimize the threshold and fixation point of the active perception. In consequence, the system learns to balance speed versus accuracy and sets the fixation point to optimize both quantities. Although we consider one example in robot touch, we expect that the underlying principles have general applicability.
Nathan F. Lepora, Uriel Martinez-Hernandez, Giovanni Pezzulo, Tony J. Prescott
IROS4
2013 Active Bayesian perception for angle and position discrimination with a biomimetic fingertip
abstract
In this work, we apply active Bayesian perception to angle and position discrimination and extend the method to perform actions in a sensorimotor task using a biomimetic fingertip. The first part of this study tests active perception off-line with a large dataset of edge orientations and positions, using a Monte Carlo validation to ascertain the classification accuracy. We observe a significant improvement over passive methods that lack a sensorimotor loop for actively repositioning the sensor. The second part of this study then applies these findings about active perception to an example sensorimotor task in real-time. Using an appropriate online sensorimotor control architecture, the robot made decisions about what to do next and where to move next, which was applied to a contour-following task around several objects. The successful outcome of this simple but illustrative task demonstrates that active perception can be of practical benefit for tactile robotics.
Uriel Martinez-Hernandez, Tony J. Dodd, Tony J. Prescott, Nathan F. Lepora
IROS3
2013 Whisker Movements Reveal Spatial Attention: A Unified Computational Model of Active Sensing Control in the Rat
abstract
Spatial attention is most often investigated in the visual modality through measurement of eye movements, with primates, including humans, a widely-studied model. Its study in laboratory rodents, such as mice and rats, requires different techniques, owing to the lack of a visual fovea and the particular ethological relevance of orienting movements of the snout and the whiskers in these animals. In recent years, several reliable relationships have been observed between environmental and behavioural variables and movements of the whiskers, but the function of these responses, as well as how they integrate, remains unclear. Here, we propose a unifying abstract model of whisker movement control that has as its key variable the region of space that is the animal's current focus of attention, and demonstrate, using computer-simulated behavioral experiments, that the model is consistent with a broad range of experimental observations. A core hypothesis is that the rat explicitly decodes the location in space of whisker contacts and that this representation is used to regulate whisker drive signals. This proposition stands in contrast to earlier proposals that the modulation of whisker movement during exploration is mediated primarily by reflex loops. We go on to argue that the superior colliculus is a candidate neural substrate for the siting of a head-centred map guiding whisker movement, in analogy to current models of visual attention. The proposed model has the potential to offer a more complete understanding of whisker control as well as to highlight the potential of the rodent and its whiskers as a tool for the study of mammalian attention.
Benjamin Mitchinson, Tony J. Prescott
PLoS Comput. Biol.2
2012 Tactile SLAM with a biomimetic whiskered robot
abstract
Future robots may need to navigate where visual sensors fail. Touch sensors provide an alternative modality, largely unexplored in the context of robotic map building. We present the first results in grid based simultaneous localisation and mapping (SLAM) with biomimetic whisker sensors, and show how multi-whisker features coupled with priors about straight edges in the world can boost its performance. Our results are from a simple, small environment but are intended as a first baseline to measure future algorithms against.
Charles W. Fox, Mathew H. Evans, Martin J. Pearson, Tony J. Prescott
ICRA4
2012 Brain-inspired Bayesian perception for biomimetic robot touch
abstract
Studies of decision making in animals suggest a neural mechanism of evidence accumulation for competing percepts according to Bayesian sequential analysis. This model of perception is embodied here in a biomimetic tactile sensing robot based on the rodent whisker system. We implement simultaneous perception of object shape and location using two psychological test paradigms: first, a free-response paradigm in which the agent decides when to respond, implemented with Bayesian sequential analysis; and second an interrogative paradigm in which the agent responds after a fixed interval, implemented with maximum likelihood estimation. A benefit of free-response Bayesian perception is that it allows tuning of reaction speed against accuracy. In addition, we find that large gains in decision performance are achieved with unforced responses that allow null decisions on ambiguous data. Therefore free-response Bayesian perception offers benefits for artificial systems that make them more animal-like in behavior.
Nathan F. Lepora, J. Charlie Sullivan, Benjamin Mitchinson, Martin J. Pearson, Kevin N. Gurney, Tony J. Prescott
ICRA6
2012 Whiskered texture classification with uncertain contact pose geometry
abstract
Tactile sensing can be an important source of information for robots, and texture discrimination in particular is useful in object recognition and terrain identification. Whisker based tactile sensing has recently been shown to be a promising approach for mobile robots, using simple sensors and many classification approaches. However these approaches have often been tested in limited environments, and have not been compared against one another in a controlled way. A wide range of whisker-object contact poses are possible on a mobile robot, and the effect such contact variability has on sensing has not been properly investigated. We present a novel, carefully controlled study of simple surface texture classifiers on a large set of varied pose conditions that mimic those encountered by mobile robots. Namely, single brief whisker contacts with textured surfaces at a range of surface orientations and contact speeds. Results show that different classifiers are appropriate for different settings, with spectral template and feature based approaches performing best in surface texture, and contact speed estimation, respectively. The results may be used to inform selection of classifiers in tasks such as tactile SLAM.
Mathew H. Evans, Martin J. Pearson, Nathan F. Lepora, Tony J. Prescott, Charles W. Fox
IROS4
2012 Embodied hyperacuity from Bayesian perception: Shape and position discrimination with an iCub fingertip sensor
abstract
Recent advances in modeling animal perception has motivated an approach of Bayesian perception applied to biomimetic robots. This study presents an initial application of Bayesian perception on an iCub fingertip sensor mounted on a dedicated positioning robot. We systematically probed the test system with five cylindrical stimuli offset by a range of positions relative to the fingertip. Testing the real-time speed and accuracy of shape and position discrimination, we achieved sub-millimeter accuracy with just a few taps. This result is apparently the first explicit demonstration of perceptual hyperacuity in robot touch, in that object positions are perceived more accurately than the taxel spacing. We also found substantial performance gains when the fingertip can reposition itself to avoid poor perceptual locations, which indicates that improved robot perception could mimic active perception in animals.
Nathan F. Lepora, Uriel Martinez-Hernandez, Hector Barron-Gonzalez, Mathew H. Evans, Giorgio Metta, Tony J. Prescott
IROS6
2011 Neural Computation via Neural Geometry: A Place Code for Inter-whisker Timing in the Barrel Cortex?
abstract
The place theory proposed by Jeffress (1948) is still the dominant model of how the brain represents the movement of sensory stimuli between sensory receptors. According to the place theory, delays in signalling between neurons, dependent on the distances between them, compensate for time differences in the stimulation of sensory receptors. Hence the location of neurons, activated by the coincident arrival of multiple signals, reports the stimulus movement velocity. Despite its generality, most evidence for the place theory has been provided by studies of the auditory system of auditory specialists like the barn owl, but in the study of mammalian auditory systems the evidence is inconclusive. We ask to what extent the somatosensory systems of tactile specialists like rats and mice use distance dependent delays between neurons to compute the motion of tactile stimuli between the facial whiskers (or 'vibrissae'). We present a model in which synaptic inputs evoked by whisker deflections arrive at neurons in layer 2/3 (L2/3) somatosensory 'barrel' cortex at different times. The timing of synaptic inputs to each neuron depends on its location relative to sources of input in layer 4 (L4) that represent stimulation of each whisker. Constrained by the geometry and timing of projections from L4 to L2/3, the model can account for a range of experimentally measured responses to two-whisker stimuli. Consistent with that data, responses of model neurons located between the barrels to paired stimulation of two whiskers are greater than the sum of the responses to either whisker input alone. The model predicts that for neurons located closer to either barrel these supralinear responses are tuned for longer inter-whisker stimulation intervals, yielding a topographic map for the inter-whisker deflection interval across the surface of L2/3. This map constitutes a neural place code for the relative timing of sensory stimuli.
Stuart P. Wilson, James A. Bednar, Tony J. Prescott, Benjamin Mitchinson
PLoS Comput. Biol.3
2010 Learning in a Unitary Coherent Hippocampus
Charles W. Fox, Tony J. Prescott
ICANN (1)2
2010 Hippocampus as unitary coherent particle filter
abstract
We present a mapping of the hippocampal formation onto a Temporal Restricted Boltzmann Machine [1] based architecture, running a deterministic version of Gibbs sampling, and extended with a lostness detection and recovery circuit modelled on subiculum and septal acetylcholine (ACh). The mapping approximates Bayesian filtering, which infers both auto-associative de-noised percepts and temporal sequences, the latter including sequences of places during navigation. Inference may be viewed as a neurally implemented particle filter with a single particle-as suggested previously [2] as a purely behavioural animal model.
Charles W. Fox, Tony J. Prescott
IJCNN2
2010 Naive Bayes texture classification applied to whisker data from a moving robot
abstract
Many rodents use their whiskers to distinguish objects by surface texture. To examine possible mechanisms for this discrimination, data from an artificial whisker attached to a moving robot was used to test texture classification algorithms. This data was examined previously using a template-based classifier of the whisker vibration power spectrum. Motivated by a proposal about the neural computations underlying sensory decision making, we classified the raw whisker signal using the related `naive Bayes' method. The integration time window is important, with roughly 100ms of data required for good decisions and 500ms for the best decisions. For stereotyped motion, the classifier achieved hit rates of about 80% using a single (horizontal or vertical) stream of vibration data and 90% using both streams. Similar hit rates were achieved on natural data, apart from a single case in which the performance was only about 55%. Therefore this application of naive Bayes represents a biologically motivated algorithm that can perform well in a real-world robot task.
Nathan F. Lepora, Mathew H. Evans, Charles W. Fox, Mathew E. Diamond, Kevin N. Gurney, Tony J. Prescott
IJCNN6
2010 BRAHMS: Novel middleware for integrated systems computation
Benjamin Mitchinson, Tak-Shing Chan, Jonathan M. Chambers, Martin J. Pearson, Mark D. Humphries, Charles W. Fox, Kevin N. Gurney, Tony J. Prescott
Adv. Eng. Informatics8
2010 Adaptive Cancelation of Self-Generated Sensory Signals in a Whisking Robot
abstract
Sensory signals are often caused by one's own active movements. This raises a problem of discriminating between self-generated sensory signals and signals generated by the external world. Such discrimination is of general importance for robotic systems, where operational robustness is dependent on the correct interpretation of sensory signals. Here, we investigate this problem in the context of a whiskered robot. The whisker sensory signal comprises two components: one due to contact with an object (externally generated) and another due to active movement of the whisker (self-generated). We propose a solution to this discrimination problem based on adaptive noise cancelation, where the robot learns to predict the sensory consequences of its own movements using an adaptive filter. The filter inputs (copy of motor commands) are transformed by Laguerre functions instead of the often-used tapped-delay line, which reduces model order and, therefore, computational complexity. Results from a contact-detection task demonstrate that false positives are significantly reduced using the proposed scheme.
Sean R. Anderson, Martin J. Pearson, Anthony G. Pipe, Tony J. Prescott, Paul Dean, John Porrill
IEEE Trans. Robotics4
2009 Hippocampus, Amygdala and Basal Ganglia Based Navigation Control
Ansgar R. Koene, Tony J. Prescott
ICANN (1)2
2006 A Biologically Inspired FPGA Based Implementation of a Tactile Sensory System for Object Recognition and Texture Discrimination
abstract
Both a FPGA implementation of a rodent's tactile sensory system and a neural FPGA based hardware processor, mimicking the brainstem behaviour are presented. They have principally been designed using biological considerations. The two systems are being ported on a single FPGA platform and will ultimately be embedded on a mobile robot, which will operate in real world environments for object recognition and surface textural discrimination purposes
Martin J. Pearson, Mokhtar Nibouche, Anthony G. Pipe, Chris Melhuish, Ian Gilhespy, Benjamin Mitchinson, Kevin N. Gurney, Tony J. Prescott, Peter Redgrave
FPL8
2006 A robot model of the basal ganglia: Behavior and intrinsic processing
Tony J. Prescott, Fernando Montes-González, Kevin N. Gurney, Mark D. Humphries, Peter Redgrave
Neural Networks1
2003 The Interaction of Recurrent Axon Collateral Networks in the Basal Ganglia
Mark D. Humphries, Tony J. Prescott, Kevin N. Gurney
ICANN2
1997 A Robot Trace-Maker: Modelling the Fossil Evidence of Early Invertebrate Behavior
abstract
The study of trace fossils, the fossilized remains of animal behavior, reveals interesting parallels with recent research in behavior-based robotics. This article reports robot simulations of the meandering foraging trails left by early invertebrates that demonstrate that such trails can be generated by mechanisms similar to those used for robot wall-following. We conclude with the suggestion that the capacity for intelligent behavior shown by many behavior-based robots is similar to that of animals of the late Precambrian and early Cambrian periods approximately 530 to 565 million years ago.
Tony J. Prescott, Carl Ibbotson
Artif. Life1
1991 Obstacle Avoidance through Reinforcement Learning
Tony J. Prescott, John E. W. Mayhew
NIPS1