Body weight, as an essential physiological trait, is of considerable significance in many applications like body management, rehabilitation, and drug dosing for patient-specific treatments. Previous works on the body weight estimation task are mainly vision-based, using 2D/3D, depth, or infrared images, facing problems in illumination, occlusions, and especially privacy issues. The pressure mapping mattress is a non-invasive and privacy-preserving tool to obtain the pressure distribution image over the bed surface, which strongly correlates with the body weight of the lying person. To extract the body weight from this image, we propose a deep learning-based model, including a dual-branch network to extract the deep features and pose features respectively. A contrastive learning module is also combined to the deep-feature branch to help mine the mutual factors across different postures of every single subject. The two groups of features are then concatenated for the body weight regression task. To test the model's performance over different hardware and posture settings, we create a pressure image dataset of 10 subjects and 23 postures, using a self-made pressure-sensing bedsheet. This dataset, which is made public together with this paper, together with a public dataset, are used for the validation. The results show that our model outperforms the state-of-the-art algorithms over both 2 datasets. Our research constitutes an important step toward fully automatic weight estimation in both clinical and at-home practice. Our dataset is available for research purposes at: https://github.com/USTCWzy/MassEstimation.

The lack of efficient and intuitive programming paradigms for industrial manipulators stands in the way of increasing the degree of automation in various industrial manufacturing environments. We approach this lack by exploring tactile surface sensors (TSS) enclosing the links of a manipulator as a gesture input device for intuitive robot programming. First, our low-cost tactile surface sensor is briefly presented. Subsequently, a preliminary gesture set is introduced and feature-based approaches for gesture recognition are addressed. Furthermore, the extraction of relevant parameters from the gestures as well as the integration of gesture input into our skill-based robot control architecture are outlined. Quantitative performance results based on a user study with 12 subjects and a set of 7 gestures show that even with a comparatively low spatial resolution of the sensor (20mm) average accuracies of over 90% can be obtained.

We present a wearable textile sensor system for monitoring muscle activity, leveraging surface pressure changes between the skin and an elastic sport support band. The sensor is based on an 8×16 element fabric resistive pressure sensing matrix of 1cm spatial resolution, which can be read out with 50fps refresh rate. We evaluate the system by monitoring leg muscles during leg workouts in a gym out of the lab. The sensor covers the lower part of quadriceps of the user. The shape and movement of the two major muscles (vastus lateralis and medialis) are visible from the data during various exercises. The system registers the activity of the user for every second, including which machine he/she is using, walking, relaxing and adjusting the machines; it also counts the repetitions from each set and evaluate the force consistency which is related to the workout quality. 6 people participated in the experiment of overall 24 leg workout sessions. Each session includes cross-trainer warm-up and cool-down, 3 different leg machines, 4 sets on each machine. Plus relaxing, adjusting machines, and walking, we perform activity recognition and quality evaluation through 2-dimensional mapping and the time sequence of the average force. We have reached 81.7% average recognition accuracy on a 2s sliding window basis, 93.3% on an event basis, and 85.6% spotting F1-score. We further demonstrate how to evaluate the workout quality through counting, force pattern variation and consistency.

We present a novel sensor system for the support of nutrition monitoring. The system is based on smart table cloth equipped with a fine grained pressure textile matrix and a weight sensitive tablet. Unlike many other nutrition monitoring approaches, our system is unobtrusive, non privacy invasive and easily deployable in every day life. It allows the spotting and recognition of food intake related actions, such as cutting, scooping, stirring, etc., the identification of the plate/container on which the action is executed, and the tracking of the weight change in the containers. In other words, we can determine how many pieces are cut on the main dish plate, how many are taken from the side dish, how many sips are taken from the drink, how fast the food is being consumed and how much weight is taken overall. In addition, the distinction between different eating actions, such as cutting, scooping, poking, provides clues to the type of food taken and the way the meal is consumed. We have evaluated our system on 40 meals (5 subjects) in a real life living environment: for seven eating related actions (cutting, scooping, stirring, etc.), resulting in above 90% average recognition rate for person dependent cases, and spotting each action out of continuous data streams (average F1 score 87%).

There is a large class of routine physical exercises that are performed on the ground, often on dedicated "mats" (e.g. push-ups, crunches, bridge). Such exercises involve coordinated motions of different body parts and are difficult to recognize with a single body worn motion sensors (like a step counter). Instead a network of sensors on different body parts would be needed, which is not always practicable. As an alternative we describe a cheap, simple textile pressure sensor matrix, that can be unobtrusively integrated into exercise mats to recognize and count such exercises. We evaluate the system on a set of 10 standard exercises. In an experiment with 7 subjects, each repeating each exercise 20 times, we achieve a user independent recognition rate of 82.5% and a user independent counting accuracy of 89.9%. The paper describes the sensor system, the recognition methods and the experimental results.

We demonstrate through a pressure sensor matrix, that weight distribution on feet is influenced by body posture. A small cheap carpet equipped with low precision pressure sensor matrix is already sufficient to detect subtle activities and identity of the person on the carpet. By a 0.4 m2 matrix of 32 × 32, 12 bit pressure sensors, we achieve 78.7% accuracy for 11 test subjects performing 7 subtle activities (open 7 different drawers or cabinet doors) and 88.6% accuracy in recognizing who has performed the activities. We thus see the potential of using a single carpet as a unified approach in houses to detect how inhabitants interact with the furniture without attaching different sensors onto each single furniture.

In this paper we use ubiquitous smart-chairs to evaluate live presentations. We validate the hypothesis that the audiences' activities can be recognized with pressure sensors under chairs' legs (74.6% accuracy rate from 8 typical activities in 8 live presentations, each with 6 chairs seated), and ce