James Foster

dblp:94/4949 · DBLP profile ↗
← Back
8ranked-venue papers
1as first author
5since 2021 · last 2024
—ORCID · unresolved

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 7 · 1 first-author · 5 since 2021Systems, architecture and hardware · 2 · 1 first-author · 2 since 2021Applied, interdisciplinary, general and emerging computing · 1

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
5 papers
Deep learning architectures and training · 38% Generative modeling · 22% Legged, aerial and field robots · 16%

Topics — the 13 heaviest of 14, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Deep learning architectures and training
neural differential equations
1.432021
Efficient and Accurate Gradients for Neural SDEs · NeurIPS 2021
Neural Rough Differential Equations for Long Time Series · ICML 2021
Neural Controlled Differential Equations for Irregular Time Series · NeurIPS 2020
Machine learning › Generative modeling
generative adversarial network
1.022021
Efficient and Accurate Gradients for Neural SDEs · NeurIPS 2021
Neural SDEs as Infinite-Dimensional GANs · ICML 2021
Robotics › Legged, aerial and field robots › bipedal robot
bipedal walking control
0.812024
Efficient, Dynamic Locomotion through Step Placement with Straight Legs and Rolling Contacts · ICRA 2024
Robotics › Legged, aerial and field robots › legged robots
legged robot locomotion
0.812024
Efficient, Dynamic Locomotion through Step Placement with Straight Legs and Rolling Contacts · ICRA 2024
Robotics › Motion planning and robot control
robot control
0.812024
Efficient, Dynamic Locomotion through Step Placement with Straight Legs and Rolling Contacts · ICRA 2024
Machine learning › Deep learning architectures and training › neural differential equations
neural controlled differential equations
0.622021
Neural Controlled Differential Equations for Irregular Time Series · NeurIPS 2020
Neural SDEs as Infinite-Dimensional GANs · ICML 2021
Machine learning › Deep learning architectures and training
gradient computation
0.512021
Efficient and Accurate Gradients for Neural SDEs · NeurIPS 2021
Machine learning › Probabilistic and Bayesian machine learning › continuous-time model › stochastic differential equations
neural SDE
0.512021
Efficient and Accurate Gradients for Neural SDEs · NeurIPS 2021
Machine learning › Deep learning architectures and training › neural differential equations
neural stochastic differential equations
0.512021
Neural SDEs as Infinite-Dimensional GANs · ICML 2021
Machine learning › Time series and sequential data
time series modeling
0.512021
Neural Rough Differential Equations for Long Time Series · ICML 2021
Machine learning › Generative modeling › generative adversarial network
Wasserstein GAN
0.512021
Neural SDEs as Infinite-Dimensional GANs · ICML 2021
Machine learning › Deep learning architectures and training › neural differential equations
controlled differential equation
0.412020
Neural Controlled Differential Equations for Irregular Time Series · NeurIPS 2020
Computer vision › Video understanding and tracking › temporal modeling
temporal dynamics modeling
0.412020
Neural Controlled Differential Equations for Irregular Time Series · NeurIPS 2020

Methods — techniques the papers use, named apart from their topics

adjoint backpropagation · 0.9stance leg length control · 0.8rolling contact · 0.8ALIP-based step adjustment · 0.8stochastic differential equation · 0.5rough path theory · 0.5numerical solvers · 0.5neural CDE · 0.5log-signature · 0.5brownian interval · 0.5
YearPublicationVenuePosition
2024 Efficient, Dynamic Locomotion through Step Placement with Straight Legs and Rolling Contacts
abstract
For humans, fast, efficient walking over flat ground represents the vast majority of locomotion that an individual experiences on a daily basis, and for an effective, real-world humanoid robot the same will likely be the case. In this work, we propose a locomotion controller for efficient walking over near-flat ground using a relatively simple, model-based controller that utilizes a novel combination of several interesting design features including an ALIP-based step adjustment strategy, stance leg length control as an alternative to center of mass height control, and rolling contact for heel-to-toe motion of the stance foot. We then present the results of this controller on our robot Nadia, both in simulation and on hardware. These results include validation of this controller’s ability to perform fast, reliable forward walking at 0.75 m/s along with backwards walking, side-stepping, turning in place, and push recovery. We also present an efficiency comparison between the proposed control strategy and our baseline walking controller over three steady-state walking speeds. Lastly, we demonstrate some of the benefits of utilizing rolling contact in the stance foot, specifically the reduction of necessary positive and negative work throughout the stride.
Stefan Fasano, James Foster, Sylvain Bertrand, Christian DeBuys, Robert J. Griffin
ICRA2
2024 Physically Consistent Online Inertial Adaptation for Humanoid Loco-manipulation
abstract
The ability to accomplish manipulation and locomotion tasks in the presence of significant time-varying external loads is a remarkable skill of humans that has yet to be replicated convincingly by humanoid robots. Such an ability will be a key requirement in the environments we envision deploying our robots: dull, dirty, and dangerous. External loads constitute a large model bias, which is typically unaccounted for. In this work, we enable our humanoid robot to engage in loco-manipulation tasks in the presence of significant model bias due to external loads. We propose an online estimation and control framework involving the combination of a physically consistent extended Kalman filter for inertial parameter estimation coupled to a whole-body controller. We showcase our results both in simulation and in hardware, where weights are mounted on Nadia’s wrist links as a proxy for engaging in tasks where large external loads are applied to the robot.
James Foster, Stephen McCrory, Christian DeBuys, Sylvain Bertrand, Robert J. Griffin
IROS1
2021 Neural SDEs as Infinite-Dimensional GANs
abstract
Stochastic differential equations (SDEs) are a staple of mathematical modelling of temporal dynamics. However, a fundamental limitation has been that such models have typically been relatively inflexible, which recent work introducing Neural SDEs has sought to solve. Here, we show that the current classical approach to fitting SDEs may be approached as a special case of (Wasserstein) GANs, and in doing so the neural and classical regimes may be brought together. The input noise is Brownian motion, the output samples are time-evolving paths produced by a numerical solver, and by parameterising a discriminator as a Neural Controlled Differential Equation (CDE), we obtain Neural SDEs as (in modern machine learning parlance) continuous-time generative time series models. Unlike previous work on this problem, this is a direct extension of the classical approach without reference to either prespecified statistics or density functions. Arbitrary drift and diffusions are admissible, so as the Wasserstein loss has a unique global minima, in the infinite data limit \textit{any} SDE may be learnt.
Patrick Kidger, James Foster, Terry J. Lyons
ICML2
2021 Neural Rough Differential Equations for Long Time Series
abstract
Neural controlled differential equations (CDEs) are the continuous-time analogue of recurrent neural networks, as Neural ODEs are to residual networks, and offer a memory-efficient continuous-time way to model functions of potentially irregular time series. Existing methods for computing the forward pass of a Neural CDE involve embedding the incoming time series into path space, often via interpolation, and using evaluations of this path to drive the hidden state. Here, we use rough path theory to extend this formulation. Instead of directly embedding into path space, we instead represent the input signal over small time intervals through its \textit{log-signature}, which are statistics describing how the signal drives a CDE. This is the approach for solving \textit{rough differential equations} (RDEs), and correspondingly we describe our main contribution as the introduction of Neural RDEs. This extension has a purpose: by generalising the Neural CDE approach to a broader class of driving signals, we demonstrate particular advantages for tackling long time series. In this regime, we demonstrate efficacy on problems of length up to 17k observations and observe significant training speed-ups, improvements in model performance, and reduced memory requirements compared to existing approaches.
James Morrill, Cristopher Salvi, Patrick Kidger, James Foster
ICML4
2021 Efficient and Accurate Gradients for Neural SDEs
abstract
Neural SDEs combine many of the best qualities of both RNNs and SDEs, and as such are a natural choice for modelling many types of temporal dynamics. They offer memory efficiency, high-capacity function approximation, and strong priors on model space. Neural SDEs may be trained as VAEs or as GANs; in either case it is necessary to backpropagate through the SDE solve. In particular this may be done by constructing a backwards-in-time SDE whose solution is the desired parameter gradients. However, this has previously suffered from severe speed and accuracy issues, due to high computational complexity, numerical errors in the SDE solve, and the cost of reconstructing Brownian motion. Here, we make several technical innovations to overcome these issues. First, we introduce the \textit{reversible Heun method}: a new SDE solver that is algebraically reversible -- which reduces numerical gradient errors to almost zero, improving several test metrics by substantial margins over state-of-the-art. Moreover it requires half as many function evaluations as comparable solvers, giving up to a $1.98\times$ speedup. Next, we introduce the \textit{Brownian interval}. This is a new and computationally efficient way of exactly sampling \textit{and reconstructing} Brownian motion; this is in contrast to previous reconstruction techniques that are both approximate and relatively slow. This gives up to a $10.6\times$ speed improvement over previous techniques. After that, when specifically training Neural SDEs as GANs (Kidger et al. 2021), we demonstrate how SDE-GANs may be trained through careful weight clipping and choice of activation function. This reduces computational cost (giving up to a $1.87\times$ speedup), and removes the truncation errors of the double adjoint required for gradient penalty, substantially improving several test metrics. Altogether these techniques offer substantial improvements over the state-of-the-art, with respect to both training speed and with respect to classification, prediction, and MMD test metrics. We have contributed implementations of all of our techniques to the \texttt{torchsde} library to help facilitate their adoption.
Patrick Kidger, James Foster, Terry J. Lyons
NeurIPS2
2020 Tids Detection from Ship-Based GNSS Receiver: First Test on 2010 Maule Tsunami
abstract
The VARION (Variometric Approach for Real-Time Ionosphere Observation) algorithm has been successfully applied several times to TIDs (Travelling ionospheric disturbances) detection in a real-time scenario. VARION is, thus, able to estimate sTEC variations in real time and it can be applied on ship-based GNSS receiver since it is based on geometry free combination: the receiver motion does not affect the sTEC estimation process. This work is a feasibility study on the possibility to use data from ship-based GNSS receiver to detect TIDs. In particular, data of the February 27, 2010, MW8.8 Chilean (Maule) earthquake and tsunami were analysed. The preliminary results show that the same TIDs are detected both from the sea (ships) and land. In conclusion, ship-based GNSS receivers could represent a real-time and cost-effective tool to enhance tsunami early warning systems, without requiring the installation of complex infrastructures in open sea.
Michela Ravanelli, Mattia Crespi, James Foster
IGARSS3
2020 Neural Controlled Differential Equations for Irregular Time Series
abstract
Neural ordinary differential equations are an attractive option for modelling temporal dynamics. However, a fundamental issue is that the solution to an ordinary differential equation is determined by its initial condition, and there is no mechanism for adjusting the trajectory based on subsequent observations. Here, we demonstrate how this may be resolved through the well-understood mathematics of \emph{controlled differential equations}. The resulting \emph{neural controlled differential equation} model is directly applicable to the general setting of partially-observed irregularly-sampled multivariate time series, and (unlike previous work on this problem) it may utilise memory-efficient adjoint-based backpropagation even across observations. We demonstrate that our model achieves state-of-the-art performance against similar (ODE or RNN based) models in empirical studies on a range of datasets. Finally we provide theoretical results demonstrating universal approximation, and that our model subsumes alternative ODE models.
Patrick Kidger, James Morrill, James Foster, Terry J. Lyons
NeurIPS3
2007 Crossover Bias in Genetic Programming
Maarten Keijzer, James Foster
EuroGP2