Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Jack M. Wang

dblp:67/240 · DBLP profile ↗
← Back
10ranked-venue papers
7as first author
0since 2021 · last 2013
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Graphics, computer vision, multimedia, augmented reality and games · 6 · 3 first-authorArtificial intelligence and machine learning · 4 · 4 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer graphics and multimedia
6 papers
Computer animation and physical simulation · 100%
Artificial intelligence
4 papers
Probabilistic and Bayesian machine learning · 78% Motion planning and robot control · 16% Video understanding and tracking · 4%

Topics — the 10 heaviest of 11, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computer animation and physical simulation
character animation
0.542012
Optimizing locomotion controllers using biologically-based actuators and objectives · ACM Trans. Graph. 2012
Continuous character control with low-dimensional embeddings · ACM Trans. Graph. 2012
Optimizing walking controllers for uncertain inputs and environments · ACM Trans. Graph. 2010
Machine learning › Probabilistic and Bayesian machine learning › stochastic processes
gaussian process
0.232008
Gaussian Process Dynamical Models for Human Motion · IEEE Trans. Pattern Anal. Mach. Intell. 2008
Multifactor Gaussian process models for style-content separation · ICML 2007
Gaussian Process Dynamical Models · NIPS 2005
Machine learning › Probabilistic and Bayesian machine learning › structured models
latent variable model
0.232008
Gaussian Process Dynamical Models for Human Motion · IEEE Trans. Pattern Anal. Mach. Intell. 2008
Multifactor Gaussian process models for style-content separation · ICML 2007
Gaussian Process Dynamical Models · NIPS 2005
Computer animation and physical simulation
motion synthesis
0.212013
Animating human lower limbs using contact-invariant optimization · ACM Trans. Graph. 2013
Machine learning › Probabilistic and Bayesian machine learning › stochastic processes › gaussian process
gaussian process dynamical model
0.112008
Gaussian Process Dynamical Models for Human Motion · IEEE Trans. Pattern Anal. Mach. Intell. 2008
Computer animation and physical simulation › motion synthesis
human motion synthesis
0.112007
Multifactor Gaussian process models for style-content separation · ICML 2007
Robotics › Motion planning and robot control
dynamic modeling
0.112005
Gaussian Process Dynamical Models · NIPS 2005
Robotics › Motion planning and robot control
trajectory optimization
0.012013
Animating human lower limbs using contact-invariant optimization · ACM Trans. Graph. 2013
Computer vision › Video understanding and tracking › motion analysis
human motion analysis
0.012008
Gaussian Process Dynamical Models for Human Motion · IEEE Trans. Pattern Anal. Mach. Intell. 2008
Computer vision › 3D vision › motion capture
human motion capture
0.012005
Gaussian Process Dynamical Models · NIPS 2005

Methods — techniques the papers use, named apart from their topics

musculotendon actuation · 0.3spacetime constraints · 0.2space-time constraint · 0.2probabilistic motion models · 0.1metabolic energy minimization · 0.1hill-type musculotendon model · 0.1control policy precomputation · 0.1gaussian process · 0.1stochastic optimization · 0.1monte carlo estimation · 0.1objective function optimization · 0.1SIMBICON · 0.1latent variable model · 0.1dimensionality reduction · 0.1multilinear model · 0.1gaussian process latent variable model · 0.1marginalization · 0.1
YearPublicationVenuePosition
2013 Animating human lower limbs using contact-invariant optimization
abstract
We present a trajectory optimization approach to animating human activities that are driven by the lower body. Our approach is based on contact-invariant optimization. We develop a simplified and generalized formulation of contact-invariant optimization that enables continuous optimization over contact timings. This formulation is applied to a fully physical humanoid model whose lower limbs are actuated by musculotendon units. Our approach does not rely on prior motion data or on task-specific controllers. Motion is synthesized from first principles, given only a detailed physical model of the body and spacetime constraints. We demonstrate the approach on a variety of activities, such as walking, running, jumping, and kicking. Our approach produces walking motions that quantitatively match ground-truth data, and predicts aspects of human gait initiation, incline walking, and locomotion in reduced gravity.
Igor Mordatch, Jack M. Wang, Emanuel Todorov, Vladlen Koltun
ACM Trans. Graph.2
2012 Continuous character control with low-dimensional embeddings
abstract
Interactive, task-guided character controllers must be agile and responsive to user input, while retaining the flexibility to be readily authored and modified by the designer. Central to a method's ease of use is its capacity to synthesize character motion for novel situations without requiring excessive data or programming effort. In this work, we present a technique that animates characters performing user-specified tasks by using a probabilistic motion model, which is trained on a small number of artist-provided animation clips. The method uses a low-dimensional space learned from the example motions to continuously control the character's pose to accomplish the desired task. By controlling the character through a reduced space, our method can discover new transitions, tractably precompute a control policy, and avoid low quality poses.
Sergey Levine, Jack M. Wang, Alexis Haraux, Zoran Popovic, Vladlen Koltun
ACM Trans. Graph.2
2012 Optimizing locomotion controllers using biologically-based actuators and objectives
abstract
We present a technique for automatically synthesizing walking and running controllers for physically-simulated 3D humanoid characters. The sagittal hip, knee, and ankle degrees-of-freedom are actuated using a set of eight Hill-type musculotendon models in each leg, with biologically-motivated control laws. The parameters of these control laws are set by an optimization procedure that satisfies a number of locomotion task terms while minimizing a biological model of metabolic energy expenditure. We show that the use of biologically-based actuators and objectives measurably increases the realism of gaits generated by locomotion controllers that operate without the use of motion capture data, and that metabolic energy expenditure provides a simple and unifying measurement of effort that can be used for both walking and running control optimization.
Jack M. Wang, Samuel R. Hamner, Scott L. Delp, Vladlen Koltun
ACM Trans. Graph.1
2010 Optimizing walking controllers for uncertain inputs and environments
abstract
We introduce methods for optimizing physics-based walking controllers for robustness to uncertainty. Many unknown factors, such as external forces, control torques, and user control inputs, cannot be known in advance and must be treated as uncertain. These variables are represented with probability distributions, and a return function scores the desirability of a single motion. Controller optimization entails maximizing the expected value of the return, which is computed by Monte Carlo methods. We demonstrate examples with different sources of uncertainty and task constraints. Optimizing control strategies under uncertainty increases robustness and produces natural variations in style.
Jack M. Wang, David J. Fleet, Aaron Hertzmann
ACM Trans. Graph.1
2009 Optimizing walking controllers
abstract
This paper describes a method for optimizing the parameters of a physics-based controller for full-body, 3D walking. A modified version of the SIMBICON controller [Yin et al. 2007] is optimized for characters of varying body shape, walking speed and step length. The objective function includes terms for power minimization, angular momentum minimization, and minimal head motion, among others. Together these terms produce a number of important features of natural walking, including active toe-off, near-passive knee swing, and leg extension during swing. We explain the specific form of our objective criteria, and show the importance of each term to walking style. We demonstrate optimized controllers for walking with different speeds, variation in body shape, and in ground slope.
Jack M. Wang, David J. Fleet, Aaron Hertzmann
ACM Trans. Graph.1
2008 Gaussian Process Dynamical Models for Human Motion
abstract
We introduce Gaussian process dynamical models (GPDM) for nonlinear time series analysis, with applications to learning models of human pose and motion from high-dimensionalmotion capture data. A GPDM is a latent variable model. It comprises a low-dimensional latent space with associated dynamics, and a map from the latent space to an observation space. We marginalize out the model parameters in closed-form, using Gaussian process priors for both the dynamics and the observation mappings. This results in a non-parametric model for dynamical systems that accounts for uncertainty in the model. We demonstrate the approach, and compare four learning algorithms on human motion capture data in which each pose is 50-dimensional. Despite the use of small data sets, the GPDM learns an effective representation of the nonlinear dynamics in these spaces.
Jack M. Wang, David J. Fleet, Aaron Hertzmann
IEEE Trans. Pattern Anal. Mach. Intell.1
2008 Correction to "Gaussian Process Dynamical Models for Human Motion"
abstract
In the above titled paper (ibid., vol. 30, no. 2, pp. 283-298, Feb 08), two figures were misprinted. The correct figures are presented here.
Jack M. Wang, David J. Fleet, Aaron Hertzmann
IEEE Trans. Pattern Anal. Mach. Intell.1
2007 Multifactor Gaussian process models for style-content separation
abstract
We introduce models for density estimation with multiple, hidden, continuous factors. In particular, we propose a generalization of multilinear models using nonlinear basis functions. By marginalizing over the weights, we obtain a multifactor form of the Gaussian process latent variable model. In this model, each factor is kernelized independently, allowing nonlinear mappings from any particular factor to the data. We learn models for human locomotion data, in which each pose is generated by factors representing the person's identity, gait, and the current state of motion. We demonstrate our approach using time-series prediction, and by synthesizing novel animation from the model.
Jack M. Wang, David J. Fleet, Aaron Hertzmann
ICML1
2006 Segmentation-Based 3D Artistic Rendering
Alexander Kolliopoulos, Jack M. Wang, Aaron Hertzmann
Rendering Techniques2
2005 Gaussian Process Dynamical Models
abstract
This paper introduces Gaussian Process Dynamical Models (GPDM) for nonlinear time series analysis. A GPDM comprises a low-dimensional latent space with associated dynamics, and a map from the latent space to an observation space. We marginalize out the model parameters in closed-form, using Gaussian Process (GP) priors for both the dynamics and the observation mappings. This results in a nonparametric model for dynamical systems that accounts for uncertainty in the model. We demonstrate the approach on human motion capture data in which each pose is 62-dimensional. Despite the use of small data sets, the GPDM learns an effective representation of the nonlinear dynamics in these spaces. Webpage: http://www.dgp.toronto.edu/
Jack M. Wang, David J. Fleet, Aaron Hertzmann
NIPS1