ICLR 2027 Submission

NeCR

Neural Contact-Consistent Retargeting for Whole-Body Humanoid Tracking

Under review as a conference paper at ICLR 2027

Abstract

Human-to-humanoid motion retargeting converts human motion into reference trajectories for humanoid control. Learning-based methods transfer motion semantics efficiently but enforce nothing at inference, while optimization-based methods enforce constraints but can settle on a pose that breaks the supporting contact. What is missing is the signal that tells the optimizer where correction is needed, over which intervals, and with what confidence. We present NeCR, a hybrid neural-optimization framework for contact-consistent motion retargeting. NeCR first predicts a semantically faithful nominal robot trajectory. A surface-conditioned temporal model then predicts continuous whole-body contact modes. Conditioned on them, correction reduces to a sparse, block-banded proximal projection that adjusts only support-relevant degrees of freedom. On public datasets retargeted to a Unitree G1, physical correction becomes nearly free: penetration is nearly eliminated and support-phase sliding falls from 20.6% to 4.4% at a cost of 0.16 cm MPKPE, and NeCR runs at 5.9 ms per frame end to end, over five times faster than real time at 30 Hz. The resulting references are also more trackable, improving policy success across two independently implemented trackers and under cross-reference evaluation. A proprioceptive policy trained on them transfers zero-shot to a real Unitree G1 on whole-body-contact motions such as crawling and fall recovery. Code, retargeted datasets, and trained policies will be released.

NeCR pipeline: motion prior, unified contact network, and contact-guided optimizationHover or tap to flip

Real-to-sim pairs

Whole-Body Contact Tracking

Each row pairs a real Unitree G1 deployment with its corresponding simulation result for direct comparison.

Mohak sequence

Real robot

Mohak sequence

Simulation

Fall and get-up

Real robot

Fall and get-up

Simulation

Self comparison

From Nominal Retargeting to Contact-Consistent Motion

Each clip compares the human reference, the nominal robot motion from the initial retargeting network (blue), and the complete NeCR result (black-and-white solid robot).

Lying on Side

Side view

Lying on Stomach

Side view

Backward Crawl

Side view

Backward Mohak

Looped sequence · side view

Forward Jog

Side view

Stand to Kneeling

Front view

Qualitative comparison

Retargeting Across Diverse Motions

Each synchronized video compares the human reference with GMR, OmniRetarget, NMR, and NeCR on the same motion.

Motion 01

Cartwheel

Fast acrobatic motion with large whole-body rotation.

Human · GMR · OmniRetarget · NMR · NeCR
Motion 02

Cross-Leg Motion

A compact pose sequence with challenging lower-body articulation.

Human · GMR · OmniRetarget · NMR · NeCR
Motion 03

Dance

Rhythmic whole-body motion with coordinated arms and legs.

Human · GMR · OmniRetarget · NMR · NeCR
Motion 04

Fall

Rapid transition from standing to body-ground contact.

Human · GMR · OmniRetarget · NMR · NeCR
Motion 05

Forward Jump

Dynamic forward motion with takeoff, flight, and landing.

Human · GMR · OmniRetarget · NMR · NeCR
Motion 06

Jump

Vertical whole-body dynamics and coordinated landing.

Human · GMR · OmniRetarget · NMR · NeCR
Motion 07

Mohak Idle

Expressive upper-body motion around a stable support pose.

Human · GMR · OmniRetarget · NMR · NeCR
Motion 08

Sit on Heels

Deep-knee motion with a low center of mass.

Human · GMR · OmniRetarget · NMR · NeCR
Motion 09

Stretching

Large-range articulated motion across the full body.

Human · GMR · OmniRetarget · NMR · NeCR
Motion 10

Walk

Steady locomotion with repeated support transitions.

Human · GMR · OmniRetarget · NMR · NeCR
Motion 11

Run and Fall

A fast locomotion sequence followed by a dynamic fall.

Human · GMR · OmniRetarget · NMR · NeCR
Motion 12

Crawl

Whole-body locomotion with sustained hand and knee contacts.

Human · GMR · OmniRetarget · NMR · NeCR

Interactive demo

Explore LAFAN motions in 3D

Compare each human reference with the synchronized NeCR retargeting result across the first 1,600 frames.

LAFAN1 RETARGETING

Select a motion sequence

Dance 1 · dance1_subject1

Drag to orbit · Scroll to zoom
Loading synchronized motion…
0001 / 1600