ECL

PROJECT PAGE

Evidence-Guided Counterfactual Learning
for Long-Tailed Robotic Policies

Anonymous Authors
SIMULATION↗
+29.9%

MiniVLA macro-average improvement

40.8 → 53.0
SIMULATION↗
+17.1%

π0.5 macro-average improvement

40.3 → 47.2
DATA0×
Zero

Additional data or region annotations

Original demonstrations only
DEPLOYMENT0×
Zero

Additional inference computation

Factual policy only
Simulation manipulation demo Simulation manipulation demo Simulation manipulation demo Simulation manipulation demo Simulation manipulation demo Simulation manipulation demo
LONG-TAILED ROBOT LEARNINGECLEvidence-Guided
Counterfactual Learning

No extra processing · No annotations
No replacement · No deployment overhead

Explore demonstrations ↓

OVERVIEW

Why Tail Tasks Fail?

In the practical deployment of vision-language-action policies, handling long-tailed task distributions is a common challenge due to the highly imbalanced composition of robot demonstration datasets. To investigate this issue, we study the head-task action bias in shared robot policies, particularly focusing on its relationship with task-specific visual evidence. Our experimental analysis shows that, when the visual evidence required by a tail task is insufficient, the policy increasingly falls back on action patterns reinforced by data-rich head tasks, resulting in degraded performance on under-represented tasks. Motivated by this observation, we propose Evidence-Guided Counterfactual Learning, a training framework for long-tailed robot policies. Our method identifies decision-relevant visual evidence using instruction-related and action-related signals, and constructs counterfactual observations by removing the selected evidence. The resulting counterfactual predictions are used to strengthen the association among task instructions, visual evidence, and actions, with the supervision adaptively adjusted according to the number of demonstrations available for each task. The proposed framework requires neither additional training data nor region-level annotations and incurs no additional computation during deployment. Extensive experiments across simulated benchmarks, different VLA architectures, and real-world robot platforms demonstrate that our method robustly and consistently improves long-tailed robot policy learning, particularly for tail tasks, while maintaining reliable performance on head tasks.

CORE FINDING

Head-task action bias

When task-specific visual grounding is insufficient, a shared policy increasingly falls back on action patterns reinforced by data-rich head tasks. ECL strengthens the association among instructions, visual evidence, and actions for underrepresented tasks.

01No extra data processingUses the original demonstrations directly
02No manual labelsNo boxes, masks, or region annotations
03No object replacementPreserves the original task semantics
04No external pipelineNo detector or image inpainting model
05No deployment overheadUses only the factual policy at inference

IMPROVEMENTS ACROSS HEAD AND TAIL TASKS

Our Contributions

Simple. Fundamental. Effective.

LIBERO-CORE-LT · MINIVLA

Per-task simulation success rate

LT, APA, and ECL are grouped within each of the ten tasks.

LTAPAECL (Ours)

Success rate (%)

LIBERO-CORE-LT

Simulation demonstrations

APA and ECL rollouts are shown side by side for all ten LIBERO-Core-LT tasks. Switch between MiniVLA and π0.5 to inspect the complete task set.

PIPER & XARM6

Real-world demonstrations

APA and ECL rollouts are shown side by side for all six tasks on each robot platform. PiPER and xArm6 are presented separately, with independent model controls.

ROBOT 01

AGILEX PiPER

Third-person camera rollouts across all six tasks.

ROBOT 02

xArm6

External-camera rollouts across all six tasks.