Fennekin

Review for "Multi-Head Latent Control: A Unified Interface for LLM Agent Decision Making"

Summary
This paper introduces a novel approach to enabling LLM agents to make deployment-time decisions without modifying the model backbone. The method uses two lightweight heads—Capability and Resolution—to infer control signals from hidden-state trajectories, allowing models to decide whether to proceed, defer, request clarification, or use tools. The approach shows strong empirical performance across multiple benchmarks, significantly reducing reliance on large models while maintaining high accuracy.

Mathematical/empirical assessment
The paper presents a well-structured framework with clear definitions of the Capability and Resolution Heads. The experimental results are thorough, showing consistent improvements in both quality-cost tradeoffs and resolution decision-making. The use of latent-state traces for control decisions is promising, and the ablation studies provide useful insights into the design choices. However, the theoretical justification for why latent states contain sufficient information for these decisions is somewhat limited.

Strengths
- The method is lightweight and post hoc, making it easy to adapt to new backbones without retraining.
- The empirical results are strong, with significant reductions in large-model usage across multiple benchmarks.
- The paper includes detailed ablation studies and analysis of different model configurations.
- The approach is generalizable across language and vision-language tasks.

Concerns
- The paper does not provide a formal theoretical analysis of why latent-state trajectories are sufficient for control decisions, which could strengthen the argument.
- Some of the claims about the broader applicability of the method could be more clearly tied to the specific experiments conducted.
- While the paper discusses limitations in the appendix, a more explicit discussion in the main text would be helpful.

Final decision
Weak accept

The paper presents a valuable and practical contribution to the field of LLM agent decision-making. While the empirical results are strong and the approach is well-motivated, some aspects of the theoretical foundation and broader implications could be more clearly articulated. With minor refinements, this work has the potential to make a meaningful impact.

Summary:
This paper introduces MotionForesight, a method for predicting future 3D trajectories of points on manipulated objects from short monocular video contexts. The approach leverages pretrained video models and adapts them to forecast 3D motion by masking future frames and training a lightweight adapter. It achieves strong performance on diverse out-of-distribution scenarios using only 40k human videos, without auxiliary inputs like language.

Mathematical/empirical assessment:
The paper presents a clear formulation of the problem as reference-anchored 3D track forecasting. The loss equation (Eq. (3)) is well-defined, with separate weights for observed and future predictions. Empirical results show that MotionForesight outperforms larger models and methods with additional supervision, particularly in terms of ADE, FDE, and PWT metrics. The motion-conditional diagnostics (TVO, VVO, DQS) provide deeper insights into the quality of predicted dynamics.

Strengths:
- Novel and practical approach to 3D motion forecasting from monocular videos.
- Efficient use of pretrained video models without requiring large-scale labeled data.
- Strong empirical results across diverse scenarios, including out-of-distribution generalization.
- Clear ablation studies and analysis of scaling with more data.

Concerns:
- The paper does not address the limitations of monocular depth estimation or how errors in pseudo-ground-truth tracks affect performance.
- The model's deterministic nature may limit its ability to capture multimodal future outcomes.
- The evaluation focuses on single-trajectory metrics, which may not fully reflect the quality of physically plausible alternatives.

Final decision: Weak accept