Cosmos3-Edge-Policy-DROID-Marlin-W8A16

Cosmos3 Edge Policy DROID Marlin W8A16

Base model | Cosmos Lite | Benchmark | Cosmos 3 report

Deprecated / not recommended for new deployments. This checkpoint remains available for reproducibility of earlier experiments. Use Cosmos3-Edge-Policy-DROID-GenW8A8 instead.

This is a historical Cosmos Lite W8A16 artifact for the Edge DROID policy. It is not a recommended new deployment target.

At A Glance

<video controls muted playsinline poster="https://huggingface.co/XXXXyu/Cosmos3-Edge-Policy-DROID-Marlin-W8A16/resolve/main/assets/rollout_demo_poster.png"> <source src="https://huggingface.co/XXXXyu/Cosmos3-Edge-Policy-DROID-Marlin-W8A16/resolve/main/assets/rollout_demo.mp4" type="video/mp4"> </video>

The preview above is a historical RoboLab Banana rollout associated with this artifact.

Model Overview

nvidia/Cosmos3-Edge-Policy-DROID is a 4B Cosmos3 Mixture-of-Transformers policy that predicts DROID robot actions from language, RGB observations, and robot state. Cosmos Lite changes its inference representation and runtime; it does not retrain or distill the policy.

This historical full_w8 artifact uses W8A16 across 336 (0 / 336 W4 / W8). Activations and non-targeted weights remain BF16. The bundle is self-contained and does not require the BF16 source checkpoint at deployment time.

Calibration And Evaluation

No additional policy training is performed. Full W8A16 is calibration-free: packing uses weight statistics only and does not consume rollout or training observations. Closed-loop quality in this card is the historical 50-episode Banana comparison.

Policy Interface

The validated RoboLab client composes three camera views into a 640x540 RGB input and maps it to the model's 736x544 inference bucket. It returns a 32x8 DROID joint-position action chunk; the standard integration executes all 32 actions before requesting another chunk.

Model precision is fixed by this artifact. Guidance, denoise steps, and shift are independent runtime controls. The release config defaults to guidance 3, two denoise steps, and shift 5.

Benchmark Results

This artifact is retained for reproducibility of the earlier full_w8 experiment. The historical Banana result above is a 50-episode paired task-local comparison, not a substitute for the RoboLab-120 release benchmark. See the legacy ablation tables for the complete comparison and the main benchmark for recommended artifacts.

The artifact uses the Cosmos Lite packed weight layout and must be loaded through the Cosmos Lite runtime.

Quickstart

Install the Hugging Face CLI, clone the runtime, and download this self-contained bundle:

python -m pip install -U "huggingface_hub[cli]"
hf download "XXXXyu/Cosmos3-Edge-Policy-DROID-Marlin-W8A16" --local-dir /data/cosmos_lite/edge_marlin_w8a16

git clone https://github.com/xxxxyu/cosmos-lite.git
cd cosmos-lite
CUDA_VISIBLE_DEVICES=0 examples/robolab_quant/pipeline.sh setup --with-sage

Validate the bundle before loading it:

BUNDLE_DIR=/data/cosmos_lite/edge_marlin_w8a16 \
STRATEGY=full_w8 \
examples/robolab_quant/pipeline.sh validate

For serving and closed-loop RoboLab evaluation, follow the RoboLab pipeline guide.

Quantization And Bundle Details

Format Note

This is a Cosmos Lite deployment bundle, not a generic GPTQ or AWQ checkpoint. The packed weights, precision map, residual tensors, processor assets, and runtime manifest must be loaded through Cosmos Lite. Weight-only artifacts keep activations in BF16; GenW8A8 artifacts use FP8 W8A8 only in the generation branch and retain the documented BF16 paths elsewhere.

The default server binds to 127.0.0.1:8000 and has no built-in TLS or authentication. Do not expose it directly to an untrusted network.

Provenance

• Base policy: nvidia/Cosmos3-Edge-Policy-DROID
• Runtime: Cosmos Lite
• Bundle contents include runtime configuration, source revisions, file sizes, and SHA256 hashes.

Limitations And Safety

Simulation results do not establish transfer to a new robot, camera layout, task distribution, or action contract. Validate those changes with paired closed-loop rollouts. This policy is not real-robot safety certified. Real deployment requires an independent E-stop, watchdog, motion limits, stale-command rejection, and operator supervision.

This community quantization is not an NVIDIA product.

License

The upstream model and this derivative are distributed under OpenMDW-1.1. Review the upstream model card and repository notices before use.