cgg507

Behemoth-R1-123B-v2-q4f16_1

cgg507/Behemoth-R1-123B-v2-q4f16_1

Behemoth-R1-123B-v2-q4f16_1 is a machine learning model from cgg507. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

python3 -m mlcllm compile --quantization q4f161 --output 123br1.so . --overrides "tensorparallelshards=2" --device cuda python3 -m mlcllm chat --device cuda 123br1/ --model-lib /workspace/123br1.so