Downloads · 30 days
14
17% of all-time downloads
Arcee-Nova-fp8
juliensimon/Arcee-Nova-fp8
Arcee-Nova-fp8 is a text generation model from juliensimon. Use it when you need the model to write or continue text.
FP8-quantized version of Arcee Nova, a 72B-parameter Qwen2-based model from Arcee AI. FP8 reduces the model size by ~50% while maintaining quality, enabling inference on fewer GPUs.
All-time downloads
82
Public
Parameters
72.7B
75.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors75.2 GB · 100%
Parameter types
How the weights are stored.
F8_E4M370.2B · 97%
Try a prompt
Base models
Model card
From the Hugging Face model README
Arcee Nova — FP8
FP8-quantized version of Arcee Nova, a 72B-parameter Qwen2-based model from Arcee AI. FP8 reduces the model size by ~50% while maintaining quality, enabling inference on fewer GPUs.
Video walkthrough: Unlock the Future of Creative Writing with Arcee Nova!
Model Details
| Detail | Value |
|---|---|
| Base model | arcee-ai/Arcee-Nova |
| Architecture | Qwen2 (72B parameters) |
| Quantization | FP8 (8-bit floating point) |
| Model size | ~75 GB (16 shards) |
| Format | Safetensors |
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained(
"juliensimon/Arcee-Nova-fp8", torch_dtype="auto", device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("juliensimon/Arcee-Nova-fp8")
- Task
- Text Generation
- Type
- qwen2
- Created
- Aug 15, 2024
- Updated
- Mar 22, 2026