Downloads · 30 days
3
2% of all-time downloads
Rombos-LLM-V2.6-Nemotron-70b-exl2
UnstableLlama/Rombos-LLM-V2.6-Nemotron-70b-exl2
Rombos-LLM-V2.6-Nemotron-70b-exl2 is a machine learning model from UnstableLlama. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
--- <p<h2ExLlamaV2 Quantization</h2</p <pQuantized with <a href="https://github.com/turboderp/exllamav2/releases/tag/v0.2.2"ExLlamaV2 v0.2.3</a</p
All-time downloads
129
Public
Repo size
64.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json13.7 MB · 100%
At a glance
- License
- llama3.1
- Model type
- llama
- Access
- Public
- Created
- Oct 18, 2024
- Updated
- Oct 18, 2024
- SHA
- 3ca3cf8f
Model card
From the Hugging Face model README
<a href="https://huggingface.co/rombodawg/Rombos-LLM-V2.6-Nemotron-70b">Rombos-LLM-V2.6-Nemotron-70b</a> by Rombodawg
<p><h2>ExLlamaV2 Quantization</h2></p> <p>Quantized with <a href="https://github.com/turboderp/exllamav2/releases/tag/v0.2.2">ExLlamaV2 v0.2.3</a></p>
I applied the last step of my continuous finetuning method to the Nemotron-70b model from Nvidia. More details bellow:
Quants: (Coming Soon)
Open-LLM-Leaderboard scores: (Coming soon)
- Type
- llama
- License
- llama3.1
- Created
- Oct 18, 2024
- Updated
- Oct 18, 2024