Downloads · 30 days
210
7% of all-time downloads
Marx-3B-V2-GGUF
afrideva/Marx-3B-V2-GGUF
Marx-3B-V2-GGUF is a text generation model from afrideva. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Quantized GGUF model files for Marx-3B-V2 from acrastt
All-time downloads
3.2K
Public
Repo size
23.9 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf23.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Dec 18, 2023
- Updated
- Dec 18, 2023
- SHA
- 51cb5829
Try a prompt
Base models
Model card
From the Hugging Face model README
acrastt/Marx-3B-V2-GGUF
Quantized GGUF model files for Marx-3B-V2 from acrastt
| Name | Quant method | Size |
|---|---|---|
| marx-3b-v2.fp16.gguf | fp16 | 6.85 GB |
| marx-3b-v2.q2_k.gguf | q2_k | 2.15 GB |
| marx-3b-v2.q3_k_m.gguf | q3_k_m | 2.27 GB |
| marx-3b-v2.q4_k_m.gguf | q4_k_m | 2.58 GB |
| marx-3b-v2.q5_k_m.gguf | q5_k_m | 2.76 GB |
| marx-3b-v2.q6_k.gguf | q6_k | 3.64 GB |
| marx-3b-v2.q8_0.gguf | q8_0 | 3.64 GB |
Original Model Card:
<a href="https://www.buymeacoffee.com/acrastt" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
This is OpenLLaMA 3B V2 finetuned on EverythingLM Data V2(ShareGPT format) for 2 epochs.
Prompt template:
### HUMAN:
{prompt}
### RESPONSE:
<leave a newline for the model to answer>
q4_1 GGML quant available here.</br> q4_1 GGUF quant available here.
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Dec 18, 2023
- Updated
- Dec 18, 2023