Downloads · 30 days
6
4% of all-time downloads
una-cybertron-7b-v2-GGUF-fp16
ddh0/una-cybertron-7b-v2-GGUF-fp16
una-cybertron-7b-v2-GGUF-fp16 is a text generation model from ddh0. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This is FBL's una-cybertron-7b-v2, converted to GGUF. No other changes were made.
All-time downloads
164
Public
Repo size
22.3 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf22.3 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Dec 9, 2023
- Updated
- Dec 9, 2023
- SHA
- b729ccdb
Try a prompt
Model card
From the Hugging Face model README
This is FBL's una-cybertron-7b-v2, converted to GGUF. No other changes were made.
Two files are avaliable here:
- una-cybertron-7b-v2-fp16.gguf: the original model converted to GGUF without quantization
- una-cybertron-7b-v2-q8_0-LOT.gguf: the original model converted to GGUF with q8_0 quantization using the
--leave-output-tensorcommand-line option
From llama.cpp/quantize --help:
--leave-output-tensor: Will leave output.weight un(re)quantized. Increases model size but may also increase quality, especially when requantizing
The model was converted using convert.py from Georgi Gerganov's llama.cpp repo, release b1620.
All credit belongs to FBL for fine-tuning and releasing this model. Thank you!
- Task
- Text Generation
- License
- apache-2.0
- Created
- Dec 9, 2023
- Updated
- Dec 9, 2023