Downloads · 30 days
137
5% of all-time downloads
llama2_xs_460M_experimental_evol_instruct-GGUF
afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF
llama2_xs_460M_experimental_evol_instruct-GGUF is a text generation model from afrideva. Use it when you need the model to write or continue text.
Quantized GGUF model files for llama2xs460Mexperimentalevolinstruct from Felladrin
All-time downloads
2.7K
Public
Repo size
2.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf2.9 GB · 100%
At a glance
- Task
- Text Generation
- Access
- Public
- Created
- Nov 18, 2023
- Updated
- Nov 18, 2023
- SHA
- 271a6a1a
Try a prompt
Base models
Model card
From the Hugging Face model README
Felladrin/llama2_xs_460M_experimental_evol_instruct-GGUF
Quantized GGUF model files for llama2_xs_460M_experimental_evol_instruct from Felladrin
| Name | Quant method | Size |
|---|---|---|
| llama2_xs_460m_experimental_evol_instruct.q2_k.gguf | q2_k | 212.56 MB |
| llama2_xs_460m_experimental_evol_instruct.q3_k_m.gguf | q3_k_m | 238.87 MB |
| llama2_xs_460m_experimental_evol_instruct.q4_k_m.gguf | q4_k_m | 288.52 MB |
| llama2_xs_460m_experimental_evol_instruct.q5_k_m.gguf | q5_k_m | 333.29 MB |
| llama2_xs_460m_experimental_evol_instruct.q6_k.gguf | q6_k | 380.87 MB |
| llama2_xs_460m_experimental_evol_instruct.q8_0.gguf | q8_0 | 492.67 MB |
Original Model Card:
ahxt's llama2_xs_460M_experimental trained on the WizardLM's Evol Instruct dataset using AutoTrain
- Base model: ahxt/llama2_xs_460M_experimental
- Dataset: KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format
- Training: 13.5h under these parameters
Recommended Prompt Format
### Instruction:
<instruction>
### Response:
Recommended Inference Parameters
repetition_penalty: 1.15
do_sample: true
temperature: 0.5
top_p: 0.5
- Task
- Text Generation
- Created
- Nov 18, 2023
- Updated
- Nov 18, 2023