Downloads · 30 days
26
14% of all-time downloads
Meta-Llama-2-7B-Chat-Amazon-F16-GGUF
juklein/Meta-Llama-2-7B-Chat-Amazon-F16-GGUF
Meta-Llama-2-7B-Chat-Amazon-F16-GGUF is a text generation model from juklein. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as mit.
This LoRA adapter was converted to GGUF format from adrake17/Meta-Llama-2-7B-Chat-Amazon via the ggml.ai's GGUF-my-lora space. Refer to the original adapter repository for more details.
All-time downloads
188
Public
Repo size
16.8 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf16.8 MB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- mit
- Access
- Public
- Created
- Oct 12, 2025
- Updated
- Oct 12, 2025
- SHA
- b6db0c3a
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
juklein/Meta-Llama-2-7B-Chat-Amazon-F16-GGUF
This LoRA adapter was converted to GGUF format from adrake17/Meta-Llama-2-7B-Chat-Amazon via the ggml.ai's GGUF-my-lora space.
Refer to the original adapter repository for more details.
Use with llama.cpp
# with cli
llama-cli -m base_model.gguf --lora Meta-Llama-2-7B-Chat-Amazon-f16.gguf (...other args)
# with server
llama-server -m base_model.gguf --lora Meta-Llama-2-7B-Chat-Amazon-f16.gguf (...other args)
To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.
- Task
- Text Generation
- Library
- peft
- License
- mit
- Languages
- en
- Created
- Oct 12, 2025
- Updated
- Oct 12, 2025