Downloads · 30 days
185
5% of all-time downloads
LLaMA-1-7B-GGUF
PhilLovesCats/LLaMA-1-7B-GGUF
LLaMA-1-7B-GGUF is a text generation model from PhilLovesCats. Use it when you need the model to write or continue text.
- Model creator: Meta Llama - The 'Provided files'-section layout, as well as the metadata layout are heavily inspired from TheBloke - The 'License'-section, aswell as the 'LICENSE'-file are burrowed by huggyllama
All-time downloads
4.1K
Public
Repo size
109 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf82 GB · 86%
At a glance
- Task
- Text Generation
- Model type
- llama
- Access
- Public
- Created
- May 30, 2025
- Updated
- Jun 8, 2025
- SHA
- 3676ec49
Try a prompt
Model card
From the Hugging Face model README
LLaMA 1 7B - GGUF
- Model creator: Meta Llama
- The 'Provided files'-section layout, as well as the metadata layout are heavily inspired from TheBloke
- The 'License'-section, aswell as the 'LICENSE'-file are burrowed by huggyllama
Please tell me when i have violated your copyright, so that i can remove the belonging section!
Description
Due the fact that the old LLaMA (1) models are in a deprecated format and really hard to use with modern tools, i converted them using the transformers library's convert_llama_weights_to_hf.py script to convert them into a PyTorch model.
Further i used the convert_hf_to_gguf.py script from llama.cpp and to bring them into the well-known GGUF file format. Afterwards, i've build llama.cpp and ran llama-quantize.exe to downscale the model files.
Provided files
The following table only lists the quantized (.gguf) files (without the PyTorch (.bin) ones).
| Name | Quant method | Bits | Size | MD5-Hash | Use case |
|---|---|---|---|---|---|
| llama-1-7b.TQ1_0.gguf | TQ1_0 | 1 | 1.76 GB | 188467F7FDD001BBBA244071E5EBF05E | very small, significant quality loss - not recommended for most purposes |
| llama-1-7b.TQ2_0.gguf | TQ2_0 | 2 | 2.04 GB | 8C0A29B4068CD2016A5DF0924B6F8FCF | very small, significant quality loss - not recommended for most purposes |
| llama-1-7b.Q2_K.gguf | Q2_K | 2 | 2.35 GB | 5D371F8ADE1ADE8FBFA6F101A4489241 | smallest, significant quality loss - not recommended for most purposes |
| llama-1-7b.Q3_K_S.gguf | Q3_K_S | 3 | 2.74 GB | 301B3495B61D1B9115F5E7BBAB2270A8 | very small, high quality loss |
| llama-1-7b.Q3_K_M.gguf | Q3_K_M | 3 | 3.07 GB | 3755C9BCC82E1B453CB87EA3A9E2C84D | very small, high quality loss |
| llama-1-7b.Q3_K_L.gguf | Q3_K_L | 3 | 3.34 GB | 356CAE2C39D0085EECA6566C10F59235 | small, substantial quality loss |
| llama-1-7b.Q4_0.gguf | Q4_0 | 4 | 3.56 GB | D741CAC6ADA6C8B8B8C493F536A54B12 | legacy; small, very high quality loss - prefer using Q3_K_M |
| llama-1-7b.Q4_K_S.gguf | Q4_K_S | 4 | 3.59 GB | A84887EFC1C6461B2166E16F6A468C17 | small, greater quality loss |
| llama-1-7b.Q4_K_M.gguf | Q4_K_M | 4 | 3.79 GB | 04B6ECFAD36D9B57C756E0A13310341E | medium, balanced quality - recommended |
| llama-1-7b.Q5_0.gguf | Q5_0 | 5 | 4.33 GB | 7AA2E9BBF47D2C2F74B71D87C6D81EC6 | legacy; medium, balanced quality - prefer using Q4_K_M |
| llama-1-7b.Q5_K_S.gguf | Q5_K_S | 5 | 4.33 GB | F6EE8274C8D2D63AA2DEC2F8E6856AE9 | large, low quality loss - recommended |
| llama-1-7b.Q5_K_M.gguf | Q5_K_M | 5 | 4.45 GB | 2B7477EB0D86394831F39A8B9BFCD11D | large, very low quality loss - recommended |
| llama-1-7b.Q6_K.gguf | Q6_K | 6 | 5.14 GB | 3B2A3C6329954A3BAD867C4A41AD578A | very large, extremely low quality loss |
| llama-1-7b.Q8_0.gguf | Q8_0 | 8 | 6.66 GB | 0D757DD0FC2000D745FE5BE6DDD033B2 | very large, extremely low quality loss - not recommended |
| llama-1-7b.F16.gguf | F16 | 16 | 12.50 GB | D866619C36114FF150C43B955B1F2729 | original, no quality loss - not recommended |
| llama-1-7b.BF16.gguf | BF16 | 16 | 12.50 GB | B045E6BC11B19A2039CCA0709FE1C953 | original, no quality loss - not recommended |
Notice: Hashes were calculated with Get-FileHash .\FILENAME -Algorithm MD5 on Microsoft Windows 11 64-bit (x86_x64).
License
This model is under a non-commercial license (see the LICENSE file). You should only use this repository if you have been granted access to the model by filling out this form but either lost your copy of the weights or got some trouble converting them to the Transformers format.
- Task
- Text Generation
- Type
- llama
- Languages
- en
- Created
- May 30, 2025
- Updated
- Jun 8, 2025