Downloads · 30 days
15
5% of all-time downloads
chargoddard_llama-2-34b-uncode-iMat.GGUF
Nexesenex/chargoddard_llama-2-34b-uncode-iMat.GGUF
chargoddard_llama-2-34b-uncode-iMat.GGUF is a machine learning model from Nexesenex. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GGUF Quants with iMatrix for the following model : https://huggingface.co/chargoddard/llama-2-34b-uncode
All-time downloads
287
Public
Repo size
122 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf122 GB · 100%
At a glance
- Access
- Public
- Created
- Feb 4, 2024
- Updated
- Feb 5, 2024
- SHA
- d0df3f2f
Model card
From the Hugging Face model README
GGUF Quants with iMatrix for the following model : https://huggingface.co/chargoddard/llama-2-34b-uncode
That model is based on the following dataset : https://huggingface.co/datasets/open-llm-leaderboard/details_chargoddard__llama-2-34b-uncode
It's basically an attempt to un-nerf CodeLlama 34b.
Here are some benchs made with LlamaCPP :
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag,72.5,,400,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag,72.6,,1000,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag_Bin,70,,400,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Hellaswag_Bin,72.5,,1000,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Arc-Challenge,38.12709030,,299,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Arc-Easy,64.73684211,,570,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,MMLU,35.14376997,,313,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Thruthful-QA,24.96940024,,817,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,Winogrande,68.5872,,1267,2024-02-02 05:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,wikitext,5.7595,512,512,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- llama-2-34b-uncode-b2060-iMat-c32_ch3250-Q5_K_S.gguf,-,wikitext,5.0113,4096,4096,2024-02-02 01:40:00,,34b,CodeLlama,1000000,,,GGUF,chargoddard,Nexesenex,
- Created
- Feb 4, 2024
- Updated
- Feb 5, 2024