bartowski_-_internlm2-math-20b-llama-gguf

RichardErkhov/bartowski_-_internlm2-math-20b-llama-gguf

bartowski_-_internlm2-math-20b-llama-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Downloads · 30 days

279

12% of all-time downloads

All-time downloads

2.4K

Public

Repo size

200 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf236 GB · 100%

At a glance

Access: Public
Created: Oct 27, 2024
Updated: Oct 27, 2024
SHA: 0815eb4f

Model card

From the Hugging Face model README

Quantization made by Richard Erkhov.

Github

Discord

Request more models

internlm2-math-20b-llama - GGUF

Model creator: https://huggingface.co/bartowski/
Original model: https://huggingface.co/bartowski/internlm2-math-20b-llama/

Name	Quant method	Size
internlm2-math-20b-llama.Q2_K.gguf	Q2_K	7.03GB
internlm2-math-20b-llama.Q3_K_S.gguf	Q3_K_S	8.16GB
internlm2-math-20b-llama.Q3_K.gguf	Q3_K	9.05GB
internlm2-math-20b-llama.Q3_K_M.gguf	Q3_K_M	9.05GB
internlm2-math-20b-llama.Q3_K_L.gguf	Q3_K_L	9.83GB
internlm2-math-20b-llama.IQ4_XS.gguf	IQ4_XS	10.12GB
internlm2-math-20b-llama.Q4_0.gguf	Q4_0	10.55GB
internlm2-math-20b-llama.IQ4_NL.gguf	IQ4_NL	10.65GB
internlm2-math-20b-llama.Q4_K_S.gguf	Q4_K_S	10.62GB
internlm2-math-20b-llama.Q4_K.gguf	Q4_K	11.16GB
internlm2-math-20b-llama.Q4_K_M.gguf	Q4_K_M	11.16GB
internlm2-math-20b-llama.Q4_1.gguf	Q4_1	11.67GB
internlm2-math-20b-llama.Q5_0.gguf	Q5_0	12.79GB
internlm2-math-20b-llama.Q5_K_S.gguf	Q5_K_S	12.79GB
internlm2-math-20b-llama.Q5_K.gguf	Q5_K	13.11GB
internlm2-math-20b-llama.Q5_K_M.gguf	Q5_K_M	13.11GB
internlm2-math-20b-llama.Q5_1.gguf	Q5_1	13.91GB
internlm2-math-20b-llama.Q6_K.gguf	Q6_K	15.18GB
internlm2-math-20b-llama.Q8_0.gguf	Q8_0	19.66GB

Original model description:

pipeline_tag: text-generation license: other

InternLM

<div align="center"> <img src="https://github.com/InternLM/InternLM/assets/22529082/b9788105-8892-4398-8b47-b513a292378e" width="200"/> <div> </div> <div align="center"> <b><font size="5">InternLM</font></b> <sup> <a href="https://internlm.intern-ai.org.cn/"> <i><font size="4">HOT</font></i> </a> </sup> <div> </div> </div>

💻Github Repo

</div>

Converted using <a href="https://huggingface.co/chargoddard">Charles Goddard's</a> conversion script to create llama models from internlm

Original REPO link: https://huggingface.co/internlm/internlm2-math-20b

ExLLamaV2 link: https://huggingface.co/bartowski/internlm2-math-20b-llama-exl2

Created: Oct 27, 2024
Updated: Oct 27, 2024