Downloads · 30 days
221
9% of all-time downloads
h2oai_-_h2ogpt-32k-codellama-34b-instruct-gguf
RichardErkhov/h2oai_-_h2ogpt-32k-codellama-34b-instruct-gguf
h2oai_-_h2ogpt-32k-codellama-34b-instruct-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
2.6K
Public
Repo size
381 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf442 GB · 100%
At a glance
- Access
- Public
- Created
- Sep 13, 2024
- Updated
- Sep 14, 2024
- SHA
- 1aab1e00
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
h2ogpt-32k-codellama-34b-instruct - GGUF
- Model creator: https://huggingface.co/h2oai/
- Original model: https://huggingface.co/h2oai/h2ogpt-32k-codellama-34b-instruct/
Original model description:
license: llama2
Same as h2oai/h2ogpt-16k-codellama-34b-instruct but with config.json modified to be 32k for embeddings, which still functions fine as 16k model and allows stretching into 32k in vLLM that otherwise cannot modify maximum sequence length.
- Created
- Sep 13, 2024
- Updated
- Sep 14, 2024