Downloads · 30 days
12
3% of all-time downloads
hpc-coder-v2-6.7b-Q4_K_S-GGUF
hpcgroup/hpc-coder-v2-6.7b-Q4_K_S-GGUF
hpc-coder-v2-6.7b-Q4_K_S-GGUF is a machine learning model from hpcgroup. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This is the HPC-Coder-v2-6.7b model with 4 bit quantized weights in the GGUF format that can be used with llama.cpp. Refer to the original model card for more details on the model.
All-time downloads
368
Public
Repo size
3.9 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf3.9 GB · 100%
At a glance
- Library
- transformers
- Access
- Public
- Created
- Jul 18, 2024
- Updated
- Jul 18, 2024
- SHA
- ce1822d3
Base models
Model card
From the Hugging Face model README
HPC-Coder-v2-6.7b-Q4_K_S-GGUF
This is the HPC-Coder-v2-6.7b model with 4 bit quantized weights in the GGUF format that can be used with llama.cpp. Refer to the original model card for more details on the model.
Use with llama.cpp
See the llama.cpp repo for installation instructions. You can then use the model as:
llama-cli --hf-repo hpcgroup/hpc-coder-v2-6.7b-Q4_K_S-GGUF --hf-file hpc-coder-v2-6.7b-q4_k_s.gguf -r "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:" --in-prefix "\n" --in-suffix "\n### Response:\n" -c 8096 -p "your prompt here"
- Library
- transformers
- Created
- Jul 18, 2024
- Updated
- Jul 18, 2024