Downloads · 30 days
12
6% of all-time downloads
AMD-Llama-135m-code-FP16-GGUF
ApprikatAI/AMD-Llama-135m-code-FP16-GGUF
AMD-Llama-135m-code-FP16-GGUF is a machine learning model from ApprikatAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model was converted to GGUF format from amd/AMD-Llama-135m-code using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model.
All-time downloads
186
Public
Repo size
269 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf269 MB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Oct 14, 2024
- Updated
- Oct 14, 2024
- SHA
- d9c52d80
Base models
Model card
From the Hugging Face model README
ApprikatAI/AMD-Llama-135m-code-FP16-GGUF
This model was converted to GGUF format from amd/AMD-Llama-135m-code using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)
brew install llama.cpp
Invoke the llama.cpp server or the CLI.
CLI:
llama-cli --hf-repo ApprikatAI/AMD-Llama-135m-code-FP16-GGUF --hf-file amd-llama-135m-code-fp16.gguf -p "The meaning to life and the universe is"
Server:
llama-server --hf-repo ApprikatAI/AMD-Llama-135m-code-FP16-GGUF --hf-file amd-llama-135m-code-fp16.gguf -c 2048
- License
- apache-2.0
- Created
- Oct 14, 2024
- Updated
- Oct 14, 2024