Downloads · 30 days
8
1% of all-time downloads
fikri-3.1-8B-Instruct-Q4_K_M
BrewInteractive/fikri-3.1-8B-Instruct-Q4_K_M
fikri-3.1-8B-Instruct-Q4_K_M is a machine learning model from BrewInteractive. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
This is a quantized version of the BrewInteractive/fikri-3.1-8B-Instruct model.
All-time downloads
1.2K
Public
Repo size
4.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf4.9 GB · 100%
At a glance
- License
- llama3.1
- Access
- Public
- Created
- Sep 5, 2024
- Updated
- Sep 5, 2024
- SHA
- 7a7ce0ec
Model card
From the Hugging Face model README
This is a quantized version of the BrewInteractive/fikri-3.1-8B-Instruct model.
-
Original model: fikri-3.1-8B-Instruct
-
Base model: LLaMA-3.1-8B
-
Quantization: Q4_K_M
-
Optimized for faster inference and reduced memory usage while maintaining performance
-
Built on the LLaMA 3.1 architecture (8B)
-
Fine-tuned for Turkish language tasks
-
Quantized for improved efficiency
How to use
-
Install llama.cpp:
- For macOS, use Homebrew:
brew install llama.cpp - For other operating systems, follow the installation instructions on the llama.cpp GitHub repository.
- For macOS, use Homebrew:
-
Download the quantized GGUF file from this repository's Files section.
-
Run the following command for conversation mode:
llama-cli -m ./fikri-3.1-8B-Instruct-Q4_K_M.gguf --no-mmap -fa -c 4096 --temp 0.8 -if --in-prefix "<|start_header_id|>user<|end_header_id|>\n\n" --in-suffix "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n"
- License
- llama3.1
- Languages
- tr
- Created
- Sep 5, 2024
- Updated
- Sep 5, 2024