Downloads · 30 days
280
17% of all-time downloads
Ornith-1.5-9B-Function-Calling-xLAM-Unsloth-GGUF
ermiaazarkhalili/Ornith-1.5-9B-Function-Calling-xLAM-Unsloth-GGUF
Ornith-1.5-9B-Function-Calling-xLAM-Unsloth-GGUF is a text generation model from ermiaazarkhalili. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as mit.
GGUF quantizations of a LoRA fine-tune of ornith-ai/Ornith-1.5-9B, supervised fine-tuned on Salesforce/xlam-function-calling-60k.
All-time downloads
1.7K
Public
Repo size
37.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf37.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- mit
- Access
- Public
- Created
- Aug 23, 2026
- Updated
- Aug 23, 2026
- SHA
- f55fea52
Try a prompt
Base models
Model card
From the Hugging Face model README
Ornith-1.5-9B-Function-Calling-xLAM-Unsloth-GGUF
GGUF quantizations of a LoRA fine-tune of ornith-ai/Ornith-1.5-9B, supervised fine-tuned on Salesforce/xlam-function-calling-60k.
Quantized from ermiaazarkhalili/Ornith-1.5-9B-Function-Calling-xLAM-Unsloth. See that repository for the full-precision weights.
| Base model | ornith-ai/Ornith-1.5-9B |
| Training data | Salesforce/xlam-function-calling-60k |
| Method | LoRA supervised fine-tuning via Unsloth + TRL |
| License | mit (inherited from the base model) |
Available quantizations
| File | Size |
|---|---|
ornith-1.5-9b-function-calling-xlam-unsloth.q2_k.gguf | 3.83 GB |
ornith-1.5-9b-function-calling-xlam-unsloth.q3_k_m.gguf | 4.62 GB |
ornith-1.5-9b-function-calling-xlam-unsloth.q4_k_m.gguf | 5.63 GB |
ornith-1.5-9b-function-calling-xlam-unsloth.q5_k_m.gguf | 6.47 GB |
ornith-1.5-9b-function-calling-xlam-unsloth.q6_k.gguf | 7.36 GB |
ornith-1.5-9b-function-calling-xlam-unsloth.q8_0.gguf | 9.53 GB |
Usage
llama.cpp
huggingface-cli download ermiaazarkhalili/Ornith-1.5-9B-Function-Calling-xLAM-Unsloth-GGUF ornith-1.5-9b-function-calling-xlam-unsloth.q4_k_m.gguf --local-dir .
llama-cli -m ornith-1.5-9b-function-calling-xlam-unsloth.q4_k_m.gguf -p "Explain gradient checkpointing in two sentences." -n 256
Ollama
echo 'FROM ./ornith-1.5-9b-function-calling-xlam-unsloth.q4_k_m.gguf' > Modelfile
ollama create ornith-1.5-9b-function-calling-xlam-unsloth-gguf -f Modelfile
ollama run ornith-1.5-9b-function-calling-xlam-unsloth-gguf
Training configuration
| Setting | Value |
|---|---|
| LoRA rank (r) | 64 |
| LoRA alpha | 64 |
| Learning rate | 0.0002 |
| Epochs | 1 |
| Effective batch size | 8 (1 x 8 grad accum) |
| Max sequence length | 2048 |
| Base precision | 4-bit (QLoRA) |
| Target modules | down_proj, gate_proj, in_proj_qkv, in_proj_z, k_proj, o_proj, out_proj, q_proj, up_proj, v_proj |
Observed training loss
Measured from our SLURM logs for this configuration. These are training-loss observations only — no downstream benchmark evaluation has been run on this model, so they should not be read as a quality claim.
| SLURM job | Steps | First loss | Final loss |
|---|---|---|---|
55906359 | 14,250 | 0.9539 | 0.8267 |
55906361 | 7,500 | 0.5712 | 0.1162 |
Limitations
- No benchmark evaluation has been run on this checkpoint. The only reported numbers are training-loss observations.
- Inherits the biases, knowledge cutoff and failure modes of the base model.
- Fine-tuned on a single instruction-following dataset; behaviour outside that distribution is untested.
- LoRA adapters were merged into the base weights, so the merged model cannot be detached from this fine-tune.
Reproducing
Trained by notebooks/xlam_function_calling_ornith-1.5-9b_unsloth.ipynb, executed non-interactively with
papermill on a SLURM H100 partition (Unsloth + TRL, LoRA).
Card generated from the training run's own configuration and logs by
scripts/generate_hub_model_card.py.
- Task
- Text Generation
- Library
- gguf
- License
- mit
- Created
- Aug 23, 2026
- Updated
- Aug 23, 2026