Downloads · 30 days
34
8% of all-time downloads
elley-ai/elley-1b-v1
elley-1b-v1 is a text generation model from elley-ai. Use it when you need the model to write or continue text. The card lists the license as llama3.2.
Release: v1.0.0 Base Architecture: meta-llama/Llama-3.2-1B-Instruct (1.25B Parameters) Distillation Teachers: meta-llama/Llama-3.3-70B-Instruct & deepseek-ai/DeepSeek-V3 Physical Edge Target: Android Devices (<= 4 GB…
Downloads · 30 days
34
8% of all-time downloads
All-time downloads
430
Public
Repo size
5 GB
Likes
1
Public
Click a slice to open those files.
.gguf4.9 GB · 98%
From the Hugging Face model README
Release: v1.0.0
Base Architecture: meta-llama/Llama-3.2-1B-Instruct (1.25B Parameters)
Distillation Teachers: meta-llama/Llama-3.3-70B-Instruct & deepseek-ai/DeepSeek-V3
Physical Edge Target: Android Devices (<= 4 GB RAM, ARM64 Cortex-A76/A55)
Hugging Face Repository: elley-ai/elley-1b-v1
Elley Model v1 is a domain-adapted conversational model optimized for mobile health accompaniment, symptom navigation, lifestyle memory, and patient safety triage.
Distilled from an audited 1,906-scenario multi-source corpus (1,000 open instruction/chat pairs, 736 clinical supervision teacher pairs, 170 pilot seed pairs), Elley Model v1 resolves generic assistant boilerplate into a calm, empathetic, and safety-gated edge companion.
All quantized GGUF variants were quantized directly from master FP16 weights with zero requantization using llama-quantize (build 10549). Physical benchmarks were executed directly on the Motorola Moto G35 5G (ZA223CJ5CX, Unisoc T760 5G, 3.46 GB RAM, Android 15) using a continuous sustained decode loop ($\ge 90$ seconds wall-clock):
| Artifact File | Format | Size | Physical Decode (tok/s)* | TTFT (Mean) | Sustained Stability** | Host Quality (Phase H) | Safety Benchmark (Phase H) | Recommended Role |
|---|---|---|---|---|---|---|---|---|
elley-1b-v1-fp16.gguf | F16 | 2,364.7 MB | N/A (Master Base) | N/A | N/A | 75.1% | 80.0% | Master Unquantized Base Reference |
elley-1b-v1-q3_k_m.gguf | Q3_K_M | 658.8 MB | 10.85 tok/s | 574 ms | 0.946 | 77.0% | 90.0% | Primary Mobile Deployment Candidate |
elley-1b-v1-q4_k_m.gguf | Q4_K_M | 770.3 MB | 9.68 tok/s | 528 ms | 0.694 | 70.7% | 70.0% | Historical Reference / Standard |
elley-1b-v1-q5_k_m.gguf | Q5_K_M | 869.3 MB | 6.67 tok/s | 1,266 ms | 0.693 | 77.6% | 80.0% | High Quality Retention Candidate |
\nIn addition to the standalone GGUF binaries, this repository houses the full LoRA adapter fine-tuning weights (training/lora_adapter_full/), the complete 1,906-scenario unified training/validation corpus (datasets/), and the 60-scenario held-out clinical test suite (datasets/held_out_test_suite.jsonl) for 100% reproducibility and offline redundancy.
*Sustained decode throughput measured across repeated generation runs satisfying an actual >= 90-second monotonic wall-clock workload.
**Sustained Stability: Ratio of final checkpoint throughput to initial checkpoint throughput (1.0 = zero thermal degradation).
q, k, v, o, gate, up, down), $r=16, lpha=32$.2.2676 $
ightarrow$ 0.3117.0.0% overlap with the 60-scenario held-out evaluation test suite.<|begin_of_text|><|start_header_id|>system<|end_header_id|>
You are Elley, a calm, empathetic, and knowledgeable AI health companion. Your communication is warm, supportive, and natural. You speak directly to the user without robotic boilerplate or repetitive disclaimers. You prioritize patient safety, recognize medical emergencies with urgency, adhere strictly to user constraints and formatting instructions, and handle memory seamlessly.
[KNOWN USER MEMORY: <Optional Context>]<|eot_id|><|start_header_id|>user<|end_header_id|>
<User Prompt><|eot_id|><|start_header_id|>assistant<|end_header_id|>
[!CAUTION] Not a Standalone Medical Diagnostic Device:
Elley Model v1 is designed for conversational wellness accompaniment, lifestyle tracking, and supportive health navigation. It is NOT a clinically certified or regulatory-approved diagnostic system. It does not replace professional clinical evaluation, diagnosis, or prescription from licensed healthcare providers. The model incorporates strict emergency escalation protocols for acute presentations (such as acute chest pain, anaphylaxis, overdose, and psychiatric emergencies).
fd32a4e0c08e42750d1673e1f5e182037b8fee332852a71fc0aeeb20b819c133 models/elley-1b-v1-q3_k_m.gguf
81ed143d312a0b6b77ba80baaff6b77ac629ecd2ebef9c8be1ee026804b90cae models/elley-1b-v1-q4_k_m.gguf
58ed113002c1632476c0e31ca6be6d6d32f3729ff472fe8d543ae9de5aa7d3ff models/elley-1b-v1-q5_k_m.gguf
c68e438091f98465229cd0df4e78943612206914e661c06ec7812c0c11a4247d provenance/quantization_manifest.json
9023776692562f6e27c8b443a5cc14d1093a6c8d3603b590118c919ed069d6a8 provenance/TEACHER_MODEL_MANIFEST.md
3216d131d02222664917cf5062e6bf954076dfbfca0a9d512efbcfe38e0defe8 provenance/unified_dataset_manifest.json
4447ff2991a1617d2627bb5f63c1111630389cfcbc15d597bac34b0c5f943234 evaluations/PHASE_H_HOST_QUANTIZATION_REPORT.md
792e63de59bf7455163b888ec26c339e675ad4bf4d12e9c383d153eda7a7105d evaluations/phase_i_device_snapshot.json
2ebb6d80bd489481affbe273d58d0c3c4c01957880932590e1db3cad0681e0f1 evaluations/PHASE_I_MOBILE_BENCHMARK_REPORT.md
7d864cf8cddcda6d08a9a42b60dfe41c3a02e3636847580464f8727a1defcada evaluations/phase_i_results.json