ruvltra-medium

<div align="center">

RuvLTRA Medium

⚖️ Balanced Model for General-Purpose Tasks

</div>

---

Overview

RuvLTRA Medium provides the sweet spot between capability and resource usage. Ideal for desktop applications, development workstations, and moderate-scale deployments.

Model Card

🚀 Quick Start

# Download
wget https://huggingface.co/ruv/ruvltra-medium/resolve/main/ruvltra-1.1b-q4_k_m.gguf

# Run inference
./llama-cli -m ruvltra-1.1b-q4_k_m.gguf \
  -p "Explain quantum computing in simple terms:" \
  -n 512 -c 8192

💡 Use Cases

• Development: Code assistance and generation
• Writing: Content creation and editing
• Analysis: Document summarization
• Chat: Conversational AI applications

🔧 Integration

Rust

use ruvllm::hub::ModelDownloader;

let path = ModelDownloader::new()
    .download("ruv/ruvltra-medium", None)
    .await?;

Python

from llama_cpp import Llama
from huggingface_hub import hf_hub_download

model_path = hf_hub_download("ruv/ruvltra-medium", "ruvltra-1.1b-q4_k_m.gguf")
llm = Llama(model_path=model_path, n_ctx=8192)

OpenAI-Compatible Server

python -m llama_cpp.server \
  --model ruvltra-1.1b-q4_k_m.gguf \
  --host 0.0.0.0 --port 8000

Performance

---

License: Apache 2.0 | GitHub: ruvnet/ruvector

---

⚡ TurboQuant KV-Cache Compression

RuvLTRA models are fully compatible with TurboQuant — 2-4 bit KV-cache quantization that reduces inference memory by 6-8x with <0.5% quality loss.

Usage with RuvLLM

cargo add ruvllm    # Rust
npm install @ruvector/ruvllm   # Node.js

use ruvllm::quantize::turbo_quant::{TurboQuantCompressor, TurboQuantConfig, TurboQuantBits};

let config = TurboQuantConfig {
    bits: TurboQuantBits::Bit3_5, // 10.7x compression
    use_qjl: true,
    ..Default::default()
};
let compressor = TurboQuantCompressor::new(config)?;
let compressed = compressor.compress_batch(&kv_vectors)?;
let scores = compressor.inner_product_batch_optimized(&query, &compressed)?;

v2.1.0 Ecosystem

• Hybrid Search — Sparse + dense vectors with RRF fusion (20-49% better retrieval)
• Graph RAG — Knowledge graph + community detection for multi-hop queries
• DiskANN — Billion-scale SSD-backed ANN with <10ms latency
• FlashAttention-3 — IO-aware tiled attention, O(N) memory
• MLA — Multi-Head Latent Attention (~93% KV-cache compression)
• Mamba SSM — Linear-time selective state space models
• Speculative Decoding — 2-3x generation speedup

RuVector GitHub | ruvllm crate | @ruvector/ruvllm npm

---

Benchmarks (L4 GPU, 24GB VRAM)

Benchmarked on Google Cloud L4 GPU via ruvltra-calibration Cloud Run Job (2026-03-28)