Downloads · 30 days
61
52% of all-time downloads
Thox-ai/ThoxGlobal-7B
ThoxGlobal-7B is a text generation model from Thox-ai. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
Downloads · 30 days
61
52% of all-time downloads
All-time downloads
118
Public
Repo size
4.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.7 GB · 98%
From the Hugging Face model README
THOX Multilingual Assistant (LoRA Adapter + GGUF) — THOX's multilingual assistant model: a LoRA fine-tune (rank 8) published as an adapter with a bundled Q4_K_M GGUF for direct use
Safetensors weights · GGUF: Q4_K_M · Live on Ollama
</div>Run it: Ollama — Thox-ai/thoxglobal-7b · Find your model: THOX Model Factory · Collection: Open & Pro — Laptop and Desktop Models
<div align="center"> <a href="https://www.kickstarter.com/projects/thox/four-devices-one-private-ai-ecosystem-thoxai?ref=4tzhm0"><img src="https://huggingface.co/spaces/Thox-ai/README/resolve/main/back-thox-on-kickstarter.jpg" alt="Back THOX on Kickstarter" width="520"></a> </div>Your AI. Your Data. Your Rules.™
ThoxGlobal-7B is THOX's multilingual assistant model: a LoRA fine-tune (rank 8) published as an adapter with a bundled Q4_K_M GGUF for direct use.
bash ollama run Thox-ai/thoxglobal-7b | Base model | Qwen/Qwen2.5-7B-Instruct |
| Parameters | 7B |
| Formats | Safetensors weights · GGUF: Q4_K_M · LoRA adapter files |
| Training | LoRA fine-tune (rank 8) published as an adapter with a bundled Q4_K_M GGUF for direct use |
| License | Apache-2.0. The THOX fine-tune and additions in this repo are covered under Apache-2.0; see the license text for terms. |
| This repository contains | Full weights and tokenizer in this repo |
| File | Size | SHA-256 |
|---|---|---|
adapter_model.safetensors | 80,792,096 B | 2d1b36426555a6662d9d756e21e50cdcb79fdcabc2c1abcc28f946a0366a072f |
thoxglobal-7b-Q4_K_M.gguf | 4,683,073,408 B | 6de855b3c1ff26efa7e3425ee182b4339990f7d609c70dd31e81db1a102756ca |
Bundled GGUF (Ollama)
ollama run Thox-ai/thoxglobal-7b
Bundled GGUF (llama.cpp)
hf download Thox-ai/ThoxGlobal-7B --include '*.gguf' --local-dir ./ThoxGlobal-7B
llama-cli -m ./ThoxGlobal-7B/thoxglobal-7b-Q4_K_M.gguf -p "Hello" -n 128
Adapter (Transformers + PEFT)
Load the base model named in this card's metadata, then attach the adapter from this repo:
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = "<base model named in this card's metadata>"
tok = AutoTokenizer.from_pretrained(base)
model = AutoModelForCausalLM.from_pretrained(base, device_map="auto")
model = PeftModel.from_pretrained(model, "Thox-ai/ThoxGlobal-7B")
| Platform / device | Run path |
|---|---|
| Ollama (laptop / desktop) | ollama run Thox-ai/thoxglobal-7b |
| Hugging Face | Download the builds listed under Files from this repo (see Run it) |
ThoxOS loads this model as a host-class assistant through its local model runtime. Serve the bundled GGUF with Ollama on the ThoxOS host:
ollama run Thox-ai/thoxglobal-7b
ThoxOS points its chat and agent surfaces at the local Ollama endpoint (http://localhost:11434); no cloud account is required and prompts stay on the machine.
On a MeshStack node, pull the model once and serve it to the rest of your mesh:
ollama pull Thox-ai/thoxglobal-7b
ollama serve
Other devices on the same mesh reach it through the node's OpenAI-compatible endpoint (http://<node>:11434/v1). The adapter form can equally be served from the Hugging Face files with llama.cpp:
hf download Thox-ai/ThoxGlobal-7B --include '*.gguf' --local-dir ./ThoxGlobal-7B
llama-cli -m ./ThoxGlobal-7B/thoxglobal-7b-Q4_K_M.gguf -p "Hello" -n 128
THOX fine-tune of Qwen/Qwen2.5-7B-Instruct. The corpus and procedure are described in this card as published at release (see Summary and Evaluation); no training beyond what this card describes is claimed for this repository.
No THOX GATE49 result is published for this model.
Published by THOX.ai as Thox-ai/ThoxGlobal-7B. Upstream base: Qwen/Qwen2.5-7B-Instruct. This card was conformed to THOX Model Card Standard v1.0 on 2026-10-31 (frontmatter, tags, header, files, and section structure); the technical content is as published at release.
Apache-2.0. The THOX fine-tune and additions in this repo are covered under Apache-2.0; see the license text for terms.
THOX.ai — Your AI. Your Data. Your Rules.™
@misc{thoxai2026thoxglobal7b,
title={ThoxGlobal-7B},
author={THOX.ai},
year={2026},
url={https://huggingface.co/Thox-ai/ThoxGlobal-7B}
}