Downloads · 30 days
70
5% of all-time downloads
Catniti/catrex-1.0
catrex-1.0 is a text generation model from Catniti. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Bilingual (RU/EN) chat model on 65M parameters, trained from scratch.
Downloads · 30 days
70
5% of all-time downloads
All-time downloads
1.3K
Public
Parameters
64.8M
1.2 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors259 MB · 66%
From the Hugging Face model README
Bilingual (RU/EN) chat model on 65M parameters, trained from scratch.
| Metric | Value |
|---|---|
| val loss | 4.6802 |
| perplexity | 107.8 |
| Parameters | 64.82M |
| Context | 512 tokens |
| Training steps | 430 |
catrex-1.0-f16.gguf~/.lmstudio/models/Catniti/catrex-1.0/llama-cli -hf Catniti/catrex-1.0:f16 -p "Hi!"
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("Catniti/catrex-1.0")
model = AutoModelForCausalLM.from_pretrained("Catniti/catrex-1.0")
msgs = [{"role": "user", "content": "Hi!"}]
ids = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt")
out = model.generate(ids, max_new_tokens=100, temperature=0.8, do_sample=True)
print(tok.decode(out[0][ids.shape[1]:], skip_special_tokens=True))
ChatML:
<|im_start|>user
Hi!<|im_end|>
<|im_start|>assistant