Downloads · 30 days
10
26% of all-time downloads
falcon-thought-7b-v0-1
nkpz/falcon-thought-7b-v0-1
falcon-thought-7b-v0-1 is a machine learning model from nkpz. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Fine-tune of https://huggingface.co/suayptalha/Falcon3-Jessi-v0.4-7B-Slerp using a custom training script + custom optimizer.
All-time downloads
39
Public
Parameters
7.5B
14.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.9 GB · 100%
At a glance
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Feb 12, 2025
- Updated
- Feb 12, 2025
- SHA
- 686a617b
Model card
From the Hugging Face model README
Fine-tune of https://huggingface.co/suayptalha/Falcon3-Jessi-v0.4-7B-Slerp using a custom training script + custom optimizer.
This is a variant of https://huggingface.co/nkpz/falcon-thought-7b-v0 and it isn't hugely different.
The one big difference from v0 is that I used NLL loss instead of an experimental AI-generated loss function. v0-1 had a much smoother loss curve for this reason.
It still gets "I"/"you" confused pretty frequently or generates <|eot_id|> prematurely. Keep expectations low in terms of stability and correctness (it hallucinates), but it's capable of reasoning in a roleplay context which is cool.
- Type
- llama
- License
- mit
- Created
- Feb 12, 2025
- Updated
- Feb 12, 2025