Downloads · 30 days
18
3% of all-time downloads
Qwen2-1.5B-stepbasin-books
BEE-spoke-data/Qwen2-1.5B-stepbasin-books
Qwen2-1.5B-stepbasin-books is a text generation model from BEE-spoke-data. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/
All-time downloads
580
Public
Parameters
1.5B
3.1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors3.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Jul 15, 2024
- Updated
- Dec 29, 2025
- SHA
- 78870aea
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
Qwen2-1.5B-stepbasin-books
[!IMPORTANT]
this was finetuned at 16384 context length
This is an experiment on long context text generation (i.e. 6k+ tokens generated) to evaluate if/when generation breaks down, etc. As such, all the data on which this model has been fine-tuned are full-length books.
Details
This model is a fine-tuned version of Qwen/Qwen2-1.5B on https://github.com/stepbasin/books/tree/master/books
It achieves the following results on the evaluation set:
- Loss: 2.8110
- Accuracy: 0.4298
- Num Input Tokens Seen: 44040192
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Jul 15, 2024
- Updated
- Dec 29, 2025