Downloads · 30 days
8
21% of all-time downloads
AuriStream100M_20Pred_BigAudioDataset_500k-randinit
TuKoResearch/AuriStream100M_20Pred_BigAudioDataset_500k-randinit
AuriStream100M_20Pred_BigAudioDataset_500k-randinit is a feature extraction model from TuKoResearch. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as apache-2.0.
AuriStream is a speech language model by Greta Tuckute and Klemen Kotar.
All-time downloads
39
Public
Parameters
217M
1.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors868 MB · 100%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- apache-2.0
- Model type
- AuriStream
- Access
- Public
- Created
- Aug 23, 2026
- Updated
- Aug 30, 2026
- SHA
- 82130fb6
Model card
From the Hugging Face model README
AuriStream100M_20Pred_BigAudioDataset_500k-randinit
AuriStream is a speech language model by Greta Tuckute and Klemen Kotar.
This model predicts cochlear tokens from a tokenizer such as WavCochCausalV8192.
Native training step-zero initialization for the 100M 20-prediction model. This exactly uses origin seed 11101994 and historical source commit fad735c90bd44b4bcfd6bdf9429edbb640d2ebf5, matching the start of W&B run 3g8jxx2k. The weights are untrained FP32 values produced before XLA/FSDP wrapping.
Model Details
| Parameter | Value |
|---|---|
| Parameters | ~0.22B |
| Layers | 12 |
| Hidden Size | 768 |
| Attention Heads | 12 |
| Vocab Size | 8192 |
| Prediction Steps | 20 |
Usage
from transformers import AutoModel, AutoConfig
# Load with trust_remote_code for custom model
model = AutoModel.from_pretrained(
"TuKoResearch/AuriStream100M_20Pred_BigAudioDataset_500k-randinit",
trust_remote_code=True,
)
# Or load config first
config = AutoConfig.from_pretrained("TuKoResearch/AuriStream100M_20Pred_BigAudioDataset_500k-randinit", trust_remote_code=True)
Base Model Code
This checkpoint uses shared model code from TuKoResearch/AuriStream-base.
Tokenizer
This model uses cochlear tokens from WavCochCausalV8192.
- Task
- Feature Extraction
- Library
- transformers
- Type
- AuriStream
- License
- apache-2.0
- Created
- Aug 23, 2026
- Updated
- Aug 30, 2026