Downloads · 30 days
5
12% of all-time downloads
soda-research/discrete-audio-isoflop-3e20-1.68B-d1920-L19-B128-a41e32
discrete-audio-isoflop-3e20-1.68B-d1920-L19-B128-a41e32 is a machine learning model from soda-research. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
A suite of discrete audio models trained for our IsoFLOP study as part of SODA, which is a unified next-token prediction on interleaved semantic, acoustic, and text tokens.
Downloads · 30 days
5
12% of all-time downloads
All-time downloads
43
Public
Parameters
1.7B
6.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors6.7 GB · 100%
From the Hugging Face model README
A suite of discrete audio models trained for our IsoFLOP study as part of SODA, which is a unified next-token prediction on interleaved semantic, acoustic, and text tokens.
🥤 Project Page: https://soda-audio.github.io
For full usage instructions (e.g., inference code), and more information, please refer to the SODA-4B-base model card.
The details for this particular model is as follows:
compute_budget: 3e20param_count (non-embedding): 1.68Bhidden_dim: 1920num_layers: 19batch_size: 128training_step: 56131hash_key: a41e32📈 WandB: https://wandb.ai/potsawee/marin/groups/IsoFlop/workspace