Downloads · 30 days
4
9% of all-time downloads
soda-research/discrete-audio-isoflop-3e20-1.23B-d1664-L17-B256-5b9328
discrete-audio-isoflop-3e20-1.23B-d1664-L17-B256-5b9328 is a machine learning model from soda-research. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
A suite of discrete audio models trained for our IsoFLOP study as part of SODA, which is a unified next-token prediction on interleaved semantic, acoustic, and text tokens.
Downloads · 30 days
4
9% of all-time downloads
All-time downloads
45
Public
Parameters
1.2B
5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors4.9 GB · 100%
From the Hugging Face model README
A suite of discrete audio models trained for our IsoFLOP study as part of SODA, which is a unified next-token prediction on interleaved semantic, acoustic, and text tokens.
🥤 Project Page: https://soda-audio.github.io
For full usage instructions (e.g., inference code), and more information, please refer to the SODA-4B-base model card.
The details for this particular model is as follows:
compute_budget: 3e20param_count (non-embedding): 1.23Bhidden_dim: 1664num_layers: 17batch_size: 256training_step: 38864hash_key: 5b9328📈 WandB: https://wandb.ai/potsawee/marin/groups/IsoFlop/workspace