Downloads · 30 days
0
aligntune-testrun-tokenization-indic
ram-lexsi/aligntune-testrun-tokenization-indic
aligntune-testrun-tokenization-indic is a machine learning model from ram-lexsi. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
<div align="center" <table border="0" cellspacing="0" cellpadding="0" style="border: none; border-collapse: collapse;" <tr <td align="center" style="border: none; vertical-align: middle;" <a href="https://lexsi.ai/"<i…
Access
Public
Updated Aug 26, 2026
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json3.7 MB · 98%
At a glance
- Library
- transformers
- Access
- Public
- Created
- Aug 26, 2026
- Updated
- Aug 26, 2026
- SHA
- 55339b4b
Model card
From the Hugging Face model README
<div align="center">
<table border="0" cellspacing="0" cellpadding="0" style="border: none; border-collapse: collapse;">
<tr>
<td align="center" style="border: none; vertical-align: middle;">
<a href="https://lexsi.ai/"><img src="https://huggingface.co/ram-lexsi/aligntune-testrun-tokenization-indic/resolve/main/aligntune_logo.png" alt="Lexsi Labs" style="height: 60px;"/></a>
</td>
<td align="center" style="border: none; vertical-align: middle;">
<a href="https://github.com/Lexsi-Labs/aligntune"><img src="https://huggingface.co/ram-lexsi/aligntune-testrun-tokenization-indic/resolve/main/aligntune_banner.png" alt="AlignTune" style="height: 60px;"/></a>
</td>
</tr>
</table>
</div>
aligntune-testrun-tokenization-indic
Built using AlignTune — supports any open-source model, any algorithm, any backend (TRL / Unsloth / ES / etc).
| Finetuned from | — |
| Algorithm | — |
| Backend | — |
| Artifact | tokenizer |
| Published | 2026-08-26 12:19 UTC |
Usage
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("ram-lexsi/aligntune-testrun-tokenization-indic")
- Library
- transformers
- Created
- Aug 26, 2026
- Updated
- Aug 26, 2026