Downloads · 30 days
839
34% of all-time downloads
mesolitica/Malaysian-TTS-4B-v0.1
Malaysian-TTS-4B-v0.1 is a text generation model from mesolitica. Use it when you need the model to write or continue text. It is set up for transformers.
Continue pretraining Qwen/Qwen3-4B-Base on mesolitica/Malaysian-TTS-v2,
Downloads · 30 days
839
34% of all-time downloads
All-time downloads
2.5K
Public
Parameters
4.1B
49.3 GB on disk
Likes
4
Public
Click a slice to open those files.
.safetensors16.4 GB · 100%
From the Hugging Face model README
Continue pretraining Qwen/Qwen3-4B-Base on mesolitica/Malaysian-TTS-v2,
husein and idayu speakers only.pip3 install git+https://github.com/mesolitica/DistilCodec
# wget https://huggingface.co/IDEA-Emdoor/DistilCodec-v1.0/resolve/main/model_config.json
# wget https://huggingface.co/IDEA-Emdoor/DistilCodec-v1.0/resolve/main/g_00204000
from distilcodec import DistilCodec, demo_for_generate_audio_codes
from transformers import AutoTokenizer, AutoModelForCausalLM
codec_model_config_path='model_config.json'
codec_ckpt_path = 'g_00204000'
codec = DistilCodec.from_pretrained(
config_path=codec_model_config_path,
model_path=codec_ckpt_path,
use_generator=True,
is_debug=False).eval()
tokenizer = AutoTokenizer.from_pretrained('mesolitica/Malaysian-TTS-4B-v0.1')
model = AutoModelForCausalLM.from_pretrained('mesolitica/Malaysian-TTS-4B-v0.1', torch_dtype = 'auto').cuda()
import soundfile as sf
string = 'The first anti-hoax legislation in the world, Akta Anti Berita Tidak Benar two thousand and eighteen. Saya nak makan nasi ayam.'
left = 'idayu' +': ' + string
prompt = f'<|im_start|>{left}<|speech_start|>'
generate_kwargs = dict(
**tokenizer(prompt, return_tensors = 'pt', add_special_tokens = False).to('cuda'),
max_new_tokens=1024,
temperature=0.5,
do_sample=True,
repetition_penalty=1.0,
)
generation_output = model.generate(**generate_kwargs)
speech_token = tokenizer.decode(generation_output[0]).split('<|speech_start|>')[1].replace('<|endoftext|>', '')
numbers = re.findall(r'speech_(\d+)', speech_token)
d = list(map(int, numbers))
y_gen = codec.decode_from_codes(d, minus_token_offset=False)
sf.write('output.mp3', y_gen[0, 0].cpu().numpy(), 24000)
Output,
Source code at https://github.com/mesolitica/malaya-speech/tree/master/session/qwen-tts
Special thanks to https://www.sns.com.my and Nvidia for 1x H100!