Downloads · 30 days
0
becausereasons/yue2-chnsn-chanson-francaise
yue2-chnsn-chanson-francaise is a text-to-audio model from becausereasons. Use it for the text-to-audio task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
Artist-style LoRAs that push YuE2-3B into classic French chanson: theatrical baritone and soprano leads with real vibrato, sweeping strings, accordion, piano, brass swells, upright bass, brushed drums, and the mid-cen…
Downloads · 30 days
0
Access
Public
Updated Nov 3, 2026
Repo size
652 MB
Likes
8
Public
Click a slice to open those files.
.safetensors590 MB · 90%
From the Hugging Face model README
Artist-style LoRAs that push YuE2-3B into classic French chanson: theatrical baritone and soprano leads with real vibrato, sweeping strings, accordion, piano, brass swells, upright bass, brushed drums, and the mid-century orchestral sound behind them. Vocals are sung in French. Both male and female leads are in the data, and the prompt decides which one you get. It also does something the base model is not built for: a spoken passage inside a song (see A read letter below).
Each file patches both halves of YuE2 in one go: the autoregressive planner (writes the score, decides the arrangement and the vocal lines) and the flow-matching decoder (the sound). Trigger word for all of them: chnsn.
September 2026 update: a new-trainer generation. chnsn_montmartre and chnsn_cabaret were trained on the same 15 songs with a different trainer (the experimental YuE2 support in Ostris AI Toolkit). The voices are more expressive and more idiomatic than on the two earlier files, male and female alike. They are early checkpoints on purpose: on a set this small the later ones pick up an audible high-end grit, explained under Known limitations. The two earlier files stay available and unchanged.
Last updated: 20 September 2026.
ComfyUI workflows: download both: a core ComfyUI version (built-in nodes only, no custom nodes) and an FS_Audio Suite version. Each has a setup note and the recommended settings for every LoRA in this YuE2 series.
| LoRA | File | Character | Start here | |
|---|---|---|---|---|
| 🌙 | CHNSN Montmartre | chnsn_montmartre.safetensors | New-trainer generation, step 300. The most expressive voices of the set, clean breaths and whispers, wide range across the prompts below. | clip 1.0 / model 1.0; drop to clip 0.5 if a song will not end |
| 🎭 | CHNSN Cabaret | chnsn_cabaret.safetensors | New-trainer generation, step 350. A touch more settled and more orchestral than Montmartre; the swing and yé-yé demos. Very occasionally a trace of high-end grit on breaths. | clip 1.0 or clip 0.5, model 1.0 |
| 🎻 | CHNSN Rive Gauche | chnsn_rive_gauche.safetensors | Step 200, the decoder-loss minimum. The more supple of the two: acoustic narrative, yé-yé, female leads, waltz meters, and the sung-letter duet all came from this file. | clip 1.0 / model 1.0, cfg 1.0 |
| 🎺 | CHNSN Grand Boulevard | chnsn_grand_boulevard.safetensors | Step 350, the final checkpoint. Tighter, more orchestral, writes shorter chanson-length songs. The orchestral ballad demo. | clip 1.0 / model 1.0, cfg 1.0 |
Same original French lyric, seed 7, 32 steps dpm_2 / sgm_uniform, 360 s cap, no post-processing. clip is strength_clip (the planner), model is strength_model (the decoder).
Montmartre, female torch song — prompts/female_torch_minimal.txt, full strength (clip 1.0 / model 1.0). A smoky low female lead with whispered passages over felt piano and bowed bass; the whispers stay clean (6/8, 96 BPM, D minor, 2:51):
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_montmartre__female_torch.mp3"></audio>
Montmartre, male dark crescendo — prompts/male_dark_crescendo.txt, full strength. A dark baritone with wide vibrato, hushed verses rising to a full-voiced orchestral climax (6/8, 90 BPM, D minor, 3:35):
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_montmartre__male_dark_crescendo.mp3"></audio>
Montmartre, male piano ballad, live — prompts/male_piano_live.txt, full strength. A resonant baritone with heavy vibrato, hushed verses and a belted chorus over grand piano (70 BPM, D minor, 3:34):
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_montmartre__male_piano_live.mp3"></audio>
Montmartre, male timpani anthem — prompts/male_timpani_anthem.txt, full strength. A defiant theatrical baritone with choir, brass fanfare and timpani (125 BPM, D minor, 4:28):
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_montmartre__male_timpani_anthem.mp3"></audio>
Montmartre, female dark waltz — prompts/female_dark_waltz.txt, clip 0.5 / model 1.0 (6/8, 90 BPM, D minor, 3:24):
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_montmartre__female_dark_waltz_clip05.mp3"></audio>
Cabaret, big-band swing — prompts/swing_bigband.txt, full strength (115 BPM, F major, 3:26):
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_cabaret__swing_bigband.mp3"></audio>
Cabaret, yé-yé baroque — prompts/female_yeye_baroque.txt, clip 0.5 / model 1.0 (125 BPM, C major, 4:12):
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_cabaret__yeye_baroque_clip05.mp3"></audio>
They load exactly like the others (same fused-key layout, text_encoders.* planner and diffusion_model.* decoder; the LoRA matrices are stored as lora_A / lora_B, and there are no projection diffs), through the same FS_Audio graph shown in Quick start.
What the new trainer does differently, what it costs, and how to spot a runaway score from the .abc sidecar are written up on the sister page: CNZN, Two trainers: what we learned.
All demos use an original French lyric (nine tagged sections, a Paris-in-the-rain chanson), seed 7, baseline recipe, 32 steps dpm_2 / sgm_uniform, 360 s cap, no post-processing.
CHNSN Rive Gauche — a read letter (duet), prompt prompts/duet_spoken_letter.txt. Female lead on the verses and chorus, then a male baritone takes a letter written as prose and delivers it as a declaimed verse, then the chorus returns. 6/8, 90 BPM, D minor, 3:06:
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_rive_gauche__duet_letter.mp3"></audio>
CHNSN Rive Gauche — yé-yé baroque, prompt prompts/female_yeye_baroque.txt: youthful female lead, harpsichord, fuzz bass, mellotron flutes, brass stabs (125 BPM, C major, 4:09):
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_rive_gauche__yeye_baroque.mp3"></audio>
CHNSN Rive Gauche — female dark waltz, prompt prompts/female_dark_waltz.txt: a dramatic female lead with vibrato and declaimed verses over a dark slow waltz, accordion, dissonant strings and tape textures (6/8, 90 BPM, D minor, 3:18, 83 % of vocal bars sung):
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_rive_gauche__female_dark_waltz.mp3"></audio>
CHNSN Rive Gauche — acoustic narrative, prompt prompts/acoustic_narrative.txt: warm baritone storytelling over nylon-string guitar, upright bass and soft strings (105 BPM, D minor, 3:44):
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_rive_gauche__acoustic_narrative.mp3"></audio>
CHNSN Grand Boulevard — orchestral ballad, prompt prompts/orchestral_ballad.txt: dramatic baritone with vibrato, sweeping strings, piano, brass swells (86 BPM, D minor, 3:26):
<audio controls src="https://huggingface.co/becausereasons/yue2-chnsn-chanson-francaise/resolve/main/demos/chnsn_grand_boulevard__orchestral_ballad.mp3"></audio>
Ready-made workflows: download them here. The core ComfyUI version needs no custom nodes (core LoRA loader + YuE2 nodes, same settings as below); the FS_Audio Suite version is the chain below.
The LoRAs are in the fused-key layout that Comfy's YuE2 implementation uses (text_encoders.* for the planner, diffusion_model.* for the decoder). They were trained with, and load through, the FS_Audio Suite node pack.
yue2_3b_bf16.safetensors from Comfy-Org/YuE2 in models/checkpoints/.chnsn_*.safetensors into models/loras/.🧩 FS_Audio Lora Loader ──loras──▶ 🎤 FS_Audio Model Loader ──pipe──▶ 🎵 FS_Audio Sampler ──▶ 💿 FS_Audio Output
lora_name = chnsn_rive_gauche.safetensors yue2_checkpoint = yue2_3b_bf16 style = <prompt, starts with "chnsn,">
strength_clip = 1.0 (planner) melody_transcriber = none lyrics = <tagged French lyric blocks>
strength_model = 1.0 (decoder) score_mode = full
Sampler settings used for every demo:
| widget | value |
|---|---|
| steps / sampler / scheduler | 32 / dpm_2 / sgm_uniform |
| score_mode | full |
| song_length_cap | 360 (chanson-length lyrics plan to 3–5 minutes; the cap rarely triggers) |
| repetition_penalty | 1.2 |
Two recipes:
| Baseline (all demos) | Wild | |
|---|---|---|
| strength_clip (planner) | 1.0 | 1.0 |
| strength_model (decoder) | 1.0 | 1.0 |
| Weirdness (cfg) | 1.0 | 1.4 |
| score_temperature | 0.7 | 0.9 |
| music_temperature | 1.0 | 1.2 |
Headless, the same graph as an API prompt:
prompt = {
"1": {"class_type": "FSAudioLoraLoader", "inputs": {"lora_name": "chnsn_rive_gauche.safetensors", "strength_model": 1.0, "strength_clip": 1.0}},
"2": {"class_type": "FSAudioModelLoader", "inputs": {"yue2_checkpoint": "yue2_3b_bf16.safetensors", "melody_transcriber": "none", "loras": ["1", 0]}},
"3": {"class_type": "FSAudioSampler", "inputs": {"pipe": ["2", 0], "style": STYLE, "lyrics": LYRICS, "seed": 7,
"song_length_cap": 360, "score_mode": "full", "steps": 32, "sampler": "dpm_2", "scheduler": "sgm_uniform",
"Weirdness (cfg)": 1.0, "score_temperature": 0.7, "music_temperature": 1.0, "repetition_penalty": 1.2}},
"4": {"class_type": "FSAudioOutput", "inputs": {"song": ["3", 0], "score": ["3", 1], "info": ["3", 2], "filename_prefix": "chnsn"}},
}
Start with the trigger, then write one descriptive sentence in this order: language → genre → vocal → instruments → mood → production → BPM. This is the format the planner was trained on. Bare tag lists produce odd plans.
chnsn, French, classic French chanson, dramatic expressive male baritone vocal with rich vibrato and theatrical phrasing, sweeping orchestral strings, acoustic piano, brass swells, upright bass, soft brushed drums, poignant, romantic and deeply melancholic, grand cinematic arrangement with emotional crescendos, 81 BPM
Ready-made prompts in prompts/:
| file | what it gets you |
|---|---|
orchestral_ballad.txt | the Grand Boulevard demo: dramatic baritone, strings, piano, brass |
acoustic_narrative.txt | warm baritone storytelling, nylon guitar, upright bass, soft strings |
swing_bigband.txt | 1960s big-band swing chanson; rendered but the planner leaves long instrumental stretches (only a third of vocal bars sung), so treat it as an instrumental-leaning prompt |
female_yeye_baroque.txt | the yé-yé demo: youthful female lead, harpsichord, fuzz bass, mellotron |
female_dark_waltz.txt | dramatic female with vibrato over a dark 6/8 waltz, accordion, dissonant strings, tape loops (demo) |
female_torch_minimal.txt | smoky low-register female torch song, felt piano, glass harmonica, long silences; use the wild recipe (rendered, not in the demos) |
duet_spoken_letter.txt | the duet demo: female lead plus a male baritone narrator reading a letter |
"Female vocal" in the prompt reliably gives a female lead even though only three of the fifteen training songs have one. Waltz words ("slow waltz", "dark waltz") put the planner in 6/8; "yé-yé", "harpsichord", "fuzz bass" push it to 125 BPM in a major key.
YuE2 has no spoken-word mode: the planner writes a pitched melody for every vocal bar. But two things together get a passage delivered rather than sung:
a deep low male baritone narrator who does not sing but reads a letter aloud in a calm monotone spoken voice over the bridge, recited parlé passage with no melody ... the spoken passage close-miked and dry.The section tag then picks the flavour. Under a normal [Bridge] tag the planner writes the letter as a declaimed verse on a simple melody and hands it to the male voice: that is the duet demo. Under an unfamiliar [Spoken] tag the planner writes that stretch as an instrumental interlude with no vocal melody at all, and the decoder still voices every word over the band, at about 2.5 words per second: proper recitation. The [Spoken] render carried all of the letter; the [Bridge] render sang about half of it before returning to the chorus. Check the .abc next to the render: a % interlude with rest-only V: Vocal bars at that spot means it worked.
Tagged French blocks. Use [Intro], [Verse 1], [Verse 2], [Chorus], [Bridge], [Outro] (and [Spoken] for narration); number the verses and write a repeated chorus out again where you want it sung. Standard orthography with accents and apostrophes. Shape that made the demos:
[Intro]
two short lines, the image the song returns to
[Verse 1]
four lines, ten to twelve syllables, rhymed in pairs
[Verse 2]
four more lines
[Chorus]
four lines, the hook phrase at the top of the first two
[Verse 3]
four lines
[Chorus]
(repeat, written out)
[Bridge]
four lines, or a prose letter for the narrator
[Chorus]
(repeat, written out)
[Outro]
the intro image again, trailing off
The planner sometimes drops the bridge on the orchestral prompt and goes verse–chorus–verse–chorus–outro; the acoustic and swing prompts keep it. Chanson-length lyrics like this plan to 3–5 minutes.
Trained on a single RTX 5090 with the FS_Audio Suite Artist Trainer on Comfy's own YuE2 weights. One run trains the planner LoRA and the decoder LoRA together; the file also carries full vae2llm / llm2vae projection diffs. Both published files come from the same run.
| Rive Gauche | Grand Boulevard | |
|---|---|---|
| dataset | 15 songs, 45 minutes: French chanson from the 1950s to the 1980s, mostly orchestral male-baritone chanson with a few acoustic guitar narratives and three female-led songs | same |
| checkpoint | step 200 | step 350 (final) |
| planner / decoder steps | 350 / 600 | 350 / 600 |
| artist (planner) loss | 5.220 → 4.606 | 5.220 → 4.582 |
| decoder loss at checkpoint | 1.148 (the minimum) | 1.162 |
| wall time | 21 minutes for the whole run, dataset build included |
Hyper-parameters: rank 64 planner / rank 32 decoder, LR 3e-5 planner / 4e-5 decoder / 2e-5 I/O projections, artist fraction 0.5 vs regularizer pack, KL 0.1, batch 2 songs, 8192 max tokens, 750-frame windows, EMA 0.99, one song held out, score-first 0, no transcription.
Why two checkpoints. The trainer names its _best file by planner loss, which keeps falling to the end. The decoder loss bottomed at step 200 (1.148) and drifted back up to 1.162 by step 350 on this 15-song set, a mild version of the overfit seen on other small sets. Step 200 is the pick by the decoder curve, and three of the four demos are from it. The step-350 file is published because the orchestral ballad rendered from it was preferred by ear, and the drift is small enough that both are usable.
Same 15 songs, Ostris AI Toolkit's YuE2 trainer on the int8 ConvRot checkpoint: one rank-32 LoRA over both experts, 650 steps planned, LR 5e-5 with the planner at 0.6x, planner KL anchor 0.2, full score conditioning with 0.5 score dropout, 60 s decoder windows, planner context 4000 tokens, a checkpoint every 50 steps. About 4 s per step on an RTX 5090, 47 minutes for the run.
Why steps 300 and 350 of 650. With 15 songs every song is seen about 20 times by step 300. The planner's drift from the base model (the KL term) reached by step 400 what a 34-song set only reached at its final step, and by ear the decoder follows the same curve: steps 300 to 350 are clean, and from roughly step 400 on a gritty, burnt high end creeps into breaths, whispers, sibilants and cymbal swells. The later checkpoints are not published. A small set gives a usable file early, not a better one late.
The planner learns from the captions as much as from the audio, so the caption format decides whether your prompts work later. What worked here:
ffmpeg -err_detect ignore_err.score-first 0 and no automatic transcription.strength_model to 0.8. Part of the training audio came from lossy sources, which is a suspect we have not proven; if you train your own, start from lossless files.[Bridge] on orchestral prompts. If the bridge matters, try the acoustic prompt family or the [Spoken] tag.chnsn_montmartre.safetensors 118 MB new-trainer generation, step 300, planner + decoder LoRA (bf16, no projection diffs)
chnsn_cabaret.safetensors 118 MB new-trainer generation, step 350, same layout
chnsn_rive_gauche.safetensors 177 MB step 200, planner + decoder LoRA (bf16 weights, fp32 projection diffs)
chnsn_grand_boulevard.safetensors 177 MB step 350, same layout
demos/ mp3 renders (192 kbps from the FLAC masters), seed 7 throughout
prompts/ style prompts
These LoRAs are trained on my own GPU and released free. If they're useful to you and you'd like to chip in for compute, there's a Ko-fi: ko-fi.com/becausereasons <3
Weights are released under CC BY-NC 4.0, inherited from the YuE2-3B base model. Non-commercial use only; attribute "CHNSN LoRAs by becausereasons".