Avnas-7B-v0-GGUF

bugged v0 GGUF has eos padding

reuploading a fixed v1 later

(you can kind of use EOS token ban for now as a workaround)

<<<<<<
    # --- 4. Load Tokenizer ---
    tokenizer = AutoTokenizer.from_pretrained(MODEL_PATH, local_files_only=True)
    if tokenizer.pad_token is None:
        tokenizer.pad_token = tokenizer.eos_token
    tokenizer.padding_side = "right"
======
    # --- 4. Load Tokenizer ---
    tokenizer = AutoTokenizer.from_pretrained(MODEL_PATH, local_files_only=True)
    
    # FIX: Use <unk> (ID 0) for padding instead of EOS (ID 2)
    # This prevents the model from learning to stop generating prematurely
    tokenizer.pad_token_id = 0  # unk_token_id for Mistral/Llama
    tokenizer.padding_side = "right"
>>>>>>