Downloads · 30 days
21
32% of all-time downloads
WizardLM-13B-V1.2-fixed-tokenizer
dblakely/WizardLM-13B-V1.2-fixed-tokenizer
WizardLM-13B-V1.2-fixed-tokenizer is a text generation model from dblakely. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
This is a slightly modified versions of the original WizardLM/WizardLM-13B-V1.2 checkpoint that fixes a few bugs:
All-time downloads
65
Public
Parameters
13B
52.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors52.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Jan 22, 2024
- Updated
- Jan 22, 2024
- SHA
- abaefe7c
Try a prompt
Model card
From the Hugging Face model README
This is a slightly modified versions of the original WizardLM/WizardLM-13B-V1.2 checkpoint that fixes a few bugs:
- In the original checkpoint, the BOS token is set to the EOS token (
</s>, token ID 2). In this version, the BOS is reverted to<s>(token ID 1). - The original has a mismatch between the size of the tokenizer vocab and the model embedding vocab. This is because the tokenizer includes an extra token for the added
[PAD]token, making the vocab 32,001 tokens. This discrepancy can cause index errors. This version simply removes the added[PAD]in favor of using the<unk>(token ID 0) for padding. So the tokenizer's vocab is reverted back to a size of 32,000 to match the model's vocab size.
For all other information about this model, refer to the original WizardLM/WizardLM-13B-V1.2 checkpoint.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Created
- Jan 22, 2024
- Updated
- Jan 22, 2024