Downloads · 30 days
0
llama-tokenizer
oobabooga/llama-tokenizer
llama-tokenizer is a machine learning model from oobabooga. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Converted using convertllamaweightstohf.py, commit d2ffc3f:
Access
Public
Updated Apr 20, 2023
Repo size
500 KB
Likes
22
Public
Repo makeup
Click a slice to open those files.
.json1.8 MB · 79%
At a glance
- Access
- Public
- Created
- Apr 20, 2023
- Updated
- Apr 20, 2023
- SHA
- 5034ac08
Model card
From the Hugging Face model README
Converted using convert_llama_weights_to_hf.py, commit d2ffc3f:
python convert_llama_weights_to_hf.py --input_dir /models/LLaMA/ --model_size 7B --output_dir /tmp/converted
- Created
- Apr 20, 2023
- Updated
- Apr 20, 2023