Downloads · 30 days
0
Neko-Institute-of-Science/llama-miscellaneous-4bit
llama-miscellaneous-4bit is a machine learning model from Neko-Institute-of-Science. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Just stuff I do for the guys on /g/lmg. I will only post models here without any json files etc... You can just get those from my normal LLaMA-7-65B converts. Yes these work on cuda as well.
Downloads · 30 days
0
Access
Public
Updated Apr 10, 2023
Repo size
17.5 GB
Likes
2
Public
Click a slice to open those files.
.safetensors17.5 GB · 100%
From the Hugging Face model README
Just stuff I do for the guys on /g/lmg. I will only post models here without any json files etc... You can just get those from my normal LLaMA-7-65B converts. Yes these work on cuda as well.
Currently for llama-30b-sft-oa-alpaca-epoch-2-4bit-128g The config.json's "vocab_size": 32000 needs to be "vocab_size": 32016 to be able to load it.