Downloads · 30 days
0
bhenrym14/airophin-13b-pntk-16k-LoRA
airophin-13b-pntk-16k-LoRA is a machine learning model from bhenrym14. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GPTQ weights can be found here: https://huggingface.co/bhenrym14/airophin-13b-pntk-16k-GPTQ fp16 weights can be found here: https://huggingface.co/bhenrym14/airophin-13b-pntk-16k-fp16
Downloads · 30 days
0
Access
Public
Updated Aug 25, 2023
Repo size
1 GB
Likes
1
Public
Click a slice to open those files.
.bin1 GB · 100%
From the Hugging Face model README
GPTQ weights can be found here: https://huggingface.co/bhenrym14/airophin-13b-pntk-16k-GPTQ fp16 weights can be found here: https://huggingface.co/bhenrym14/airophin-13b-pntk-16k-fp16
This is a finetune of Llama-2-13b, intended to extend the useful context window to 16384 tokens. There are two training phases:
This is a QLoRA fine-tune (rank 64).
All training was performed with 1x RTX 6000 Ada.
For full model card, including how to use PNTK, see any of the two merged models linked above.
IMPORTANT There are TWO sets of adapter weights. adapter_model_base is to be applied to llama-2-13b. The result can then be merged with adapter_model. These adapters correspond to the first and second training phase respectively. Applying the second phase adapter to base llama-2-13b will produce different results to what the merged full airophin model.