Downloads · 30 days
151
0% of all-time downloads
NousResearch/GPT4-x-Vicuna-13b-fp16
GPT4-x-Vicuna-13b-fp16 is a text generation model from NousResearch. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as gpl.
As a base model used https://huggingface.co/eachadea/vicuna-13b-1.1
Downloads · 30 days
151
0% of all-time downloads
All-time downloads
83.5K
Public
Repo size
52.1 GB
Likes
23
Public
Click a slice to open those files.
.bin26 GB · 100%
From the Hugging Face model README
As a base model used https://huggingface.co/eachadea/vicuna-13b-1.1
Finetuned on Teknium's GPTeacher dataset, unreleased Roleplay v2 dataset, GPT-4-LLM dataset Uncensored, WizardLM Uncensored and Nous Research Instruct Dataset
Approx 180k instructions, all from GPT-4, all cleaned of any OpenAI censorship/"As an AI Language Model" etc.
Base model still has OpenAI censorship. Soon, a new version will be released with cleaned vicuna from https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltere
Trained on 8 A100-80GB GPUs for 5 epochs following Alpaca deepspeed training code.
Nous Research Instruct Dataset will be released soon.
Prompt format is Alpaca:
### Instruction:
### Response:
or
### Instruction:
### Input:
### Response:
GPTeacher, Roleplay v2 by https://huggingface.co/teknium
Wizard LM by https://github.com/nlpxucan
Nous Research Instruct Dataset by https://huggingface.co/karan4d and https://huggingface.co/huemin
Compute provided by our project sponsor https://redmond.ai/