Downloads · 30 days
0
ggml-gpt4-x-vicuna-13b
eachadea/ggml-gpt4-x-vicuna-13b
ggml-gpt4-x-vicuna-13b is a text generation model from eachadea. Use it when you need the model to write or continue text.
Access
Public
Updated May 12, 2023
Repo size
26.9 GB
Likes
13
Public
Repo makeup
Click a slice to open those files.
.bin26.9 GB · 100%
At a glance
- Task
- Text Generation
- Access
- Public
- Created
- May 12, 2023
- Updated
- May 12, 2023
- SHA
- 5e29a215
Try a prompt
Model card
From the Hugging Face model README
ggml version (post-PR #1405)
As a base model used https://huggingface.co/eachadea/vicuna-13b-1.1
Finetuned on Teknium's GPTeacher dataset, unreleased Roleplay v2 dataset, GPT-4-LLM dataset, and Nous Research Instruct Dataset
Approx 180k instructions, all from GPT-4, all cleaned of any OpenAI censorship/"As an AI Language Model" etc.
Base model still has OpenAI censorship. Soon, a new version will be released with cleaned vicuna from https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltere
Trained on 8 A100-80GB GPUs for 5 epochs following Alpaca deepspeed training code.
Nous Research Instruct Dataset will be released soon.
GPTeacher, Roleplay v2 by https://huggingface.co/teknium
Wizard LM by https://github.com/nlpxucan
Nous Research Instruct Dataset by https://huggingface.co/karan4d and https://huggingface.co/huemin
Compute provided by our project sponsor https://redmond.ai/
- Task
- Text Generation
- Created
- May 12, 2023
- Updated
- May 12, 2023