Downloads · 30 days
5
1% of all-time downloads
Zephyr-7b-QnA
Feluda/Zephyr-7b-QnA
Zephyr-7b-QnA is a question answering model from Feluda. Use it when the input is a question plus a passage. It is set up for transformers. The card lists the license as mit.
This Model is Finetuned for Document Question and Answering purpose Trained on the yahma/alpaca-cleaned(https://huggingface.co/TheBloke/zephyr-7B-beta-GPTQ) dataset.
All-time downloads
334
Public
Repo size
168 MB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors168 MB · 99%
At a glance
- Task
- Question Answering
- Library
- transformers
- License
- mit
- Model type
- mistral
- Access
- Public
- Created
- Jan 28, 2024
- Updated
- Jan 30, 2024
- SHA
- b6151fb8
Try a prompt
Datasets
Model card
From the Hugging Face model README
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->This Model is Finetuned for Document Question and Answering purpose Trained on the yahma/alpaca-cleaned(https://huggingface.co/TheBloke/zephyr-7B-beta-GPTQ) dataset.
Model Details
Training hyperparameters
The following hyperparameters were used during training:
-gradient_accumulation_steps=1,
-warmup_steps=5,
-max_steps=20,
-learning_rate=2e-4,
-fp16=not torch.cuda.is_bf16_supported(),
-bf16=torch.cuda.is_bf16_supported(),
-logging_steps=1,
-optim="adamw_8bit",
-weight_decay=0.01,
-lr_scheduler_type="linear",
-seed=3407,
-
Framework versions
-
PEFT 0.7.1
-
Transformers 4.36.0
-
Pytorch 2.0.0
-
Datasets 2.16.1
-
Tokenizers 0.15.0
- Task
- Question Answering
- Library
- transformers
- Type
- mistral
- License
- mit
- Languages
- en
- Created
- Jan 28, 2024
- Updated
- Jan 30, 2024