Downloads · 30 days
29
8% of all-time downloads
yuriachermann/Not-so-bright-AGI-Llama3.1-8B-UC200k-v2
Not-so-bright-AGI-Llama3.1-8B-UC200k-v2 is a question answering model from yuriachermann. Use it when the input is a question plus a passage. It is set up for peft. The card lists the license as llama3.
Downloads · 30 days
29
8% of all-time downloads
All-time downloads
378
Public
Repo size
218 MB
Likes
2
Public
Click a slice to open those files.
.safetensors218 MB · 96%
From the Hugging Face model README
Model Type: Fine-Tuned
Model Base: meta-llama/Meta-Llama-3.1-8B-Instruct
Datasets Used: HuggingFaceH4/ultrachat_200k
Author: Yuri Achermann
Date: August 10, 2024
The following hyperparameters were used during training:
Primary Use Case: The model is intended for generating human-like responses in conversational applications, like chatbots or virtual assistants.
Limitations: The model may generate inaccurate or biased content as it reflects the data it was trained on. It is essential to evaluate the generated responses in context and use the model responsibly.
The evaluation platform consists of Gaudi Accelerators and Xeon CPUs running benchmarks from the Eleuther AI Language Model Evaluation Harness
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande |
|---|---|---|---|---|---|
| 70.742 | 66.89 | 82.32 | 66.04 | 63.48 | 74.98 |
The model may inherit biases present in the training data. It is crucial to use the model in a way that promotes fairness and mitigates potential biases.
This fine-tuning effort was made possible by the support of Intel, that provided the computing resources, and Eduardo Alvarez. Additional shout-out to the creators of the meta-llama/Meta-Llama-3.1-8B-Instruct model and the contributors to the HuggingFaceH4/ultrachat_200k dataset.
For questions or feedback about this model, please contact Yuri Achermann.
This model is distributed under Apache 2.0 License.