Downloads · 30 days
5
2% of all-time downloads
ECE-EIFFEL.ia-0.5B-FT-V2-Q8
Youlln/ECE-EIFFEL.ia-0.5B-FT-V2-Q8
ECE-EIFFEL.ia-0.5B-FT-V2-Q8 is a text generation model from Youlln. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model was fine-tuned on top of the Youlln/ECE-Qwen0.5B-FT-V2 to improve its performance for specific tasks. After fine-tuning, an 8-bit quantization technique was applied using the bitsandbytes library. This proc…
All-time downloads
292
Public
Parameters
494M
643 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors632 MB · 98%
Parameter types
How the weights are stored.
I8358M · 72%
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Description
This model was fine-tuned on top of the Youlln/ECE-Qwen0.5B-FT-V2 to improve its performance for specific tasks. After fine-tuning, an 8-bit quantization technique was applied using the bitsandbytes library. This process reduced the model size and optimized inference speed while maintaining a good level of accuracy. The model is suitable for environments where memory and computational efficiency are critical, such as edge devices or applications requiring faster response times.
Quantization was selectively applied, and some layers remain in float16 to ensure precision in key computations, balancing efficiency and accuracy
- Developed by: Youri Lalain (@Youlln)
- Organization: ECE engineering school
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Created
- Oct 14, 2024
- Updated
- Oct 14, 2024