Downloads · 30 days
27
13% of all-time downloads
CodeLlama-SDSAT_L7_13B
ainergy/CodeLlama-SDSAT_L7_13B
CodeLlama-SDSAT_L7_13B is a text generation model from ainergy. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
The 13B model of "SDSAT: Accelerating LLM Inference through Speculative Decoding with Semantic Adaptive Tokens"
All-time downloads
211
Public
Parameters
13B
26 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors26 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Mar 31, 2024
- Updated
- Apr 1, 2024
- SHA
- ec2d1caa
Try a prompt
Model card
From the Hugging Face model README
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->The 13B model of "SDSAT: Accelerating LLM Inference through Speculative Decoding with Semantic Adaptive Tokens"
Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->- Developed by: ainergy
- Language(s) (NLP): Code
- Finetuned from model: CodeLlama-13B
Model Sources
<!-- Provide the basic links for the model. -->- Repository: https://github.com/ainergy-ml/SDSAT
- Paper: https://arxiv.org/abs/2403.18647
Evaluation
<!-- This section describes the evaluation protocols and provides the results. -->Results
Walltime improvement
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Mar 31, 2024
- Updated
- Apr 1, 2024