Downloads · 30 days
0
Llama-3-70B-PIM-4bit
seoultechLLM/Llama-3-70B-PIM-4bit
Llama-3-70B-PIM-4bit is a machine learning model from seoultechLLM. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Access
Public
Updated Nov 25, 2024
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
Other1.5 KB · 68%
At a glance
- License
- mit
- Access
- Public
- Created
- Nov 25, 2024
- Updated
- Nov 25, 2024
- SHA
- 0ab9616c
Model card
From the Hugging Face model README
license: mit
Model Architecture
Base Model: Llama 3 (70 billion parameters)
Quantization: 4-bit integer quantization for memory and computational efficiency
Framework: Fine-tuned with PyTorch, leveraging Hugging Face Transformers
PIM Optimization: Enhanced for PIM hardware to process data directly in memory, minimizing latency and maximizing throughput
Intended Use
Primary Use Cases:
Large-scale text generation Summarization Question answering Conversational AI Text classification
Research Focus:
This model is specifically designed for research and industrial applications that require efficient handling of large language models with constrained hardware resources.
- License
- mit
- Created
- Nov 25, 2024
- Updated
- Nov 25, 2024