Downloads · 30 days
0
lwch/llama2.go
llama2.go is a machine learning model from lwch. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
this is a model for llama2.go project, this project can run meta LLaMA model in less memory like Raspberry Pi.
Downloads · 30 days
0
Access
Public
Updated Oct 18, 2023
Repo size
79 GB
Likes
0
Public
Click a slice to open those files.
.model79 GB · 100%
From the Hugging Face model README
this is a model for llama2.go project, this project can run meta LLaMA model in less memory like Raspberry Pi.
| Model | Precision | Memory | Memory(Cached Params) |
|---|---|---|---|
| 7B | bf16 | 600M+ | 25G+ |
| 13B | bf16 | 1G+ | 43G+ |
| 70B | bf16 | 3G+ | untest |