Downloads · 30 days
10
0% of all-time downloads
aurelian-alpha0.1-70b-rope8-32K-GGUF
Noeda/aurelian-alpha0.1-70b-rope8-32K-GGUF
aurelian-alpha0.1-70b-rope8-32K-GGUF is a machine learning model from Noeda. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama2.
This repository contains .gguf files for:
All-time downloads
14.1K
Public
Repo size
98 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf41.4 GB · 42%
At a glance
- License
- llama2
- Access
- Public
- Created
- Dec 11, 2023
- Updated
- Dec 11, 2023
- SHA
- 9b1b55dc
Model card
From the Hugging Face model README
This repository contains .gguf files for:
https://huggingface.co/grimulkan/aurelian-alpha0.1-70b-rope8-32K-fp16
Made with llama.cpp commit e18f7345a300920e234f732077bda660cc6cda9c
IMPORTANT: Linear Rope Scaling = 8 (IMPORTANT: use a factor of 8 even if you are not using the full 32K context length). The setting typically defaults to 1, so you need to change it.
md5sums
aurelian-alpha0.1_Q4_K_M.gguf27ba8b8dc99776cc48d667d1766f8771aurelian-alpha0.1_Q6_K.ggufab36ed3f2cfd2f833cb814304a5cbe50
The aurelian-alpha0.1_Q6_K.gguf is just barely over 50G, HuggingFace's file
limit, so it is in two parts.
On a UNIX-like system, you can use cat to piece it together:
cat aurelian-alpha0.1_Q6_K.gguf-split-a aurelian-alpha0.1_Q6_K.gguf-split-b > aurelian-alpha0.1_Q6_K.gguf
- License
- llama2
- Created
- Dec 11, 2023
- Updated
- Dec 11, 2023