Downloads · 30 days
95
6% of all-time downloads
keitokei1994/shisa-v1-qwen2-7b-GGUF
shisa-v1-qwen2-7b-GGUF is a machine learning model from keitokei1994. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
shisa-aiさんが公開しているshisa-v1-qwen2-7bのggufフォーマット変換版です。
Downloads · 30 days
95
6% of all-time downloads
All-time downloads
1.5K
Public
Repo size
49.5 GB
Likes
1
Public
Click a slice to open those files.
.gguf34.3 GB · 69%
From the Hugging Face model README
shisa-aiさんが公開しているshisa-v1-qwen2-7bのggufフォーマット変換版です。
make LLAMA_CUDA_FA_ALL_QUANTS=true GGML_CUDA=1
./llama-server -m ./models/shisa-v1-qwen2-7b.Q8_0.gguf -ngl 99 --port 8888 -fa
This is a gguf format conversion of shisa-v1-qwen2-7b published by shisa-ai.
make LLAMA_CUDA_FA_ALL_QUANTS=true GGML_CUDA=1
./llama-server -m ./models/shisa-v1-qwen2-7b.Q8_0.gguf -ngl 99 --port 8888 -fa