yujiepan_-_llama-2-tiny-random-8bits

Quantization made by Richard Erkhov.

Github

Discord

Request more models

llama-2-tiny-random - bnb 8bits

• Model creator: https://huggingface.co/yujiepan/
• Original model: https://huggingface.co/yujiepan/llama-2-tiny-random/

Original model description:

library_name: transformers pipeline_tag: text-generation inference: true widget:

• text: Hello! example_title: Hello world group: Python

---

yujiepan/llama-2-tiny-random

This model is randomly initialized, using the config from meta-llama/Llama-2-7b-chat-hf but with the following modifications:

{
  "hidden_size": 8,
  "intermediate_size": 32,
  "num_attention_heads": 2,
  "num_hidden_layers": 1,
  "num_key_value_heads": 2,
}