Downloads · 30 days
8
2% of all-time downloads
METAGENE-1-BnB-4Bit
metagene-ai/METAGENE-1-BnB-4Bit
METAGENE-1-BnB-4Bit is a machine learning model from metagene-ai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
METAGENE-1 is a 7-billion-parameter autoregressive transformer language model, which we refer to as a metagenomic foundation model, that was trained on a novel corpus of diverse metagenomic DNA and RNA sequences compr…
All-time downloads
446
Public
Parameters
6.7B
3.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.4 GB · 100%
Parameter types
How the weights are stored.
U86.7B · 100%
Base models
Model card
From the Hugging Face model README
METAGENE-1-BnB-4Bit
Model Information
METAGENE-1 is a 7-billion-parameter autoregressive transformer language model, which we refer to as a metagenomic foundation model, that was trained on a novel corpus of diverse metagenomic DNA and RNA sequences comprising over 1.5 trillion base pairs. This dataset is sourced from a large collection of human wastewater samples, processed and sequenced using deep metagenomic (next-generation) sequencing methods. Unlike genomic models that focus on individual genomes or curated sets of specific species, the aim of METAGENE-1 is to capture the full distribution of genomic information present across the human microbiome. After pretraining, this model is designed to aid in tasks in the areas of biosurveillance, pandemic monitoring, and pathogen detection.
This repository contains metagene-ai/METAGENE-1-BnB-4Bit quantized using bitsandbytes from BF16 down to NF4 with a block size of 64, and storage type torch.bfloat16.
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jan 8, 2025
- Updated
- Feb 25, 2025