Downloads · 30 days
25
12% of all-time downloads
metagene-ai/METAGENE-1-AWQ-4Bit
METAGENE-1-AWQ-4Bit is a machine learning model from metagene-ai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
METAGENE-1 is a 7-billion-parameter autoregressive transformer language model, which we refer to as a metagenomic foundation model, that was trained on a novel corpus of diverse metagenomic DNA and RNA sequences compr…
Downloads · 30 days
25
12% of all-time downloads
All-time downloads
217
Public
Parameters
6.5B
3.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.4 GB · 100%
How the weights are stored.
I326.5B · 100%
From the Hugging Face model README
METAGENE-1 is a 7-billion-parameter autoregressive transformer language model, which we refer to as a metagenomic foundation model, that was trained on a novel corpus of diverse metagenomic DNA and RNA sequences comprising over 1.5 trillion base pairs. This dataset is sourced from a large collection of human wastewater samples, processed and sequenced using deep metagenomic (next-generation) sequencing methods. Unlike genomic models that focus on individual genomes or curated sets of specific species, the aim of METAGENE-1 is to capture the full distribution of genomic information present across the human microbiome. After pretraining, this model is designed to aid in tasks in the areas of biosurveillance, pandemic monitoring, and pathogen detection.
This repository contains metagene-ai/METAGENE-1-AWQ-4Bit quantized using AutoAWQ from BF16 down to 4Bit with a group size 128.