Downloads · 30 days
0
RAMoEA-QA
gab62-cam/RAMoEA-QA
RAMoEA-QA is a text generation model from gab62-cam. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
RAMoEA-QA is a hierarchical generative model for Respiratory Audio Question Answering (RA-QA). It supports multiple question formats (open-ended, single-verify, multiple-choice) and both discrete labels (e.g., diagnos…
Access
Public
Updated Feb 4, 2026
Repo size
127 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pth127 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Feb 4, 2026
- Updated
- Feb 4, 2026
- SHA
- 0fdd60f4
Try a prompt
Model card
From the Hugging Face model README
RAMoEA-QA (Checkpoint)
RAMoEA-QA is a hierarchical generative model for Respiratory Audio Question Answering (RA-QA). It supports multiple question formats (open-ended, single-verify, multiple-choice) and both discrete labels (e.g., diagnosis/verification) and continuous targets (regression) within a single system.
Architecture (two-stage conditional specialization):
- Audio Mixture-of-Experts (Audio-MoE): routes each (audio, question) example to one pre-trained audio encoder expert.
- Language Mixture-of-Adapters (MoA): selects one LoRA adapter on a shared frozen LLM backbone (GPT-2) to match query intent and answer format.
Intended use
Research and decision-support experiments on respiratory-audio question-answering. Not a medical device.
Usage
This checkpoint is meant to be used with the accompanying codebase (audio encoder factory + routing + alignment):
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Feb 4, 2026
- Updated
- Feb 4, 2026