Downloads · 30 days
8
38% of all-time downloads
schmidttheo/retrieval
retrieval is a machine learning model from schmidttheo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository is a compact, custom PyTorch implementation of Hybrid for Retrieval. The xlarge configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-read…
Downloads · 30 days
8
38% of all-time downloads
All-time downloads
21
Public
Parameters
33.1K
133 KB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors133 KB · 93%
From the Hugging Face model README
This repository is a compact, custom PyTorch implementation of Hybrid for Retrieval. The xlarge configuration is intended for code review, smoke tests, and small controlled experiments rather than as a production-ready pretrained release.
config.json records the generated architecture settings.training_args.json records the default experiment recipe.model.safetensors is a valid initialization checkpoint for smoke tests; it is not presented as a trained benchmark checkpoint.| Item | Value |
|---|---|
| Architecture | Hybrid |
| Scale | xlarge |
| Attention | grouped query |
| Fusion | cross attention |
| Activation | relu |
| Normalization | batchnorm |
The included configuration uses rmsprop with a polynomial schedule. These are starting values in the script, not evidence of a completed run. For a meaningful evaluation, train all baselines with the same data exposure, tuning budget, and random seeds.
python inference.py --help
Inspect the script's __main__ block for its generated smoke-test example. Because this is a custom implementation, generic automatic loading APIs require an explicit adapter before use.
A useful first evaluation would use Flickr30k, report the task metric across at least three seeds, and include a matched-capacity baseline. Keep training logs and environment versions with any published result.
The initialization checkpoint has not been trained or audited for robustness, fairness, or domain transfer. The implementation should be treated as an experimental starting point. Results from a future trained checkpoint must be documented separately from the defaults shipped here.
inference.py — primary artifactREADME.md — this documentationconfig.json — architecture configurationtraining_args.json — default experiment settingsmodel.safetensors — initialization checkpointReleased under apache-2.0. Review the source-data terms separately when this repository is used with external datasets.