ContentVault

ContentVault

Content packs for Lucky Robots. Each pack contains a metadata.yaml, a thumbnail.png, and a .zip with the pack contents.

Clone

git clone https://huggingface.co/luckyrobots/ContentVault

Content Packs

CDN

All content packs are served globally via Cloudflare CDN:

https://contentvault.luckyrobots.com/{PackName}/{filename}

For example:

https://contentvault.luckyrobots.com/Loft/metadata.yaml
https://contentvault.luckyrobots.com/Loft/Loft.zip

How sync works

A Cloudflare Worker (worker/) listens for webhooks from HuggingFace. When a push is made to this repo, the Worker:

1. Parses the commit diff to find changed files
2. Streams each file directly to Cloudflare R2 (no buffering, handles large zip files)
3. Deletes removed files from R2
4. R2 serves the files through Cloudflare's CDN with a 30-day cache at 300+ edge locations worldwide

Worker setup

cd worker
npm install

Secrets (set via wrangler)

npx wrangler secret put HF_WEBHOOK_SECRET
npx wrangler secret put HF_TOKEN

Deploy

npx wrangler deploy

Setup

# Install huggingface_hub with fast upload backend
pip install -U "huggingface_hub[hf_xet]"

# Login (requires write-access token from https://huggingface.co/settings/tokens)
hf auth login

---

CLI Commands

Upload entire folder

hf upload luckyrobots/ContentVault <local-folder> . --commit-message "Your message"

Upload a single pack/subfolder

hf upload luckyrobots/ContentVault <local-folder>/<pack-name> <pack-name> --commit-message "Add <pack-name>"

Upload a single file

hf upload luckyrobots/ContentVault <local-file> <path-in-repo> --commit-message "Add file"

Upload large folder (resumable, multi-threaded, auto-retry)

hf upload-large-folder luckyrobots/ContentVault <local-folder>

Delete files remotely

hf upload luckyrobots/ContentVault . . --include="" --delete="<folder-name>/*" --commit-message "Remove <folder-name>"

---

Tips

• Resumable uploads: upload_large_folder and hf upload-large-folder are resumable. If interrupted, run the same command again.
• Don't use raw git push for large files — use the CLI/API instead. They handle LFS/Xet automatically.
• Write token required: Tokens default to read-only. Enable write access at https://huggingface.co/settings/tokens.
• 50 GB max per file on HuggingFace. Split larger files before uploading.
• Ignore patterns: Use --include and --exclude to filter what gets uploaded.