Downloads · 30 days
12
57% of all-time downloads
OneScience-Group/FengWu
FengWu is a machine learning model from OneScience-Group. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
<p align="center" <strong <span style="font-size: 30px;"FengWu</span </strong </p
Downloads · 30 days
12
57% of all-time downloads
All-time downloads
21
Public
Repo size
—
Likes
0
Public
Click a slice to open those files.
.py34.5 KB · 70%
From the Hugging Face model README
FengWu is a global medium-range weather forecast foundation model jointly released by the Shanghai Artificial Intelligence Laboratory and multiple universities. It has been adopted by organizations such as the Hong Kong Observatory for operational weather forecasting.
Paper: FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Lead
https://arxiv.org/abs/2304.02948
The FengWu model is built on a multi-modal and multi-task deep learning approach, without relying on traditional physical equations. It is trained entirely on ERA5 reanalysis data.
| Scenario | Description |
|---|---|
| Weather Forecast Training | Train FengWu using ERA5 HDF5 data |
| Local Quick Validation | Use synthetic data to verify data loading, model training & inference, and inference result visualization. |
| ModelScope / OneCode Execution | Download as a standalone model package, install dependencies, and run scripts directly. |
| Multi-GPU Training | Launch multi-process training via torchrun. |
Experience intelligent one-click AI4S programming through the OneCode online environment:
Click to Experience Intelligent One-Click AI4S Programming
Hardware Requirements
hf download OneScience-Group/FengWu --local-dir ./FengWu
cd FengWu
DCU Environment
# Please activate DTK and CONDA first
conda create -n onescience311 python=3.11 -y
conda activate onescience311
# uv installation is supported
pip install onescience[earth-dcu] -i http://mirrors.onescience.ai:3141/pypi/simple/ --trusted-host mirrors.onescience.ai
GPU Environment
# Please activate CONDA first
conda create -n onescience311 python=3.11 -y libstdcxx-ng=12 libgcc-ng=12 gcc_linux-64=12 gxx_linux-64=12
conda activate onescience311
# uv installation is supported
pip install onescience[earth-gpu] -i http://mirrors.onescience.ai:3141/pypi/simple/ --trusted-host mirrors.onescience.ai
The OneScience community provides ERA5 data for training (due to file size limits, the current repository contains a slice of the full dataset). Users can download it with the command below and confirm that the data path in conf/config.yaml is set correctly:
hf download --repo-type dataset OneScience-Group/ERA5 --local-dir ./data
Single GPU:
python scripts/train.py
Multi-GPU:
torchrun --nproc_per_node=8 --nnodes=1 --rdzv_id=1000 --rdzv_backend=c10d --max_restarts=0 --master_addr="localhost" --master_port=29500 scripts/train.py
Training will save model_bak.pth under data/checkpoints/.
This repository provides weights trained on 39 years of ERA5 reanalysis data in the weights/ folder. The weight files will be uploaded soon and are expected to be available in the near future.
python scripts/inference.py
Inference results will be saved to result/output/.
python scripts/result.py
You can specify a date and variable at the end of result.py for visualization.
| Platform | OneScience Main Repository | Skills Repository |
|---|---|---|
| Gitee | https://gitee.com/onescience-ai/onescience | https://gitee.com/onescience-ai/oneskills |
| GitHub | https://github.com/onescience-ai/OneScience | https://github.com/onescience-ai/oneskills |