Skip to content

WeatherBench2 indexes #131

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tennlee merged 28 commits into from
Jul 8, 2025
Merged

WeatherBench2 indexes #131

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
747a05e
add a data accessor for one of the WeatherBench2 datasets
jennan May 28, 2025
44cb8ce
create more generic class for WeatherBench2 datasets
jennan Jun 5, 2025
c051a8d
allow using one class for multiple resolutions
jennan Jun 9, 2025
7683596
add full ERA5 dataset
jennan Jun 9, 2025
a9f1b76
add ERA5 climatology (WIP)
jennan Jun 10, 2025
8fc5a6c
simpler code using spellcheck_prompt function instead of decorator
jennan Jun 23, 2025
4e26079
save dataset infos as a dictionary of tuples
jennan Jun 23, 2025
4b743a5
create automatically the dataset infos module
jennan Jun 23, 2025
70f2228
Merge branch 'develop' into weatherbench
jennan Jun 23, 2025
51f8788
fix pre-commit formatting issues
jennan Jun 23, 2025
709bbdf
add docs for chunk parameters
jennan Jun 30, 2025
1a5101e
add option to download dataset (WIP)
jennan Jun 30, 2025
36f4a12
try to load from download_dir first then download if needed
jennan Jun 30, 2025
333f54c
pin zarr version to v2
jennan Jun 30, 2025
d38f0f1
add logging on save/loading
jennan Jul 1, 2025
e16f96d
display in logs storage used by downloaded dataset
jennan Jul 1, 2025
7245425
fix sample for climatology data
jennan Jul 1, 2025
59c0929
add docs about the download_dir
jennan Jul 1, 2025
bd1422d
separate code to download variable and increase logging (progress bar)
jennan Jul 7, 2025
c9fcc87
ensure logs are printed to console if nothing has been configured
jennan Jul 7, 2025
1be378e
add weatherbench classes in docs
jennan Jul 7, 2025
978278a
Merge branch 'develop' into weatherbench
jennan Jul 8, 2025
26fab64
convert data pipeline notebook to use weatherbench accessor
jennan Jul 8, 2025
f22a662
fix formatting for precommit check
jennan Jul 8, 2025
5b8c05a
document constructors parameters
jennan Jul 8, 2025
988eafc
add missing resolutions in constructors
jennan Jul 8, 2025
a37900a
add link to parent class for parameter definitions
jennan Jul 8, 2025
eff369a
fix rendering of class documentation
jennan Jul 8, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions docs/api/data/data_api.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,15 @@
:no-value:
.. autodata:: pyearthtools.data.download.arcoera5.SHORT_NAMES
:no-value:
.. autoclass:: pyearthtools.data.download.weatherbench.WeatherBench2
:class-doc-from: both
:members:
.. autoclass:: pyearthtools.data.download.weatherbench.WB2ERA5
:class-doc-from: both
:members:
.. autoclass:: pyearthtools.data.download.weatherbench.WB2ERA5Clim
:class-doc-from: both
:members:
```

## `data.indexes`
Expand Down
2 changes: 2 additions & 0 deletions docs/api/data/data_index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,8 @@ The rest of this page contains reference information for the components of the D
| | | - [AdvancedTimeDerivedValue](data_api.md#pyearthtools.data.derived.AdvancedTimeDerivedValue) |
| | | - [Insolation](data_api.md#pyearthtools.data.derived.Insolation) |
| `data.download` | Publicly available datasets | - [ARCOERA5](data_api.md#pyearthtools.data.download.arcoera5.ARCOERA5) |
| | | - [WB2ERA5](data_api.md#pyearthtools.data.download.weatherbench.WB2ERA5) |
| | | - [WB2ERA5Clim](data_api.md#pyearthtools.data.download.weatherbench.WB2ERA5Clim) |
| `data.indexes` | | - [Index](data_api.md#pyearthtools.data.indexes.Index) |
| | | - [DataIndex](data_api.md#pyearthtools.data.indexes.DataIndex) |
| | | - [FileSystemIndex](data_api.md#pyearthtools.data.indexes.FileSystemIndex) |
Expand Down
Loading