Missing Data Error for HadISST in recipe_flato13ipcc_figure_924.yml

[Luyu-H]

I encountered an error while running the recipe recipe_flato13ipcc_figure_924.yml using ESMValTool. The error indicates that no input files were found for the HadISST dataset.

I first downloaded and formatted the corresponding data using the following commands:
esmvaltool data download --config_file esmvaltool/config.yml HadISST
esmvaltool data format --config_file esmvaltool/config.yml HadISST

Despite this, the error persists when execute the recipe:
[126873] ERROR No input files found for Dataset:
{'diagnostic': 'fig09-24',
'variable_group': 'sic',
'dataset': 'HadISST',
'project': 'OBS',
'mip': 'OImon',
'short_name': 'sic',
'alias': 'OBS',
'ensemble': 'r1i1p1',
'exp': 'historical',
'frequency': 'mon',
'long_name': 'Sea Ice Area Fraction',
'modeling_realm': ['seaIce', 'ocean'],
'original_short_name': 'sic',
'preprocessor': 'global_mean_monthly',
'recipe_dataset_index': 23,
'standard_name': 'sea_ice_area_fraction',
'tier': 2,
'timerange': '1960/2005',
'type': 'reanaly',
'units': '%',
'version': 1}

[126873] ERROR Looked for files matching: /esmvaltool/climate_data/Tier2/HadISST/OBS_HadISST_reanaly_1_OImon_sic[_.]*nc

[127302] ERROR Could not create all tasks
[127302] ERROR Missing data for preprocessor fig09-24/sic:
Missing data for Dataset: sic, OImon, OBS, HadISST, historical, r1i1p1, 1
[127302] INFO Maximum memory used (estimate): 0.0 GB
[127302] INFO Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur.
[127302] ERROR Could not create all tasks

How can I ensure that the recipe correctly detects and uses the downloaded data? Are there specific naming conventions or additional steps required to make the data compatible? Any help would be greatly appreciated!

[valeriupredoi]

hi @Luyu-H for CMIP or obs4MIPs data make sure you have search_esgf: when_missing set in your config-user.yml config file, for missing OBS or OBS6 data that won't help though, you'll have to point the Tool to a valid rootpath: OBS: path that points to dir containing OBS datasets; depending where you run the Tool, there are various such data repos on different clusters, or, you can download the needed data yourself, and point the Tool to the dir where you have downloaded it 🍺