From bc71dd6717e1c19b4b96b45f3f991b44451284ca Mon Sep 17 00:00:00 2001 From: Birgit Hassler <33543691+hb326@users.noreply.github.com> Date: Tue, 3 Jun 2025 17:09:58 +0200 Subject: [PATCH 1/3] Update 04-recipe.md Updating the episode to be compatible with Version v2.12.0. File ''example_output.txt'' was also adjusted. --- _episodes/04-recipe.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/_episodes/04-recipe.md b/_episodes/04-recipe.md index b4558521..b4d20abf 100644 --- a/_episodes/04-recipe.md +++ b/_episodes/04-recipe.md @@ -2,7 +2,7 @@ title: "Running your first recipe" teaching: 15 exercises: 15 -compatibility: ESMValTool v2.10.0 +compatibility: ESMValTool v2.12.0 questions: - "How to run a recipe?" @@ -132,8 +132,8 @@ distinguished in the log messages: > > following line in the output: > > > > ``` -> >[134535] INFO These tasks will be executed: map/tas, timeseries/tas_global, ->>timeseries/script1, map/script1, timeseries/tas_amsterdam +> >INFO [3966381] These tasks will be executed: timeseries/script1, +> > timeseries/tas_amsterdam, timeseries/tas_global, map/tas, map/script1 > > ``` > > > > So there are three tasks related to timeseries: global temperature, From 1659f7b326987aa4439615a62a801fb2bd5f4c6a Mon Sep 17 00:00:00 2001 From: Birgit Hassler Date: Tue, 3 Jun 2025 17:14:59 +0200 Subject: [PATCH 2/3] changing the example_output.txt file --- _includes/example_output.txt | 384 ++++++++++++++--------------------- 1 file changed, 151 insertions(+), 233 deletions(-) diff --git a/_includes/example_output.txt b/_includes/example_output.txt index bb04b82c..dc86a051 100644 --- a/_includes/example_output.txt +++ b/_includes/example_output.txt @@ -1,233 +1,151 @@ -> ## Example output -> ->``` -> ->2024-05-15 07:04:08,041 UTC [134535] INFO ->______________________________________________________________________ -> _____ ____ __ ____ __ _ _____ _ -> | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | -> | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | -> | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | -> |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ->______________________________________________________________________ -> ->ESMValTool - Earth System Model Evaluation Tool. -> ->http://www.esmvaltool.org -> ->CORE DEVELOPMENT TEAM AND CONTACTS: -> Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) -> Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) -> Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) -> Lee de Mora (PML, UK - ledm@pml.ac.uk) -> Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) -> Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) -> Bettina Gier (UBremen, Germany - gier@uni-bremen.de) -> Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) -> Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) -> Axel Lauer (DLR, Germany - axel.lauer@dlr.de) -> Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) -> Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) -> Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) -> Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) -> Mattia Righi (DLR, Germany - mattia.righi@dlr.de) -> Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) -> Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) -> Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) -> Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) -> ->For further help, please read the documentation at ->http://docs.esmvaltool.org. Have fun! -> ->2024-05-15 07:04:08,044 UTC [134535] INFO Package versions ->2024-05-15 07:04:08,044 UTC [134535] INFO ---------------- ->2024-05-15 07:04:08,044 UTC [134535] INFO ESMValCore: 2.10.0 ->2024-05-15 07:04:08,044 UTC [134535] INFO ESMValTool: 2.10.0 ->2024-05-15 07:04:08,044 UTC [134535] INFO ---------------- ->2024-05-15 07:04:08,044 UTC [134535] INFO Using config file /pfs/lustrep1/users/username/esmvaltool_tutorial/config-user.yml ->2024-05-15 07:04:08,044 UTC [134535] INFO Writing program log files to: ->/users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/main_log.txt ->/users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/main_log_debug.txt ->2024-05-15 07:04:08,503 UTC [134535] INFO Using default ESGF configuration, configuration file /users/username/.esmvaltool/esgf-pyclient.yml not present. ->2024-05-15 07:04:08,504 UTC [134535] WARNING ->ESGF credentials missing, only data that is accessible without ->logging in will be available. -> ->See https://esgf.github.io/esgf-user-support/user_guide.html ->for instructions on how to create an account if you do not have ->one yet. -> ->Next, configure your system so esmvaltool can use your ->credentials. This can be done using the keyring package, or ->you can just enter them in /users/username/.esmvaltool/esgf-pyclient.yml. -> ->keyring ->======= ->First install the keyring package (requires a supported ->backend, see https://pypi.org/project/keyring/): ->$ pip install keyring -> ->Next, set your username and password by running the commands: ->$ keyring set ESGF hostname ->$ keyring set ESGF username ->$ keyring set ESGF password -> ->To check that you entered your credentials correctly, run: ->$ keyring get ESGF hostname ->$ keyring get ESGF username ->$ keyring get ESGF password -> ->configuration file ->================== ->You can store the hostname, username, and password or your OpenID ->account in a plain text in the file /users/username/.esmvaltool/esgf-pyclient.yml like this: -> ->logon: -> hostname: "your-hostname" -> username: "your-username" -> password: "your-password" -> ->or your can configure an interactive log in: -> ->logon: -> interactive: true -> ->Note that storing your password in plain text in the configuration ->file is less secure. On shared systems, make sure the permissions ->of the file are set so only you can read it, i.e. -> ->$ ls -l /users/username/.esmvaltool/esgf-pyclient.yml -> ->shows permissions -rw-------. -> -> ->2024-05-15 07:04:09,067 UTC [134535] INFO Starting the Earth System Model Evaluation Tool at time: 2024-05-15 07:04:09 UTC ->2024-05-15 07:04:09,068 UTC [134535] INFO ---------------------------------------------------------------------- ->2024-05-15 07:04:09,068 UTC [134535] INFO RECIPE = /LUMI_TYKKY_D1Npoag/miniconda/envs/env1/lib/python3.11/site-packages/esmvaltool/recipes/examples/recipe_python.yml ->2024-05-15 07:04:09,068 UTC [134535] INFO RUNDIR = /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run ->2024-05-15 07:04:09,069 UTC [134535] INFO WORKDIR = /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/work ->2024-05-15 07:04:09,069 UTC [134535] INFO PREPROCDIR = /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/preproc ->2024-05-15 07:04:09,069 UTC [134535] INFO PLOTDIR = /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/plots ->2024-05-15 07:04:09,069 UTC [134535] INFO ---------------------------------------------------------------------- ->2024-05-15 07:04:09,069 UTC [134535] INFO Running tasks using at most 256 processes ->2024-05-15 07:04:09,069 UTC [134535] INFO If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. ->2024-05-15 07:04:09,070 UTC [134535] INFO If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. ->2024-05-15 07:04:09,070 UTC [134535] WARNING Using the Dask basic scheduler. This may lead to slow computations and out-of-memory errors. Note that the basic scheduler may still be the best choice for preprocessor functions that are not lazy. In that case, you can safely ignore this warning. See https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-distributed-configuration for more information. ->2024-05-15 07:04:09,113 UTC [134535] WARNING 'default' rootpaths '/users/username/climate_data' set in config-user.yml do not exist ->2024-05-15 07:04:10,648 UTC [134535] INFO Creating tasks from recipe ->2024-05-15 07:04:10,648 UTC [134535] INFO Creating tasks for diagnostic map ->2024-05-15 07:04:10,648 UTC [134535] INFO Creating diagnostic task map/script1 ->2024-05-15 07:04:10,649 UTC [134535] INFO Creating preprocessor task map/tas ->2024-05-15 07:04:10,649 UTC [134535] INFO Creating preprocessor 'to_degrees_c' task for variable 'tas' ->2024-05-15 07:04:11,066 UTC [134535] INFO Found input files for Dataset: tas, Amon, CMIP6, BCC-ESM1, CMIP, historical, r1i1p1f1, gn, v20181214 ->2024-05-15 07:04:11,405 UTC [134535] INFO Found input files for Dataset: tas, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, v1 ->2024-05-15 07:04:11,406 UTC [134535] INFO PreprocessingTask map/tas created. ->2024-05-15 07:04:11,406 UTC [134535] INFO Creating tasks for diagnostic timeseries ->2024-05-15 07:04:11,406 UTC [134535] INFO Creating diagnostic task timeseries/script1 ->2024-05-15 07:04:11,406 UTC [134535] INFO Creating preprocessor task timeseries/tas_amsterdam ->2024-05-15 07:04:11,406 UTC [134535] INFO Creating preprocessor 'annual_mean_amsterdam' task for variable 'tas_amsterdam' ->2024-05-15 07:04:11,428 UTC [134535] INFO Found input files for Dataset: tas, Amon, CMIP6, BCC-ESM1, CMIP, historical, r1i1p1f1, gn, v20181214 ->2024-05-15 07:04:11,452 UTC [134535] INFO Found input files for Dataset: tas, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, v1 ->2024-05-15 07:04:11,455 UTC [134535] INFO PreprocessingTask timeseries/tas_amsterdam created. ->2024-05-15 07:04:11,455 UTC [134535] INFO Creating preprocessor task timeseries/tas_global ->2024-05-15 07:04:11,455 UTC [134535] INFO Creating preprocessor 'annual_mean_global' task for variable 'tas_global' ->2024-05-15 07:04:11,814 UTC [134535] INFO Found input files for Dataset: tas, Amon, CMIP6, BCC-ESM1, CMIP, historical, r1i1p1f1, gn, v20181214, supplementaries: areacella, fx, 1pctCO2, v20190613 ->2024-05-15 07:04:12,184 UTC [134535] INFO Found input files for Dataset: tas, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, v1, supplementaries: areacella, fx, r0i0p0 ->2024-05-15 07:04:12,186 UTC [134535] INFO PreprocessingTask timeseries/tas_global created. ->2024-05-15 07:04:12,187 UTC [134535] INFO These tasks will be executed: timeseries/script1, timeseries/tas_global, map/script1, map/tas, timeseries/tas_amsterdam ->2024-05-15 07:04:12,204 UTC [134535] INFO Wrote recipe with version numbers and wildcards to: ->file:///users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/recipe_python_filled.yml ->2024-05-15 07:04:12,204 UTC [134535] INFO Will download 129.2 MB ->Will download the following files: ->50.85 KB ESGFFile:CMIP6/CMIP/BCC/BCC-ESM1/1pctCO2/r1i1p1f1/fx/areacella/gn/v20190613/areacella_fx_BCC-ESM1_1pctCO2_r1i1p1f1_gn.nc on hosts ['aims3.llnl.gov', 'cmip.bcc.cma.cn', 'esgf-data04.diasjp.net', 'esgf.nci.org.au', 'esgf3.dkrz.de'] ->64.95 MB ESGFFile:CMIP6/CMIP/BCC/BCC-ESM1/historical/r1i1p1f1/Amon/tas/gn/v20181214/tas_Amon_BCC-ESM1_historical_r1i1p1f1_gn_185001-201412.nc on hosts ['aims3.llnl.gov', 'cmip.bcc.cma.cn', 'esgf-data04.diasjp.net', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf3.dkrz.de'] ->44.4 KB ESGFFile:cmip5/output1/BCC/bcc-csm1-1/historical/fx/atmos/fx/r0i0p0/v1/areacella_fx_bcc-csm1-1_historical_r0i0p0.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf2.dkrz.de'] ->64.15 MB ESGFFile:cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/tas_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf2.dkrz.de'] ->Downloading 129.2 MB.. ->2024-05-15 07:04:14,074 UTC [134535] INFO Downloaded /users/username/climate_data/cmip5/output1/BCC/bcc-csm1-1/historical/fx/atmos/fx/r0i0p0/v1/areacella_fx_bcc-csm1-1_historical_r0i0p0.nc (44.4 KB) in 1.84 seconds (24.09 KB/s) from aims3.llnl.gov ->2024-05-15 07:04:14,109 UTC [134535] INFO Downloaded /users/username/climate_data/CMIP6/CMIP/BCC/BCC-ESM1/1pctCO2/r1i1p1f1/fx/areacella/gn/v20190613/areacella_fx_BCC-ESM1_1pctCO2_r1i1p1f1_gn.nc (50.85 KB) in 1.88 seconds (27 KB/s) from aims3.llnl.gov ->2024-05-15 07:04:20,505 UTC [134535] INFO Downloaded /users/username/climate_data/CMIP6/CMIP/BCC/BCC-ESM1/historical/r1i1p1f1/Amon/tas/gn/v20181214/tas_Amon_BCC-ESM1_historical_r1i1p1f1_gn_185001-201412.nc (64.95 MB) in 8.27 seconds (7.85 MB/s) from aims3.llnl.gov ->2024-05-15 07:04:25,862 UTC [134535] INFO Downloaded /users/username/climate_data/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/tas_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc (64.15 MB) in 13.63 seconds (4.71 MB/s) from aims3.llnl.gov ->2024-05-15 07:04:25,870 UTC [134535] INFO Downloaded 129.2 MB in 13.67 seconds (9.45 MB/s) ->2024-05-15 07:04:25,870 UTC [134535] INFO Successfully downloaded all requested files. ->2024-05-15 07:04:25,871 UTC [134535] INFO Using the Dask basic scheduler. ->2024-05-15 07:04:25,871 UTC [134535] INFO Running 5 tasks using 5 processes ->2024-05-15 07:04:25,956 UTC [144507] INFO Starting task map/tas in process [144507] ->2024-05-15 07:04:25,956 UTC [144522] INFO Starting task timeseries/tas_amsterdam in process [144522] ->2024-05-15 07:04:25,957 UTC [144534] INFO Starting task timeseries/tas_global in process [144534] ->2024-05-15 07:04:26,049 UTC [134535] INFO Progress: 3 tasks running, 2 tasks waiting for ancestors, 0/5 done ->2024-05-15 07:04:26,457 UTC [144534] WARNING Long name changed from 'Grid-Cell Area for Atmospheric Variables' to 'Grid-Cell Area for Atmospheric Grid Variables' ->(for file /users/username/climate_data/CMIP6/CMIP/BCC/BCC-ESM1/1pctCO2/r1i1p1f1/fx/areacella/gn/v20190613/areacella_fx_BCC-ESM1_1pctCO2_r1i1p1f1_gn.nc) ->2024-05-15 07:04:26,461 UTC [144507] WARNING /LUMI_TYKKY_D1Npoag/miniconda/envs/env1/lib/python3.11/site-packages/iris/fileformats/netcdf/saver.py:2670: IrisDeprecation: Saving to netcdf with legacy-style attribute handling for backwards compatibility. ->This mode is deprecated since Iris 3.8, and will eventually be removed. ->Please consider enabling the new split-attributes handling mode, by setting 'iris.FUTURE.save_split_attrs = True'. -> warn_deprecated(message) -> ->2024-05-15 07:04:26,856 UTC [144522] INFO Extracting data for Amsterdam, Noord-Holland, Nederland (52.3730796 °N, 4.8924534 °E) ->2024-05-15 07:04:27,081 UTC [144507] WARNING /LUMI_TYKKY_D1Npoag/miniconda/envs/env1/lib/python3.11/site-packages/iris/fileformats/netcdf/saver.py:2670: IrisDeprecation: Saving to netcdf with legacy-style attribute handling for backwards compatibility. ->This mode is deprecated since Iris 3.8, and will eventually be removed. ->Please consider enabling the new split-attributes handling mode, by setting 'iris.FUTURE.save_split_attrs = True'. -> warn_deprecated(message) -> ->2024-05-15 07:04:27,085 UTC [144534] WARNING /LUMI_TYKKY_D1Npoag/miniconda/envs/env1/lib/python3.11/site-packages/iris/fileformats/netcdf/saver.py:2670: IrisDeprecation: Saving to netcdf with legacy-style attribute handling for backwards compatibility. ->This mode is deprecated since Iris 3.8, and will eventually be removed. ->Please consider enabling the new split-attributes handling mode, by setting 'iris.FUTURE.save_split_attrs = True'. -> warn_deprecated(message) -> ->2024-05-15 07:04:40,666 UTC [144507] INFO Successfully completed task map/tas (priority 1) in 0:00:14.709864 ->2024-05-15 07:04:40,805 UTC [134535] INFO Progress: 2 tasks running, 2 tasks waiting for ancestors, 1/5 done ->2024-05-15 07:04:40,813 UTC [144547] INFO Starting task map/script1 in process [144547] ->2024-05-15 07:04:40,821 UTC [144547] INFO Running command ['/LUMI_TYKKY_D1Npoag/miniconda/envs/env1/bin/python', '/LUMI_TYKKY_D1Npoag/miniconda/envs/env1/lib/python3.11/site-packages/esmvaltool/diag_scripts/examples/diagnostic.py', '/users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/map/script1/settings.yml'] ->2024-05-15 07:04:40,822 UTC [144547] INFO Writing output to /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/work/map/script1 ->2024-05-15 07:04:40,822 UTC [144547] INFO Writing plots to /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/plots/map/script1 ->2024-05-15 07:04:40,822 UTC [144547] INFO Writing log to /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/map/script1/log.txt ->2024-05-15 07:04:40,822 UTC [144547] INFO To re-run this diagnostic script, run: ->cd /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/map/script1; MPLBACKEND="Agg" /LUMI_TYKKY_D1Npoag/miniconda/envs/env1/bin/python /LUMI_TYKKY_D1Npoag/miniconda/envs/env1/lib/python3.11/site-packages/esmvaltool/diag_scripts/examples/diagnostic.py /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/map/script1/settings.yml ->2024-05-15 07:04:40,906 UTC [134535] INFO Progress: 3 tasks running, 1 tasks waiting for ancestors, 1/5 done ->2024-05-15 07:04:47,225 UTC [144522] INFO Extracting data for Amsterdam, Noord-Holland, Nederland (52.3730796 °N, 4.8924534 °E) ->2024-05-15 07:04:47,308 UTC [144534] WARNING /LUMI_TYKKY_D1Npoag/miniconda/envs/env1/lib/python3.11/site-packages/iris/fileformats/netcdf/saver.py:2670: IrisDeprecation: Saving to netcdf with legacy-style attribute handling for backwards compatibility. ->This mode is deprecated since Iris 3.8, and will eventually be removed. ->Please consider enabling the new split-attributes handling mode, by setting 'iris.FUTURE.save_split_attrs = True'. -> warn_deprecated(message) -> ->2024-05-15 07:04:47,697 UTC [144534] INFO Successfully completed task timeseries/tas_global (priority 4) in 0:00:21.738941 ->2024-05-15 07:04:47,845 UTC [134535] INFO Progress: 2 tasks running, 1 tasks waiting for ancestors, 2/5 done ->2024-05-15 07:04:48,053 UTC [144522] INFO Generated PreprocessorFile: /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/preproc/timeseries/tas_amsterdam/MultiModelMean_historical_Amon_tas_1850-2000.nc ->2024-05-15 07:04:48,058 UTC [144522] WARNING /LUMI_TYKKY_D1Npoag/miniconda/envs/env1/lib/python3.11/site-packages/iris/fileformats/netcdf/saver.py:2670: IrisDeprecation: Saving to netcdf with legacy-style attribute handling for backwards compatibility. ->This mode is deprecated since Iris 3.8, and will eventually be removed. ->Please consider enabling the new split-attributes handling mode, by setting 'iris.FUTURE.save_split_attrs = True'. -> warn_deprecated(message) -> ->2024-05-15 07:04:48,228 UTC [144522] INFO Successfully completed task timeseries/tas_amsterdam (priority 3) in 0:00:22.271045 ->2024-05-15 07:04:48,346 UTC [134535] INFO Progress: 1 tasks running, 1 tasks waiting for ancestors, 3/5 done ->2024-05-15 07:04:48,358 UTC [144558] INFO Starting task timeseries/script1 in process [144558] ->2024-05-15 07:04:48,364 UTC [144558] INFO Running command ['/LUMI_TYKKY_D1Npoag/miniconda/envs/env1/bin/python', '/LUMI_TYKKY_D1Npoag/miniconda/envs/env1/lib/python3.11/site-packages/esmvaltool/diag_scripts/examples/diagnostic.py', '/users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/timeseries/script1/settings.yml'] ->2024-05-15 07:04:48,365 UTC [144558] INFO Writing output to /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/work/timeseries/script1 ->2024-05-15 07:04:48,365 UTC [144558] INFO Writing plots to /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/plots/timeseries/script1 ->2024-05-15 07:04:48,365 UTC [144558] INFO Writing log to /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/timeseries/script1/log.txt ->2024-05-15 07:04:48,365 UTC [144558] INFO To re-run this diagnostic script, run: ->cd /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/timeseries/script1; MPLBACKEND="Agg" /LUMI_TYKKY_D1Npoag/miniconda/envs/env1/bin/python /LUMI_TYKKY_D1Npoag/miniconda/envs/env1/lib/python3.11/site-packages/esmvaltool/diag_scripts/examples/diagnostic.py /users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/timeseries/script1/settings.yml ->2024-05-15 07:04:48,447 UTC [134535] INFO Progress: 2 tasks running, 0 tasks waiting for ancestors, 3/5 done ->2024-05-15 07:04:54,019 UTC [144547] INFO Maximum memory used (estimate): 0.4 GB ->2024-05-15 07:04:54,021 UTC [144547] INFO Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ->2024-05-15 07:04:55,174 UTC [144547] INFO Successfully completed task map/script1 (priority 0) in 0:00:14.360271 ->2024-05-15 07:04:55,366 UTC [144558] INFO Maximum memory used (estimate): 0.4 GB ->2024-05-15 07:04:55,368 UTC [144558] INFO Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ->2024-05-15 07:04:55,566 UTC [134535] INFO Progress: 1 tasks running, 0 tasks waiting for ancestors, 4/5 done ->2024-05-15 07:04:56,958 UTC [144558] INFO Successfully completed task timeseries/script1 (priority 2) in 0:00:08.599797 ->2024-05-15 07:04:57,072 UTC [134535] INFO Progress: 0 tasks running, 0 tasks waiting for ancestors, 5/5 done ->2024-05-15 07:04:57,072 UTC [134535] INFO Successfully completed all tasks. ->2024-05-15 07:04:57,134 UTC [134535] INFO Wrote recipe with version numbers and wildcards to: ->file:///users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/run/recipe_python_filled.yml ->2024-05-15 07:04:57,399 UTC [134535] INFO Wrote recipe output to: ->file:///users/username/esmvaltool_tutorial/esmvaltool_output/recipe_python_20240515_070408/index.html ->2024-05-15 07:04:57,399 UTC [134535] INFO Ending the Earth System Model Evaluation Tool at time: 2024-05-15 07:04:57 UTC ->2024-05-15 07:04:57,400 UTC [134535] INFO Time for running the recipe was: 0:00:48.332409 ->2024-05-15 07:04:57,756 UTC [134535] INFO Maximum memory used (estimate): 2.5 GB ->2024-05-15 07:04:57,757 UTC [134535] INFO Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ->2024-05-15 07:04:57,759 UTC [134535] INFO Removing `preproc` directory containing preprocessed data ->2024-05-15 07:04:57,759 UTC [134535] INFO If this data is further needed, then set `remove_preproc_dir` to `false` in your user configuration file ->2024-05-15 07:04:57,782 UTC [134535] INFO Run was successful -> ``` -> -{: .solution} +INFO [3966381] +______________________________________________________________________ + _____ ____ __ ____ __ _ _____ _ + | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | + | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | + | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | + |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| +______________________________________________________________________ + +Earth System Model Evaluation Tool + +A community tool for the evaluation of Earth system models. + +https://esmvaltool.org + +The Earth System Model Evaluation Tool (ESMValTool) is a community +diagnostics and performance metrics tool for the evaluation of Earth +System Models (ESMs) that allows for routine comparison of single or +multiple models, either against predecessor versions or against +observations. + +Tutorial: https://tutorial.esmvaltool.org +Documentation: https://docs.esmvaltool.org +Contact: esmvaltool-dev@listserv.dfn.de + +If you find this software useful for your research, please cite it using +https://doi.org/10.5281/zenodo.3387139 for ESMValCore or +https://doi.org/10.5281/zenodo.3401363 for ESMValTool or +any of the reference papers listed at https://esmvaltool.org/references/. + +Have fun! + +INFO [3966381] Package versions +INFO [3966381] ---------------- +INFO [3966381] ESMValCore: 2.12.0 +INFO [3966381] ESMValTool: 2.12.0 +INFO [3966381] ---------------- +INFO [3966381] Reading configuration files from: +/home/b/b309059/ESMValTool/ESMValCore/esmvalcore/config/configurations/defaults (defaults) +/home/b/b309059/.config/esmvaltool (default user configuration directory) +INFO [3966381] Writing program log files to: +/scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/main_log.txt +/scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/main_log_debug.txt +/scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/cmor_log.txt +INFO [3966381] Starting the Earth System Model Evaluation Tool at time: 2025-06-03 12:01:59 UTC +INFO [3966381] ---------------------------------------------------------------------- +INFO [3966381] RECIPE = /home/b/b309059/ESMValTool/ESMValTool/esmvaltool/recipes/examples/recipe_python.yml +INFO [3966381] RUNDIR = /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run +INFO [3966381] WORKDIR = /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/work +INFO [3966381] PREPROCDIR = /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/preproc +INFO [3966381] PLOTDIR = /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/plots +INFO [3966381] ---------------------------------------------------------------------- +INFO [3966381] Running tasks using at most 256 processes +INFO [3966381] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. +INFO [3966381] If you experience memory problems, try reducing 'max_parallel_tasks' in your configuration. +INFO [3966381] Creating tasks from recipe +INFO [3966381] Creating tasks for diagnostic map +INFO [3966381] Creating diagnostic task map/script1 +INFO [3966381] Creating preprocessor task map/tas +INFO [3966381] Creating preprocessor 'to_degrees_c' task for variable 'tas' +INFO [3966381] Found input files for Dataset: tas, Amon, CMIP6, BCC-ESM1, CMIP, historical, r1i1p1f1, gn, v20181214 +INFO [3966381] Found input files for Dataset: tas, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, v1 +INFO [3966381] PreprocessingTask map/tas created. +INFO [3966381] Creating tasks for diagnostic timeseries +INFO [3966381] Creating diagnostic task timeseries/script1 +INFO [3966381] Creating preprocessor task timeseries/tas_amsterdam +INFO [3966381] Creating preprocessor 'annual_mean_amsterdam' task for variable 'tas_amsterdam' +INFO [3966381] Found input files for Dataset: tas, Amon, CMIP6, BCC-ESM1, CMIP, historical, r1i1p1f1, gn, v20181214 +INFO [3966381] Found input files for Dataset: tas, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, v1 +INFO [3966381] PreprocessingTask timeseries/tas_amsterdam created. +INFO [3966381] Creating preprocessor task timeseries/tas_global +INFO [3966381] Creating preprocessor 'annual_mean_global' task for variable 'tas_global' +INFO [3966381] Found input files for Dataset: tas, Amon, CMIP6, BCC-ESM1, CMIP, historical, r1i1p1f1, gn, v20181214, supplementaries: areacella, fx, 1pctCO2, v20190613 +INFO [3966381] Found input files for Dataset: tas, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, v1, supplementaries: areacella, fx, r0i0p0 +INFO [3966381] PreprocessingTask timeseries/tas_global created. +INFO [3966381] These tasks will be executed: timeseries/script1, timeseries/tas_amsterdam, timeseries/tas_global, map/tas, map/script1 +INFO [3966381] Wrote recipe with version numbers and wildcards to: +file:///scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/recipe_python_filled.yml +WARNING [3966381] /home/b/b309059/ESMValTool/ESMValCore/esmvalcore/config/_dask.py:160: ESMValCoreDeprecationWarning: Usage of Dask configuration file ~/.esmvaltool/dask.yml has been deprecated in ESMValCore version 2.12.0 and is scheduled for removal in version 2.14.0. Please use the configuration option `dask` instead (see https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-configuration for details). Ignoring all existing `dask` configuration options for this run. To enable the new `dask` configuration options, delete or move the file ~/.esmvaltool/dask.yml or set the environment variable ESMVALTOOL_USE_NEW_DASK_CONFIG=1. + warn_if_old_dask_config_exists() + +INFO [3966381] Using Dask distributed scheduler (address: tcp://10.128.10.130:41935, dashboard link: http://10.128.10.130:8787/status) +INFO [3966381] Running 5 tasks using 5 processes +INFO [3966381] Progress: 3 tasks running, 2 tasks waiting for ancestors, 0/5 done +INFO [3967058] Starting task map/tas in process [3967058] +INFO [3967062] Starting task timeseries/tas_amsterdam in process [3967062] +INFO [3967064] Starting task timeseries/tas_global in process [3967064] +INFO [3967062] Extracting data for Amsterdam, Noord-Holland, Nederland (52.3730796 °N, 4.8924534 °E) +INFO [3967062] Extracting data for Amsterdam, Noord-Holland, Nederland (52.3730796 °N, 4.8924534 °E) +INFO [3967062] Generated PreprocessorFile: /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/preproc/timeseries/tas_amsterdam/MultiModelMean_historical_Amon_tas_1850-2000.nc +INFO [3967062] Computing and saving data for preprocessing task timeseries/tas_amsterdam +INFO [3967062] timeseries/tas_amsterdam [ ] | 0% Completed | 10.18 s +INFO [3967062] timeseries/tas_amsterdam [ ] | 0% Completed | 20.24 s +INFO [3967062] timeseries/tas_amsterdam [ ] | 0% Completed | 30.31 s +INFO [3967062] timeseries/tas_amsterdam [ ] | 0% Completed | 40.38 s +INFO [3967062] timeseries/tas_amsterdam [ ] | 0% Completed | 50.42 s +INFO [3967062] timeseries/tas_amsterdam [ ] | 0% Completed | 60.47 s +INFO [3967062] timeseries/tas_amsterdam [####### ] | 18% Completed | 70.54 s +INFO [3967062] timeseries/tas_amsterdam [####### ] | 18% Completed | 80.55 s +INFO [3967062] timeseries/tas_amsterdam [########################################] | 100% Completed | 90.56 s +INFO [3967058] Computing and saving data for preprocessing task map/tas +INFO [3967062] Successfully completed task timeseries/tas_amsterdam (priority 3) in 0:01:33.741823 +INFO [3966381] Progress: 2 tasks running, 2 tasks waiting for ancestors, 1/5 done +INFO [3967058] map/tas [########################################] | 100% Completed | 2.24 s +INFO [3967064] Computing and saving data for preprocessing task timeseries/tas_global +INFO [3967058] Successfully completed task map/tas (priority 1) in 0:01:36.040206 +INFO [3966381] Progress: 1 tasks running, 2 tasks waiting for ancestors, 2/5 done +INFO [3967066] Starting task map/script1 in process [3967066] +INFO [3967066] Running command ['/work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12', '/home/b/b309059/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py', '/scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/map/script1/settings.yml'] +INFO [3967066] Writing output to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/work/map/script1 +INFO [3967066] Writing plots to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/plots/map/script1 +INFO [3967066] Writing log to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/map/script1/log.txt +INFO [3967066] To re-run this diagnostic script, run: +cd /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/map/script1; MPLBACKEND="Agg" /work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12 /home/b/b309059/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/map/script1/settings.yml +INFO [3966381] Progress: 2 tasks running, 1 tasks waiting for ancestors, 2/5 done +INFO [3967064] timeseries/tas_global [########################################] | 100% Completed | 2.08 s +INFO [3967064] Successfully completed task timeseries/tas_global (priority 4) in 0:01:38.392573 +INFO [3966381] Progress: 1 tasks running, 1 tasks waiting for ancestors, 3/5 done +INFO [3967068] Starting task timeseries/script1 in process [3967068] +INFO [3967068] Running command ['/work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12', '/home/b/b309059/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py', '/scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1/settings.yml'] +INFO [3967068] Writing output to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/work/timeseries/script1 +INFO [3967068] Writing plots to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/plots/timeseries/script1 +INFO [3967068] Writing log to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1/log.txt +INFO [3967068] To re-run this diagnostic script, run: +cd /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1; MPLBACKEND="Agg" /work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12 /home/b/b309059/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1/settings.yml +INFO [3966381] Progress: 2 tasks running, 0 tasks waiting for ancestors, 3/5 done +INFO [3967066] Maximum memory used (estimate): 0.3 GB +INFO [3967066] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. +INFO [3967068] Maximum memory used (estimate): 0.3 GB +INFO [3967068] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. +INFO [3967066] Successfully completed task map/script1 (priority 0) in 0:00:28.351139 +INFO [3966381] Progress: 1 tasks running, 0 tasks waiting for ancestors, 4/5 done +INFO [3967068] Successfully completed task timeseries/script1 (priority 2) in 0:00:26.597442 +INFO [3966381] Progress: 0 tasks running, 0 tasks waiting for ancestors, 5/5 done +INFO [3966381] Successfully completed all tasks. +INFO [3966381] Wrote recipe with version numbers and wildcards to: +file:///scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/recipe_python_filled.yml +INFO [3966381] Wrote recipe output to: +file:///scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/index.html +INFO [3966381] It looks like you are connected to a remote machine via SSH. To show the output html file, you can try the following command on your local machine: +server=136.172.124.1 && port=31415 && ssh -t -L ${port}:localhost:${port} b309059@${server} /work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12 -m http.server ${port} -d /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145 +Then visit http://localhost:31415 in your browser +INFO [3966381] If the port 31415 is already in use, you can replace it with any other free one (e.g., 12789). If you are connected through a jump host, replace the server IP address 136.172.124.1 with your SSH server name +INFO [3966381] Ending the Earth System Model Evaluation Tool at time: 2025-06-03 12:04:12 UTC +INFO [3966381] Time for running the recipe was: 0:02:12.411071 +INFO [3966381] Maximum memory used (estimate): 2.2 GB +INFO [3966381] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. +WARNING [3966381] Input data is not (fully) CMOR-compliant, see /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/cmor_log.txt for details +INFO [3966381] Run was successful +WARNING [3966381] /home/b/b309059/ESMValTool/ESMValCore/esmvalcore/_main.py:441: ESMValCoreDeprecationWarning: Usage of Dask configuration file ~/.esmvaltool/dask.yml has been deprecated in ESMValCore version 2.12.0 and is scheduled for removal in version 2.14.0. Please use the configuration option `dask` instead (see https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-configuration for details). Ignoring all existing `dask` configuration options for this run. To enable the new `dask` configuration options, delete or move the file ~/.esmvaltool/dask.yml or set the environment variable ESMVALTOOL_USE_NEW_DASK_CONFIG=1. + From 9b3120ddac8f489f0867aa62446916d2f3859aeb Mon Sep 17 00:00:00 2001 From: Birgit Hassler Date: Tue, 3 Jun 2025 17:28:35 +0200 Subject: [PATCH 3/3] changing the pathnames to something more anonymous in the example_output.txt file --- _includes/example_output.txt | 56 ++++++++++++++++++------------------ 1 file changed, 28 insertions(+), 28 deletions(-) diff --git a/_includes/example_output.txt b/_includes/example_output.txt index dc86a051..f9961e21 100644 --- a/_includes/example_output.txt +++ b/_includes/example_output.txt @@ -36,19 +36,19 @@ INFO [3966381] ESMValCore: 2.12.0 INFO [3966381] ESMValTool: 2.12.0 INFO [3966381] ---------------- INFO [3966381] Reading configuration files from: -/home/b/b309059/ESMValTool/ESMValCore/esmvalcore/config/configurations/defaults (defaults) -/home/b/b309059/.config/esmvaltool (default user configuration directory) +/home/user/username/ESMValTool/ESMValCore/esmvalcore/config/configurations/defaults (defaults) +/home/user/username/.config/esmvaltool (default user configuration directory) INFO [3966381] Writing program log files to: -/scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/main_log.txt -/scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/main_log_debug.txt -/scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/cmor_log.txt +/scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/main_log.txt +/scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/main_log_debug.txt +/scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/cmor_log.txt INFO [3966381] Starting the Earth System Model Evaluation Tool at time: 2025-06-03 12:01:59 UTC INFO [3966381] ---------------------------------------------------------------------- -INFO [3966381] RECIPE = /home/b/b309059/ESMValTool/ESMValTool/esmvaltool/recipes/examples/recipe_python.yml -INFO [3966381] RUNDIR = /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run -INFO [3966381] WORKDIR = /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/work -INFO [3966381] PREPROCDIR = /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/preproc -INFO [3966381] PLOTDIR = /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/plots +INFO [3966381] RECIPE = /home/user/username/ESMValTool/ESMValTool/esmvaltool/recipes/examples/recipe_python.yml +INFO [3966381] RUNDIR = /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run +INFO [3966381] WORKDIR = /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/work +INFO [3966381] PREPROCDIR = /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/preproc +INFO [3966381] PLOTDIR = /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/plots INFO [3966381] ---------------------------------------------------------------------- INFO [3966381] Running tasks using at most 256 processes INFO [3966381] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. @@ -75,8 +75,8 @@ INFO [3966381] Found input files for Dataset: tas, Amon, CMIP5, bcc-csm1-1, h INFO [3966381] PreprocessingTask timeseries/tas_global created. INFO [3966381] These tasks will be executed: timeseries/script1, timeseries/tas_amsterdam, timeseries/tas_global, map/tas, map/script1 INFO [3966381] Wrote recipe with version numbers and wildcards to: -file:///scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/recipe_python_filled.yml -WARNING [3966381] /home/b/b309059/ESMValTool/ESMValCore/esmvalcore/config/_dask.py:160: ESMValCoreDeprecationWarning: Usage of Dask configuration file ~/.esmvaltool/dask.yml has been deprecated in ESMValCore version 2.12.0 and is scheduled for removal in version 2.14.0. Please use the configuration option `dask` instead (see https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-configuration for details). Ignoring all existing `dask` configuration options for this run. To enable the new `dask` configuration options, delete or move the file ~/.esmvaltool/dask.yml or set the environment variable ESMVALTOOL_USE_NEW_DASK_CONFIG=1. +file:///scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/recipe_python_filled.yml +WARNING [3966381] /home/user/username/ESMValTool/ESMValCore/esmvalcore/config/_dask.py:160: ESMValCoreDeprecationWarning: Usage of Dask configuration file ~/.esmvaltool/dask.yml has been deprecated in ESMValCore version 2.12.0 and is scheduled for removal in version 2.14.0. Please use the configuration option `dask` instead (see https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-configuration for details). Ignoring all existing `dask` configuration options for this run. To enable the new `dask` configuration options, delete or move the file ~/.esmvaltool/dask.yml or set the environment variable ESMVALTOOL_USE_NEW_DASK_CONFIG=1. warn_if_old_dask_config_exists() INFO [3966381] Using Dask distributed scheduler (address: tcp://10.128.10.130:41935, dashboard link: http://10.128.10.130:8787/status) @@ -87,7 +87,7 @@ INFO [3967062] Starting task timeseries/tas_amsterdam in process [3967062] INFO [3967064] Starting task timeseries/tas_global in process [3967064] INFO [3967062] Extracting data for Amsterdam, Noord-Holland, Nederland (52.3730796 °N, 4.8924534 °E) INFO [3967062] Extracting data for Amsterdam, Noord-Holland, Nederland (52.3730796 °N, 4.8924534 °E) -INFO [3967062] Generated PreprocessorFile: /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/preproc/timeseries/tas_amsterdam/MultiModelMean_historical_Amon_tas_1850-2000.nc +INFO [3967062] Generated PreprocessorFile: /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/preproc/timeseries/tas_amsterdam/MultiModelMean_historical_Amon_tas_1850-2000.nc INFO [3967062] Computing and saving data for preprocessing task timeseries/tas_amsterdam INFO [3967062] timeseries/tas_amsterdam [ ] | 0% Completed | 10.18 s INFO [3967062] timeseries/tas_amsterdam [ ] | 0% Completed | 20.24 s @@ -106,23 +106,23 @@ INFO [3967064] Computing and saving data for preprocessing task timeseries/ta INFO [3967058] Successfully completed task map/tas (priority 1) in 0:01:36.040206 INFO [3966381] Progress: 1 tasks running, 2 tasks waiting for ancestors, 2/5 done INFO [3967066] Starting task map/script1 in process [3967066] -INFO [3967066] Running command ['/work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12', '/home/b/b309059/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py', '/scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/map/script1/settings.yml'] -INFO [3967066] Writing output to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/work/map/script1 -INFO [3967066] Writing plots to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/plots/map/script1 -INFO [3967066] Writing log to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/map/script1/log.txt +INFO [3967066] Running command ['/work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12', '/home/user/username/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py', '/scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/map/script1/settings.yml'] +INFO [3967066] Writing output to /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/work/map/script1 +INFO [3967066] Writing plots to /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/plots/map/script1 +INFO [3967066] Writing log to /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/map/script1/log.txt INFO [3967066] To re-run this diagnostic script, run: -cd /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/map/script1; MPLBACKEND="Agg" /work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12 /home/b/b309059/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/map/script1/settings.yml +cd /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/map/script1; MPLBACKEND="Agg" /work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12 /home/user/username/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/map/script1/settings.yml INFO [3966381] Progress: 2 tasks running, 1 tasks waiting for ancestors, 2/5 done INFO [3967064] timeseries/tas_global [########################################] | 100% Completed | 2.08 s INFO [3967064] Successfully completed task timeseries/tas_global (priority 4) in 0:01:38.392573 INFO [3966381] Progress: 1 tasks running, 1 tasks waiting for ancestors, 3/5 done INFO [3967068] Starting task timeseries/script1 in process [3967068] -INFO [3967068] Running command ['/work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12', '/home/b/b309059/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py', '/scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1/settings.yml'] -INFO [3967068] Writing output to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/work/timeseries/script1 -INFO [3967068] Writing plots to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/plots/timeseries/script1 -INFO [3967068] Writing log to /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1/log.txt +INFO [3967068] Running command ['/work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12', '/home/user/username/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py', '/scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1/settings.yml'] +INFO [3967068] Writing output to /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/work/timeseries/script1 +INFO [3967068] Writing plots to /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/plots/timeseries/script1 +INFO [3967068] Writing log to /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1/log.txt INFO [3967068] To re-run this diagnostic script, run: -cd /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1; MPLBACKEND="Agg" /work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12 /home/b/b309059/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1/settings.yml +cd /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1; MPLBACKEND="Agg" /work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12 /home/user/username/ESMValTool/ESMValTool/esmvaltool/diag_scripts/examples/diagnostic.py /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/timeseries/script1/settings.yml INFO [3966381] Progress: 2 tasks running, 0 tasks waiting for ancestors, 3/5 done INFO [3967066] Maximum memory used (estimate): 0.3 GB INFO [3967066] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. @@ -134,18 +134,18 @@ INFO [3967068] Successfully completed task timeseries/script1 (priority 2) in INFO [3966381] Progress: 0 tasks running, 0 tasks waiting for ancestors, 5/5 done INFO [3966381] Successfully completed all tasks. INFO [3966381] Wrote recipe with version numbers and wildcards to: -file:///scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/recipe_python_filled.yml +file:///scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/recipe_python_filled.yml INFO [3966381] Wrote recipe output to: -file:///scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/index.html +file:///scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/index.html INFO [3966381] It looks like you are connected to a remote machine via SSH. To show the output html file, you can try the following command on your local machine: -server=136.172.124.1 && port=31415 && ssh -t -L ${port}:localhost:${port} b309059@${server} /work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12 -m http.server ${port} -d /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145 +server=136.172.124.1 && port=31415 && ssh -t -L ${port}:localhost:${port} b309059@${server} /work/bd0854/b309059/utils/mambaforge/envs/esmvaltool/bin/python3.12 -m http.server ${port} -d /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145 Then visit http://localhost:31415 in your browser INFO [3966381] If the port 31415 is already in use, you can replace it with any other free one (e.g., 12789). If you are connected through a jump host, replace the server IP address 136.172.124.1 with your SSH server name INFO [3966381] Ending the Earth System Model Evaluation Tool at time: 2025-06-03 12:04:12 UTC INFO [3966381] Time for running the recipe was: 0:02:12.411071 INFO [3966381] Maximum memory used (estimate): 2.2 GB INFO [3966381] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. -WARNING [3966381] Input data is not (fully) CMOR-compliant, see /scratch/b/b309059/esmvaltool_output/recipe_python_20250603_120145/run/cmor_log.txt for details +WARNING [3966381] Input data is not (fully) CMOR-compliant, see /scratch/user/username/esmvaltool_output/recipe_python_20250603_120145/run/cmor_log.txt for details INFO [3966381] Run was successful -WARNING [3966381] /home/b/b309059/ESMValTool/ESMValCore/esmvalcore/_main.py:441: ESMValCoreDeprecationWarning: Usage of Dask configuration file ~/.esmvaltool/dask.yml has been deprecated in ESMValCore version 2.12.0 and is scheduled for removal in version 2.14.0. Please use the configuration option `dask` instead (see https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-configuration for details). Ignoring all existing `dask` configuration options for this run. To enable the new `dask` configuration options, delete or move the file ~/.esmvaltool/dask.yml or set the environment variable ESMVALTOOL_USE_NEW_DASK_CONFIG=1. +WARNING [3966381] /home/user/username/ESMValTool/ESMValCore/esmvalcore/_main.py:441: ESMValCoreDeprecationWarning: Usage of Dask configuration file ~/.esmvaltool/dask.yml has been deprecated in ESMValCore version 2.12.0 and is scheduled for removal in version 2.14.0. Please use the configuration option `dask` instead (see https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-configuration for details). Ignoring all existing `dask` configuration options for this run. To enable the new `dask` configuration options, delete or move the file ~/.esmvaltool/dask.yml or set the environment variable ESMVALTOOL_USE_NEW_DASK_CONFIG=1.