Frequently Asked Questions¶
Is there a mailing list?¶
Yes, you can subscribe to the ESMValTool user mailing list and join the discussion on general topics (installation, configuration, etc). See User mailing list.
What is YAML?¶
While .yaml or .yml is a relatively common format, users may not have
encountered this language before. The key information about this format is:
yaml is a human friendly markup language;
yaml is commonly used for configuration files (gradually replacing the venerable
.ini);the syntax is relatively straightforward;
indentation matters a lot (like
Python)!yaml is case sensitive;
More information can be found in the yaml tutorial and yaml quick reference card. ESMValTool uses the yamllint linter tool to check recipe syntax.
Re-running diagnostics¶
If a diagnostic fails, you will get the message
INFO To re-run this diagnostic script, run:
If you run the command in the stdout you will be able to re-run the
diagnostic without having to re-run the whole preprocessor. If you add the -f
argument (available only for Python diagnostics, check your options with --help)
that will force an overwrite, and it will delete not just the failed diagnostic,
but the contents of its work_dir and plot_dir directories - this is useful when needing to
redo the whole work. Adding -i or --ignore-existing will not delete any existing files,
and it can be used to skip work that was already done successfully, provided
that the diagnostic script supports this.
Enter interactive mode with iPython¶
Sometimes it is useful to enter an interactive session to have a look what’s going on.
Insert a single line in the code where you want to enter IPython:
import IPython; IPython.embed()
This is a useful functionality because it allows the user to fix things on-the-fly and after quitting the Ipython console, code execution continues as per normal.
Use multiple config-user.yml files¶
The user selects the configuration yaml file at run time. It’s possible to have several configurations files. For instance, it may be practical to have one config file for debugging runs and another for production runs.
Create a symbolic link to the latest output directory¶
When running multiple times the same recipe, the tool creates separate output directories sorted by the time tag that they were created at; sometimes, when running quite a few times, it is not straightforward to detect which one is the latest output directory, so a symbolic link attached to it would make things more clear e.g.:
recipe_example_20190905_163431
recipe_example_20190905_163519
recipe_example_latest -> recipe_example_20190905_163519
You can do that by running the tool using the latest output as basis and creating a symbolic link to it so it gets picked up at every re-run iteration:
esmvaltool run recipe_example.yml; \
ln -sfT $(ls -1d ~/esmvaltool_output/recipe_example_* | tail -1) ~/esmvaltool_output/recipe_example_latest