ECOS Paper Analysis Procedure

For the paper co-authored by Valentin Bertsch and Jonas Finke (RUB) entitled ESTIMATION OF STORAGE PARAMETERS FROM WEATHER DATA AND ENERGY SYSTEMS MODELS. Submitted to ECOS-conference (Paris) 2025. https://ecos2025.org/

Directory Structure

The analysis scripts and configuration files are organized as follows:

scripts/
├── df_inspect.py
├── ecos_fig_plots_all.py
├── ecos_fig_plot_1.py
├── ecos_fig_plot_2.py
├── ecos_peak_timeseries_posterior.py
├── ecos_residual_store.py
├── ecos_weather_load_store_n.py
├── plot_overall_comparison.py
├── plot_overall_comparison_residuals.py
├── research_data_management_b_rws_hdf5.py
├── research_data_management_rws_hdf5.py
└── wip_scripts/
    ├── combine_weather.py
    ├── combine_weather_in.yaml
    ├── df_inspect_single.py
    ├── evaluate_all.py
    ├── generate_load_curves.py
    ├── preprocess_weather_data.py
    ├── project_info.yaml
    ├── project_info_residuals.yaml
    ├── residual_in.yaml
    ├── residual_short_in.yaml
    └── weather_in.yaml

Analysis Workflow

Configuration

The analysis is controlled by YAML configuration files:

  • residual_short_in.yaml: Main configuration file for weather data analysis

  • residual_in.yaml: Configuration file for ESM data analysis

In these files the input directories on the specific computer are given. These have to be CHANGED to the actual directories on your computer.

Execution Sequence

For Weather Data Analysis:

  1. Execute preprocess_weather_data.py (scripts/wip_scripts/preprocess_weather_data.py)

  2. Run generate_load_curves.py

  3. Run evaluate_all.py (using the wanted .yaml file)

For ESM Data Analysis:

  1. Let ecos_residual_store.py run (configuration and correct file names must be set in the script)

Results

Analysis results are stored in the Temp/results directory, with subdirectories named by date.

Plots in the Paper

The plots in the paper were made using ‘ecos_fig_plots_all.py’, with the correct file names in the file and some formatting.