Explore your model

Suggest edits


1 - Why explore your model?
2 - OpenMOLE methods

Why explore your model? 🔗

Simulation models are necessarily a simplification of reality, and hypotheses have to be made when developing them. Thus every model needs to be questioned in order to fully understand the extent of its capabilities: Is it relevant to tackle the research question behind it? How to extract significant knowledge from the model? What kind of dynamics can it exhibit? How does each mechanism of the model impact those dynamics? Is every mechanism really necessary?
These are just some of the many questions a model developer has to answer in order to really know and understand his/her model, and OpenMOLE built-in methods are designed to help you answer some of these questions.

Simulation models can be abstracted as a program that transforms a set of inputs into a set of outputs. Any type of data can be used as input for simulation models: locally-defined parameters, pictures, CSV files, DB connections, etc. However, simulation experiments usually revolve around @b{parameter space exploration} (e.g. sensitivity analysis).
Likewise, the outputs generated by simulation experiments are, most of the time, metrics computed on the dynamics produced by a simulation run (e.g. fitness or error functions).

OpenMOLE methods 🔗

There are four types of general questions that can be addressed by OpenMOLE methods:

  1. What are all the possible inputs producing a given output?
    • This is a Calibration or optimization problem, solved with genetic algorithms.

  2. How does an input variation affect the output?

  3. How do the inputs individually participate to produce the outputs? Is every parameter necessary to produce the outputs? What are the robustness intervals of the inputs that lead to a desired output?

  4. What are all the possible outputs of the model?

Methods characteristics 🔗

Each OpenMOLE method is presented with a figure summarizing its performance with regard to a few criteria they all have in common.

image/svg+xml Output Exploration Input Exploration Sensitivity Optimisation optimization efficiency input/output spacecoverage rate ability to revealsensitivity w.r.t. inputs scores scale stochasticityawareness : yes : no : robust : sensitive : average subjection to curse of dimensionality

Nota Bene: These performance scores are defined relatively to each other and are not absolute values.

To go further 🔗