2023 journal article

SimOpt: A Testbed for Simulation-Optimization Experiments

INFORMS Journal on Computing.

TL;DR: A major redesign of SimOpt is introduced, a testbed of simulation-optimization (SO) problems and solvers that ports the code to an object-oriented architecture in Python and provides a graphical user interface. (via Semantic Scholar)
Source: ORCID
Added: March 10, 2023

This paper introduces a major redesign of SimOpt, a testbed of simulation-optimization (SO) problems and solvers. The testbed promotes the empirical evaluation and comparison of solvers and aims to accelerate their development. Relative to previous versions of SimOpt, the redesign ports the code to an object-oriented architecture in Python; uses an implementation of the MRG32k3a random number generator that supports streams, substreams, and subsubstreams; supports the automated use of common random numbers for ease and efficiency; includes a powerful suite of plotting tools for visualizing experiment results; uses bootstrapping to obtain error estimates; accommodates the use of data farming to explore simulation models and optimization solvers as their input parameters vary; and provides a graphical user interface. The SimOpt source code is available on a GitHub repository under a permissive open-source license and as a Python package.