AGI Experimental Framework

We’re very excited to launch AGI Experimental Framework, AGIEF, our open source framework.

We first introduced it a while back, at the end of 2015 here, and it has certainly come a long way.

AGIEF was created to make running rigorous AI experiments convenient, reproducible and scalable. The goals are:

• Repeatability: ability to save/load, stop/start an experiment from any execution step, and know that it will execute deterministically
• Visualisation: ability to visualise all the data structures at any step
• Distributed operation for performance

The Github wiki and Readme describe the project in detail and how to get started.

The framework comprises 3 repositories.

agi — Java project comprising core algorithmic code and framework package to support compute nodes.

run-framework — Python scripts to run and interact with the compute nodes covering aspects such as generating input files, launching cloud infrastructure, running those experiments (locally or remotely), executing parameter sweeps and exporting and uploading the output artefacts.

experiment-definitions — contains the experiment definitions, the files required to run and repeat specific experiments.

Originally published at Project AGI.