Software

Zephyr

Zephyr is a software for Java to visualize over time the value of code variables. At runtime, Zephyr uses Java reflexivity to parse the code and register objects and data to be visualized. Through a generic graphical user interface, developers can then browse and monitor at different time-scale the data while the code is running. Zephyr is an online debugger particularly suited for simulations, games or online numerical computations.

Short tutorial on Zephyr standalone application:

Link: http://zephyrplugins.github.com

RLPark

RLPark is a Java framework to run reinforcement learning algorithms on robots and benchmarks. RLPark uses Zephyr for visualization and real-time display. It is also compatible with the Eclipse RCP framework.

Demo of RLPark: Sarsa in Mountain car running in Zephyr for visualization

Link: http://rlpark.github.com

SDyna

Sometimes, I have requests for the code I used for Spiti (Degris et al., 2006) and in my PhD. This SDyna package can be used to reproduce all these results.

SDyna learning and acting in the Counter-Strike video game:

Link: sdyna.tar.bz2