Deprecated: Assigning the return value of new by reference is deprecated in /www/htdocs/w00b2db9/cake/dispatcher.php on line 157

Deprecated: Assigning the return value of new by reference is deprecated in /www/htdocs/w00b2db9/cake/dispatcher.php on line 221

Deprecated: Assigning the return value of new by reference is deprecated in /www/htdocs/w00b2db9/cake/libs/controller/controller.php on line 308

Deprecated: Assigning the return value of new by reference is deprecated in /www/htdocs/w00b2db9/cake/libs/controller/controller.php on line 347

Deprecated: Assigning the return value of new by reference is deprecated in /www/htdocs/w00b2db9/cake/libs/controller/controller.php on line 535

Deprecated: Assigning the return value of new by reference is deprecated in /www/htdocs/w00b2db9/cake/libs/controller/controller.php on line 805

Deprecated: Assigning the return value of new by reference is deprecated in /www/htdocs/w00b2db9/cake/libs/controller/component.php on line 125

Deprecated: Assigning the return value of new by reference is deprecated in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 681

Deprecated: Assigning the return value of new by reference is deprecated in /www/htdocs/w00b2db9/cake/libs/class_registry.php on line 55

Strict Standards: Non-static method Inflector::camelize() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/dispatcher.php on line 89

Strict Standards: Non-static method Configure::getInstance() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 275

Strict Standards: Non-static method Inflector::underscore() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 289

Strict Standards: Non-static method Inflector::underscore() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/controller/controller.php on line 243

Strict Standards: Non-static method Inflector::classify() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/controller/controller.php on line 246

Strict Standards: Non-static method Inflector::camelize() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 385

Strict Standards: Non-static method Inflector::singularize() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 385

Strict Standards: Non-static method Inflector::getInstance() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 301

Strict Standards: Non-static method Set::pushDiff() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 286

Strict Standards: Non-static method Set::pushDiff() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 287

Strict Standards: Non-static method Set::pushDiff() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 288

Strict Standards: Non-static method Inflector::underscore() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/controller/controller.php on line 247

Strict Standards: Non-static method Configure::getInstance() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 418

Strict Standards: Non-static method Inflector::underscore() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 425

Strict Standards: Non-static method Security::inactiveMins() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/session.php on line 145

Warning: session_start(): Cannot send session cookie - headers already sent by (output started at /www/htdocs/w00b2db9/cake/dispatcher.php:157) in /www/htdocs/w00b2db9/cake/libs/session.php on line 154

Warning: session_start(): Cannot send session cache limiter - headers already sent (output started at /www/htdocs/w00b2db9/cake/dispatcher.php:157) in /www/htdocs/w00b2db9/cake/libs/session.php on line 154

Warning: Cannot modify header information - headers already sent by (output started at /www/htdocs/w00b2db9/cake/dispatcher.php:157) in /www/htdocs/w00b2db9/cake/libs/session.php on line 155

Strict Standards: Non-static method Set::extract() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/session.php on line 291

Strict Standards: Non-static method Set::insert() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/session.php on line 360

Strict Standards: Non-static method Set::extract() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/session.php on line 361

Strict Standards: Non-static method Set::insert() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/session.php on line 360

Strict Standards: Non-static method Set::extract() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/session.php on line 361

Strict Standards: Non-static method Set::insert() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/session.php on line 360

Strict Standards: Non-static method Set::extract() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/session.php on line 361

Strict Standards: Non-static method ClassRegistry::addObject() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 225

Strict Standards: Non-static method ClassRegistry::getInstance() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/class_registry.php on line 66

Strict Standards: Non-static method Inflector::underscore() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 483

Strict Standards: Non-static method Configure::getInstance() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 500

Strict Standards: Non-static method Configure::getInstance() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 362

Strict Standards: Non-static method Inflector::underscore() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 369

Strict Standards: Non-static method Inflector::variable() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 679

Strict Standards: Non-static method Inflector::camelize() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 395

Strict Standards: Non-static method Inflector::underscore() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 395

Strict Standards: Non-static method Configure::getInstance() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 362

Strict Standards: Non-static method Inflector::underscore() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 369

Strict Standards: Non-static method Inflector::variable() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 679

Strict Standards: Non-static method Inflector::camelize() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 395

Strict Standards: Non-static method Inflector::underscore() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 395

Strict Standards: Non-static method Configure::getInstance() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 362

Strict Standards: Non-static method Inflector::underscore() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 369

Strict Standards: Non-static method Inflector::variable() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 679

Strict Standards: Non-static method Inflector::camelize() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 395

Strict Standards: Non-static method Inflector::underscore() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 395

Strict Standards: Non-static method Configure::getInstance() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 362

Strict Standards: Non-static method Inflector::underscore() should not be called statically in /www/htdocs/w00b2db9/cake/basics.php on line 369

Strict Standards: Non-static method Inflector::variable() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 679

Strict Standards: Non-static method Inflector::camelize() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 395

Strict Standards: Non-static method Inflector::underscore() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 395

Strict Standards: Non-static method Inflector::variable() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 679

Strict Standards: Non-static method Inflector::camelize() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 395

Strict Standards: Non-static method Inflector::underscore() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/inflector.php on line 395

Strict Standards: Non-static method Configure::getInstance() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 538

Strict Standards: Non-static method Configure::read() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 405

Strict Standards: Non-static method Configure::getInstance() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/configure.php on line 154

Strict Standards: Non-static method Configure::read() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 597

Strict Standards: Non-static method Configure::getInstance() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/configure.php on line 154
PyBrain

Strict Standards: Non-static method Configure::read() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/view/view.php on line 597

Strict Standards: Non-static method Configure::getInstance() should not be called statically, assuming $this from incompatible context in /www/htdocs/w00b2db9/cake/libs/configure.php on line 154

The FlexCube Environment

State of the art reinforcement learning methods deal with complex, only partial observable and noisy problems. Implementing new ways of reinforcement learning and trying to compare different learning methods, requires a framework that is adequate complex. On the other hand the framework must be fast, so that comparing methods can be done just in time.

The FlexCube Environment provides that: Twelve synchronous, continuous controllable edges provide a complex continuous action space. The spring morphology provides a noisy, partial observable also continuous state space.

Concept

The framework is a test case for all methods that should be capable of handling partial observable Markov decision processes (POMDPs) with mapping from continuous state- to continuous action space. But despite of that principal complexity, the framework is still fast and easy to handle.

Physics and Structure


Passive physics

Random behaviour
Body: masspoints connected with springs
Powers: gravitation and inertia
Friction: total friction
 

Strict Standards: Non-static method Configure::read() should not be called statically in /www/htdocs/w00b2db9/app/webroot/index.php on line 84

Strict Standards: Non-static method Configure::getInstance() should not be called statically in /www/htdocs/w00b2db9/cake/libs/configure.php on line 154