Currently viewing the category: "Study log"

August – September 2011

by admin on September 21, 2011 · 95 Comments

I resume my work on thesis in the end of august by implementing advanced logging into my C++ projects. Then, I wrote a python script so I have infrastructure to collect data from experiments and store them in my “experiments library“. I made several experiments with various parameters of CACLA algorithm and Neural networks architecture [...]

June – July 2011

by admin on July 20, 2011 · 92 Comments

After I finished all my exams and took a rest for a couple of weeks I returned to my master thesis. So what did I do in this period: added separate neural networks that acts as forward and inverse model, which both learns from data gathered during CACLA learning (to reach object). created a C++ [...]

February – March, 2011

by admin on March 8, 2011 · 95 Comments

At the beginning of February I implemented neuralnetworks and reinforcement learning C++ libraries which I use in my iCub application. The most of the time I spent by implementation of the application which uses the CACLA algorithm to train iCub to reach objects. I’m also planning to create some UML package and class diagrams to [...]

December 2010 – January 2011

by admin on January 23, 2011 · 91 Comments

The summary of my work on the thesis during the last 2 months. I read a lot of articles and books about Reinforcement Learning and its (C)ACLA specialized algorithms. I studied pseudocodes and also some C++ implementations of these algorithms (particularly for the maze [discrete space] problem and the cart pole [continuous space] problem). To [...]

iCub Tutorials

by admin on December 23, 2010 · 99 Comments

To get some idea how to build application for the iCub I started to study tutorials which are available in the iCub repository. On 22nd of December I made the first Hello World tutorial, to check whether links to ICUB and YARP libs works and to create the base CMakeLists for other tutorial sources. The [...]