Projects
Data Science with Keras
Data Science with Keras
2017 - 2018
- Solve a collection of Data Science projects using Artificial Neural Networks based on projects from Udacity, Coursera, and Kaggle GitHub
- Topics: data processing, visualization, DNN/CNN/RNN Modeling, NLP
- Resources: Jupyter, Pandas, Numpy, Seaborn, TensorFlow, Keras, and Scikit-learn
RL-ROBOT: Reinforcement Learning framework for Robotics
RL-ROBOT: Reinforcement Learning framework for Robotics
2015 - 2016
- Implemented a practical Reinforcement Learning framework from scratch for easy experimentation with simulated and real robots in V-REP and ROS GitHub
- Applied a value-iteration-based method to several robotic tasks with a novel algorithm that improves softmax action selection by structuring the inputs
- The resulted Reinforcement Learning method enhances model-free solutions with minimal task knowledge
- It is also compatible with high-dimensional Reinforcement Learning with low computational cost
Contributions to Remote Optimal, Adaptive Control of Mobile Robots
Contributions to Remote Optimal, Adaptive Control of Mobile Robots
2012 - 2015
- Developed a full-stack system with a novel graphical interface and sensors-actuators (real and simulated) modules for controlling mobile robots Project Log
- Includes a hierarchical regulator of sensor data transmission for networked telerobots
- Also includes a functional collaborative navigation system for path following in real and simulated robots
Teaching Reinforcement Learning with Lego Mindstorms NXT
Teaching Reinforcement Learning with Lego Mindstorms NXT
2012 - 2015
- Studied the viability of Reinforcement Learning methods in small robots Project Log
- Designed a minimal framework that adapts value-based Reinforcement Learning algorithms in a Mindstorms NXT mobile robot
- Focused on applicability and flexibility to perform several academic tasks
- Later used in mini-projects for MSc students of cognitive robotics, thus improving the teaching experience