Yailen Martinez

I am a PhD student working at the Computational Modeling Lab on a 4-year research project. My research interests are located in the domain of Multi-Agent Reinforcement Learning and Scheduling problems.

• [2011] Y. Martínez, A. Nowé, R. Bello and J. Suárez, “A Reinforcement Learning Approach for the Flexible Job Shop Scheduling Problem, Proceedings of the Fifth International Conference on Learning and Intelligent Optimization (LION5). Lecture Notes in Computer Science, Volume 6683, pp. 253-262, 2011, ISBN: 978-3-642-25565-6.

• [2010] Y. Martínez, B. Van Vreckem, D. Catteeuw and A. Nowé, “Application of Learning Automata for Stochastic Online Scheduling,” in Recent Advances in Optimization and its Applications in Engineering, Springer Berlin Heidelberg, 2010, pp. 491-498, ISBN:978-3-642-12598-0.

• [2008] A. Puris, R. Bello, Y. Trujillo, A. Nowé, Y. Martínez. “Two-Stage ACO to Solve the Job Shop Scheduling Problem”. Lecture Notes in Computer Science. Springer Berlin/Heidelberg. Book “Progress in Pattern Recognition, Image Analysis and Applications”. Volume 4756/2008. Pages 447-456. ISBN 978-3-540-76724-4.

• [2008] L. Rodriguez, G. Casas, R. Grau, Y. Martínez. “Fuzzy Scan Method to Detect Clusters”, IJBBMS-International Journal of Biological, Biomedical and Medical Sciences, Volume 3 Number 2, Spring 2008, Article #16.

• [2007] A. Puris, R. Bello, Y. Martínez, A. Nowé. “Two-Stage Ant Colony Optimization for Solving the Travelling Salesman Problem”. Lecture Notes in Computer Science. Springer Berlin/Heidelberg. Book “Nature Inspired Problem-Solving Methods in Knowledge Engineering”. Volume 4528/2007. Pages 307-316. ISBN 978-3-540-73054-5.

• [2006] A. Puris, R. Bello, A. Nowé, Y. Martínez, M. García. “Two Step Ant Colony System to Solve the Feature Selection Problem”. Lecture Notes in Computer Science. Springer Berlin/Heidelberg. Book “Progress in Pattern Recognition, Image Analysis and Applications”. Volume 4225/2006. Pages 588-596.

• [2006] A. Puris, R. Bello, Y. Martínez, A. Nowé. “Two-Stage Ant Colony System for solving the Traveling Salesman Problem”. Poster Included in a special issue of the journal: Research in Computing Science, 2006, ISSN 1870-4069.

• [2011] Y. Martínez, A. Nowé, J. Suárez and R. Bello, “Solution to the Flexible Job Shop Scheduling Problem using Reinforcement Learning,” in Proceedings of the 14th International Convention and Fair Informatica 2011, ISBN:978-959-7213-01-7.

• [2011] Y. Martínez, J. Suárez and R. Bello, “Herramienta para la ejecución de algoritmos de aprendizaje reforzado aplicados a la solución de problemas de secuenciación,” in Proceedings of the Conference Compumat 2011, ISBN:978-959-250-658-9.

• [2010] E. Kaddoum, Y. Martínez, T. Wauters, K. Verbeeck, A. Nowe, P. De Causmaecker, G. Vanden Berghe, Marie-Pierre Gleizes, Jean-Pierre Georgé, “Adaptive methods for flexible job shop scheduling with due-dates, release-dates and machine perturbations” Workshop on Self-tuning, self-configuring and self-generating search heuristics (Self* 2010), Krakow, Poland, 2010.

• [2010] P. De Causmaecker, K. Verbeeck, T. Wauters, Y. Martinez, Scalable decentralised approaches for job shop scheduling. Proceedings of the 24th European Conference on Operational Research EURO XXIV, Lisbon, 11-14 July 2010, Abstract No. TF-28-4.

• [2010] T. Wauters, Y. Martínez, P. De Causmaecker, A. Nowe, K. Verbeeck, “Reinforcement Learning approaches for the Parallel Machines Job Shop Scheduling Problem”, itec2010 - A look at the neighbours: interdisciplinary approaches to adaptive learning. International conference on interdisciplinary research on technology, education and communication, Kortrijk, 25-27 May 2010.

• [2010] Y. Martínez, T. Wauters, P. De Causmaecker, A. Nowe, K. Verbeeck, R. Bello, J. Suarez, “Reinforcement Learning approaches for the Parallel Machines Job Shop Scheduling Problem” in Proceedings of the Cuba-Flanders Workshop on Machine Learning and Knowledge Discovery, Santa Clara, Cuba, 2010, ISBN: 9789592505742.

• [2009] Y. Martínez, A. Nowe, “A Multi-Agent learning approach for the Job Shop Scheduling Problem,” in Proceedings of the 23rd European Conference on Operational Research, Bonn, Germany, 2009.

• [2009] Y. Martínez, B. Van Vreckem and D. Catteeuw, “Multi-Stage Scheduling Problem with Parallel Machines,” in Book of Abstracts of the 14th Belgian-French-German Conference on Optimization, Leuven, 2009, ISBN: 9789073802001.

• [2008] J. Suarez, Y. Martínez. “Propuesta de solución al problema de secuenciación en múltiples máquinas utilizando la metaheurística ACO”, IV Conferencia Científica de la Universidad de Ciencias Informáticas, UCIENCIA 2008, ISBN: 978-959-286-007-0.

• [2006] A. Puris, R. Bello, Y. Martínez, A. Nowé. “Improving Ant Colony Optimization to solve the Traveling Salesman Problem”. Proceedings of 18th Benelux Conference on Artificial Intelligence (BNAIC 2006).

• [2008, Master after Master Thesis] Y. Martínez. “A Multi-Agent Learning approach for the Job Shop Scheduling Problem”, Vrije Universiteit Brussel, VUB, Belgium.

• [2007, Master Thesis] Y. Martínez. “Aplicación de métodos heurísticos en la solución de problemas de configuración”, Universidad Central de Las Villas, UCLV, Cuba.

• [2011] European Workshop on Reinforcement Learning. September 9-11, Athens, Greece, 2011.
• [2011] ACAI Summer School on Automated Planning and Scheduling, ACAI'11. Freiburg, Germany, June 7-10, 2011.
• [2011] Symposium “OR problems and AI techniques”, March 2011, KULAK, Kortrijk.
• [2011] Learning and Intelligent OptimizatioN, LION 5, January 17-21, 2011, Rome, Italy.
• [2010] 11th International Conference on Parallel Problem Solving from Nature (PPSN) / Workshop on Self-tuning, self-configuring and self-generating search heuristics (Self* 2010), Krakow, Poland, September 11-15, 2010.
• [2010] Cuba-Flanders Workshop on Machine Learning and Knowledge Discovery, Santa Clara, Cuba, February 5-8, 2010.
• [2009] Summer School: Advanced Course in Artificial Intelligence, ACAI'09, Belfast, August 23-29, 2009.
• [2009] 14th Belgian-French-German Conference on Optimization, Leuven, September 14-18, 2009.
• [2009] 23rd European Conference on Operational Research, Bonn, Germany, July 5-8, 2009.
• [2009] Eight International Conference on Autonomous Agents and Multiagent Systems, Budapest, Hungary, May 10-15, 2009.
• [2008] Doctor Honoris Causa, Louvain-La-Neuve, Belgium, 08/10/2008
• [2007] TAAME 07 - Theory And Applications of MEtaheuristics - Tutorial Day, KaHo Sint Lieven, Gent, Belgium, 13/11/2007
• [2007] “Biologically inspired robotics: From evolving to self replicating and self repairing machines”, Iridia - ULB, Belgium, 25/09/2007