• March 28, Workshop Program online.
  • March 12, Proceedings available.
  • March 1, Notifications sent.
  • February 8, Prof. Peter McBurney confirmed as invited speaker.
  • February 6, Submissions closed.
  • February 1, Deadline extended until February 5th.
  • December 20, Springer Post-proceedings approved.
  • December 10, ALA-11 site launched.

ALA 2011 - Workshop at AAMAS 2011

Adaptive Learning Agents encompasses diverse fields such as Computer Science, Software Engineering, Biology, as well as Cognitive and Social Sciences. The ALA workshop will focus on agents and multiagent systems which employ learning or adaptation.

This workshop is a continuation of last year's ALA workshop, now in its eleventh year. Previous versions of this workshop may be found at the following urls:

The goal of this workshop is to increase awareness and interest in adaptive agent research, encourage collaboration and give a representative overview of current research in the area of adaptive and learning agents and multiagent systems. It aims at bringing together not only scientists from different areas of computer science (e.g., agent architectures, reinforcement learning, and evolutionary algorithms) but also from different fields studying similar concepts (e.g., game theory, bio-inspired control, mechanism design).

The workshop will serve as an inclusive forum for the discussion on ongoing or completed work in both theoretical and practical issues of adaptive and learning agents and multiagent systems.

This workshop will focus on all aspects of adaptive and learning agents and multiagent systems with a particular emphasis on how to modify established learning techniques and/or create new learning paradigms to address the many challenges presented by complex real-world problems. The topics of interest include but are not limited to:

  • Novel combinations of reinforcement and supervised learning approaches
  • Integrated learning approaches that work with other agent reasoning modules like negotiation, trust models, coordination, etc.
  • Supervised multiagent learning
  • Reinforcement learning (single and multiagent)
  • Planning (single and multiagent)
  • Reasoning (single and multiagent)
  • Distributed learning
  • Adaptation and learning in dynamic environments
  • Evolution of agents in complex environments
  • Co-evolution of agents in a multiagent setting
  • Cooperative exploration and learning to cooperate and collaborate
  • Learning trust and reputation
  • Communication restrictions and their impact on multiagent coordination
  • Design of reward structure and fitness measures for coordination
  • Scaling learning techniques to large systems of learning and adaptive agents
  • Emergent behaviour in adaptive multiagent systems
  • Game theoretical analysis of adaptive multiagent systems
  • Neuro-control in multiagent systems
  • Bio-inspired multiagent systems
  • Applications of adaptive and learning agents and multiagents systems to real world complex systems
  • Learning of Co-ordination

Update: We are excited to announce that Springer has agreed to publish a book in the LNAI series containing revised versions of the best papers from the workshop (after an additional review process).


Paper submissions may be emailed in pdf format to with the subject Submission ALA-11. Submissions may be up to 8 pages in the ACM proceedings format (i.e., the same as AAMAS papers in the main conference track) and will be evaluated for relevance, originality, significance, and clarity in a single blind review by at least 2 PC members. Accepted work will be allocated time for oral presentation during the one day workshop.

Important Dates

  • Submission Deadline
February 5th, 2011 (Note new date)
  • Notification of acceptance:
February 27th, 2011
  • Camera-ready copies:
March 6th, 2011
  • Workshop:
May 2nd, 2011
July 15th, 2011


The ALA workshop will be held at AAMAS 2011, the tenth International Conference on Autonomous Agents and Multiagent Systems which will take place in Taipei, Taiwan.


Registration is handled directly by AAMAS.


The ALA-11 proceedings containing all accepted papers can now be downloaded here.

Session 1 (Chair: Jacob Crandall)

  • 9:00-9:15: Introduction.
  • 9:15-9:40: Common Subspace Transfer for Reinforcement Learning Tasks. Haitham Bou Ammar and Matthew E. Taylor.
  • 9:40-10:05: Basis Function Discovery using Spectral Clustering and Bisimulation Metrics. Gheorghe Comanici and Doina Precup.
  • 10:05-10:30: How Adaptable Are Your Norms? Leveraging Domain Knowledge to Learn Normative Behaviors. Hadi Hosseini and Mihaela Ulieru.

10:30-11:00: Break

Session 2 (Chair: Matthew Taylor)

  • 11:00-11:25: Learning by Demonstration in Repeated Stochastic Games. Jacob W. Crandall, Malek H. Altakrori and Yomna M. Hassan.
  • 11:25-11:50: Solving Delayed Coordination Problems in MAS. Yann-Michael De Hauwere, Peter Vrancx and Ann Nowe.
  • 11:50-12:15: Heterogeneous Populations of Learning Agents in Minority Games. David Catteeuw and Bernard Manderick.
  • 12:15-12:40: A Convergent Multiagent Reinforcement Learning Approach for a Subclass of Cooperative Stochastic Games. Thomas Kemmerich and Hans Kleine Buning.
  • 12:40-12:55: Decreasing Communication Requirements for Agent Specific Rewards in Multiagent Learning. Atil Iscen, Chris HolmesParker and Kagan Tumer.

13:00-14:00: Lunch

Session 3 (Chair: Peter Vrancx)

  • 14:00-15:00: Invited Talk by Prof. Peter McBurney: Co-learning Segmentation in Marketplaces.
  • 15:00-15:15: Using Approach-Avoidance Motivation to Model Adaptive Social-Forces in Artificial Agents. Kathryn E. Merrick, Kamran Shafi and Amitay Isaacs.
  • 15:15-15:30: Learning Models and Metrics for Human-Like Behavior in the Social Ultimatum Game. Yu-Han Chang, Tomer Levinboim and Rajiv Maheswaran.

15:30-16:00: Break

Session 4 (Chair: Karl Tuyls)

  • 16:00-16:25: Multi-Agent Reinforcement Learning for Simulating Pedestrian Navigation. Francisco Martinez-Gil, Miguel Lozano and Fernando Fernández.
  • 16:25-16:40: Ad Hoc Teamwork Modeled with Multi-armed Bandits: An Extension to Discounted Infinite Rewards. Samuel Barrett and Peter Stone.
  • 16:40-16:55: Closing remarks

Program Committee

  • Adrian Agogino, UCSC, NASA Ames Research Center, USA
  • Bikramjit Banerjee, The University of Southern Mississippi, USA
  • Vincent Corruble, University of Paris 6, France
  • Steven de Jong, Maastricht University, The Netherlands
  • Enda Howley, National University of Ireland, Ireland
  • Franziska Klügl, University of Orebro, Sweden
  • W. Bradley Knox, University of Texas at Austin, USA
  • Daniel Kudenko, University of York, UK
  • Ann Nowé, Vrije Universiteit Brussels, Belgium
  • Lynne Parker, University of Tennessee, USA
  • Scott Proper, Oregon State University, USA
  • Michael Rovatsos, University of Edinburgh, UK
  • Sandip Sen, University of Tulsa, USA
  • István Szita, University of Alberta, Canada
  • Kagan Tumer, Oregon State University, USA
  • Karl Tuyls, Maastricht University, The Netherlands
  • Katja Verbeeck, KaHo Sint-Lieven, Belgium
  • Pawel Wawrzynski, Warsaw University of Technology, Poland


This year's workshop is organized by:

Questions about the ALA workshop should be directed to the chairs by email:

Senior Steering Committee Members:
  • Franziska Klügl (University of Orebro, Sweden)
  • Daniel Kudenko (University of York, UK)
  • Ann Nowé (Vrije Universiteit Brussels, Belgium)
  • Lynne E. Parker (University of Tennessee, USA)
  • Sandip Sen (University of Tulsa, USA)
  • Peter Stone (University of Texas at Austin, USA)
  • Kagan Tumer (Oregon State University, USA)
  • Karl Tuyls (Maastricht University, The Netherlands)


For inquiries please feel free to contact the chairs by e-mail: