arrow_upward
favorite
Are you interested in joining this workshop?
Let us know by clicking on the heart!
Thank you for your interest!
We look forward to seeing you there.
people0 people reacted.
background

RemembeRL: what can past experience tell us about our current action?

public Workshop
CoRL 2025
location_on COEX Convention & Exhibition Center
Seoul, South Korea
event Saturday
September 27th, 2025
schedule Start: 9.30 AM
End: 4.40 PM

Robot learning traditionally relies on applications of machine learning methods via the induction paradigm, i.e. where the agent extrapolates a policy in the form of a condensed, unified model given a set of training data. Under this formulation, training data is therefore discarded at test time, and the agent may no longer explicitly reason on past experience to inform its current action. In other words, the agent is not allowed to remember previous situations.
However, we observe that humans are able to conveniently recall past experiences to solve decision making problems, and notice a close connection with recent trends towards in-context learning, meta-learning, and retrieval-augmented inference in the Reinforcement Learning (RL) and Imitation Learning (IL) literature.

In this workshop, we investigate how robot learning algorithms can be designed for robotic agents to explicitly retrieve, reason, attend, or leverage on past experience to quickly adapt to previously unseen situations or bootstrap their learning.
Recent advances in the field allow agents to remember by framing the problem as in-context learning and meta-learning, e.g. by incorporating memory in the form of explicit, contextual input to a policy. Similarly, recent works propose retrieval mechanisms (retrieval-augmented policies) for agents to conveniently reason about the current action based on previous experience.

We then raise the question: "Should robots know, or remember how to act?"

Our objective is to understand the interconnection between the fields of in-context learning, meta-learning, transductive and retrieval-augmented inference for robot learning applications. In this context, we aim to discuss about recent contributions, challenges, opportunities and novel directions for future research.

help_outline Open questions for the community

  • Should robotic agents know or remember how to act?
  • How can past experience be integrated implicitly or explicitly in RL and IL algorithms?
  • Does reasoning on past experience improve agent performance even for tasks that do not require memory?
  • Can agents generalize their memory over unseen data and tasks? (e.g. in-context learning with OOD contexts)
  • What are the interconnections between in-context learning, meta-learning, and retrieval-based approaches?
In-context learning Meta learning Transductive inference Retrieval-augmented policies Memory-based policies Non-parametric policies Episodic memory & control

Invited Speakers

TBD

Stephen James

Imperial College London
In person
Sim-to-Real Transfer Generative models
TBD

Chelsea Finn

Stanford University
In person
In-context Learning Meta-Learning
TBD

Abhishek Gupta

University of Washington
In person
Retrieval-augmented policies Robot learning
TBD

Gunhee Kim

Seoul National University
In person
In-context RL Web/GUI Agent Control
Edward Johns

Edward Johns

Imperial College London
In person · Tentative
In-context Learning Retrieval-augmented policies
Amanda Prorok

Amanda Prorok

University of Cambridge
In person · Tentative
Memory-based policies Recurrent Neural Networks
Hung Le

Hung Le

Deakin University
Remote
Memory-based policies Recurrent Neural Networks

Program

9:20 - 9:30 AM Welcome
Opening remarks and introduction
9:30 - 10:00 AM Invited Talk 1
TBD
Title TBA
10:00 - 10:30 AM Invited Talk 2
TBD
Title TBA
10:30 - 11:30 AM Break Poster Session 1
Coffee break + Poster Session 1
11:30 - 12:00 PM Invited Talk 3
TBD
Title TBA
12:00 - 12:30 PM Invited Talk 4
TBD
Title TBA
12:30 - 1:30 PM Break
Lunch
1:30 - 2:00 PM Invited Talk 5
TBD
Title TBA
2:00 - 2:30 PM Invited Talk 6
TBD
Title TBA
2:30 - 3:15 PM Break Poster Session 2
Coffee break + Poster Session 2
3:15 - 3:45 PM Poster Spotlights
Presentations from selected posters
3:45 - 4:30 PM Panel Discussion
First last1, First last2, First last3

forum Questions for discussion:

  • Should robots know, or remember how to act?
  • Can we, will we, should we give robots a memory?
  • Is transduction the new promise for embodied intelligence?
  • What about the opportunities of memory-based approaches in terms of interpretability and explainability?
  • What are the current bottlenecks in scaling memory-based approaches for complex robot learning tasks?
+ questions from the audience
4:30 - 4:40 PM Closing
Final remarks & award(s)

Organizers

Gabriele Tiboni

Gabriele Tiboni

University of Würzburg
public gabrieletiboni.com · Main organizer
Federico Ceola

Federico Ceola

Italian Institute of Technology (IIT)
Yat Long Lo

Yat Long Lo

Amazon
Wenyan Yang

Wenyan Yang

Aalto University
Vivienne Wang

Vivienne Wang

Aalto University
Carlo D'Eramo

Carlo D'Eramo

University of Würzburg

Advisory Board

Georgia Chalvatzaki

Georgia Chalvatzaki

TU Darmstadt
Tatiana Tommasi

Tatiana Tommasi

Politecnico di Torino

Call for Papers

event_note

Coming Soon