Please Note: The main page lists projects via BBSRC Research Theme(s) quoted and then relevant Topic(s).
Cognitive maps for causal learning
Secondary Supervisor(s): Dr Matthew Apps
University of Registration: University of Birmingham
BBSRC Research Themes: Understanding the Rules of Life (Neuroscience and Behaviour, Systems Biology)
Project Outline
It has long been appreciated that humans and other animals form internal models that encode environmental states and the relationship between those states. These representations are commonly referred to as “cognitive maps” and are thought to provide a scaffold for flexible behaviour, giving rise to higher cognitive functions like inference, knowledge transfer, or continual learning that have proven extremely challenging to reverse engineer in artificial intelligence research.
Thus far, research has conceived cognitive maps predominantly as prospective representations that link states in their chronological order to predict future events, e.g., to decide which action is most likely to produce a desired outcome. However, recent work in non-human animals suggests that the brain also forms and uses retrospective representations that link states in their reverse order to infer candidate causes of rare but significant outcomes. Prospective and retrospective maps are computationally distinct and may serve different functions, supporting decisions and learning respectively. However, it is currently unknown how these two types of maps are distinctly represented in the human brain, and how the information they provide is integrated for adaptive behaviour (e.g., if retrospectively inferred causes serve to revise predictive models and/or if prediction errors serve to trigger retrospective information search). This PhD project aims to fill these gaps using a computational cognitive neuroscience approach.
The PhD candidate will develop novel tasks that vary prospective and retrospective action-outcome associations independently (e.g., by changing the frequencies of predictable and unpredictable rewards) and use neuroimaging to identify networks of brain regions that track changes in prospective and retrospective association strength. The project will also examine the information flow between prospective and retrospective maps, and their role in habit formation, maintenance, and extinction, which could have important clinical implications (e.g., in the context of addiction).
The project brings together supervisory expertise in representation learning and brain imaging (Dr Muhle-Karbe), decision neuroscience (Prof Apps), electrophysiology and computational modelling (Dr Froemer). The PhD candidate will receive in-depth training in cutting-edge methods from psychology, neuroscience, and computational science, allowing them to develop a diverse set of valuable skills for a career within or outside of academia.
Interested candidates are encouraged to get in contact (p.muhle-karbe@bham.ac.uk) for informal discussion before submitting an application.
Key references
Behrens, T. E., Muller, T. H., Whittington, J. C., Mark, S., Baram, A. B., Stachenfeld, K. L., & Kurth-Nelson, Z. (2018). What is a cognitive map? Organizing knowledge for flexible behavior. Neuron, 100(2), 490-509.
Jeong, H., Taylor, A., Floeder, J. R., Lohmann, M., Mihalas, S., Wu, B., & Namboodiri, V. M. K. (2022). Mesolimbic dopamine release conveys causal associations. Science, 378(6626), eabq6740.
Muhle-Karbe, P. S., Sheahan, H., Pezzulo, G., Spiers, H. J., Chien, S., Schuck, N. W., & Summerfield, C. (2023). Goal-seeking compresses neural codes for space in the human hippocampus and orbitofrontal cortex. Neuron, 111(23), 3885-3899.
Namboodiri, V. M. K., & Stuber, G. D. (2021). The learning of prospective and retrospective cognitive maps within neural circuits. Neuron, 109(22), 3552-3575.
