Academics / Courses / DescriptionsBME 468: Decision-making in the wild: Measurement and models
VIEW ALL COURSE TIMES AND SESSIONS
Prerequisites
Coding proficiency, ideally Python.Description
A survey of the most recent science and quantitative models of high stakes non-reactive decision making. The class will look at the evolutionary basis of high efficiency rapid learning and decision making in animals, current understanding of mechanisms from the neuroscience and psychology literature, and algorithms to model the phenomena in the low data limit that animals excel in. There will be a significant computational component, in Python
What It's About
The class will be a survey of the most recent science and quantitative models of high stakes non-reactive decision making, focused primarily on non-human mammals and birds. There will be a significant computational component, in Python. Modern artificial intelligence/reinforcement learning (RL) methods do not perform well in high-stakes scenarios where very few data samples may be available. For example, when a “predator” is introduced into a task that an RL agent is learning, state-of-the-art algorithms seek to learn the source of reward prediction error, which in this case means many “lethal” interactions. Yet animals, when a novel predator is introduced, quickly learn through observation, and change tactics. This is one of many sources of an immense learning efficiency gap, and is part of the reason the best RL agents, such as AlphaGo, require five to six orders of magnitude more energy than human go players for similar task performance. The class will look at the evolutionary basis of high efficiency rapid learning and decision making in animals, current understanding of mechanisms from the neuroscience and psychology literature, and algorithms to model the phenomena in the low data limit that animals excel in.
Who Takes It?
Anyone interested in neural engineering and thinking about the larger context of the nervous system. Participants are expected to be comfortable with programming (preferably Python, but competence in other languages should be sufficient).
Mini Syllabus
Contact MacIver for most recent syllabus. Primary graded work is sets of take-home questions on the scientific papers we read, and computational projects centered on analysis of motion capture data of animals engaged in natural behavior, such as prey capture.