Javier Masís
banner
jmasis.bsky.social
Javier Masís
@jmasis.bsky.social
postdoc at Princeton University / cognitive science / neuroscience / drums

burneholiday.com
Reposted by Javier Masís
If you've made it this far, thank you! 🙏 Thoughts and comments appreciated.
August 22, 2024 at 3:50 PM
The general model we present could also help understand differences in motivation across individuals (e.g., need for cognition) and clinical conditions (e.g., depression). Why are some people more willing to try to learn than others?
August 22, 2024 at 3:50 PM
– as such they are not solely optimization constraints, but rather should fit inside the optimization as well! Here's an account of this idea w/
@smusslick
onlinelibrary.wiley.com/doi/pdf/10.1...
August 22, 2024 at 3:50 PM
It tells us that theories of mental effort must take into account not just dynamics of the environment but dynamics of the agent. And more specifically, the bidirectional relationship that exists between control and the agent's own state (knowledge, proficiency, etc).
August 22, 2024 at 3:50 PM
So why is this cool? It shows that people modulate their cognitive control based on their learning expectations, and this can happen at a pretty fast timescale (minutes here), and also just beyond awareness (previous pilots found participants weren't sure they had learned!)
August 22, 2024 at 3:50 PM
More precise regression analyses found that all three predicted relationships by the model were present in the data: skill level, learning rate and their interaction all predicted participant deliberation in the predicted directions.
August 22, 2024 at 3:49 PM
We asked whether their willingness to deliberate could be predicted by their levels of improvement before.
Initial fits to average behavior indicated that subjects who learned more were more willing to deliberate longer in a subsequent similar task.
August 22, 2024 at 3:49 PM
Participants first engaged in a learning experience during which we measured their improvement. Participants then engaged in a very similar task during which we measured their willingness to deliberate (proxy for control), even though the task was unsolvable (not known to them).
August 22, 2024 at 3:49 PM
We designed a 2 block dot motion experiment to test these theoretical predictions.
August 22, 2024 at 3:49 PM
The model predicted that as opposed to a greedy model (current reward rate maximization, standard normative objective), a forward looking model would assign control based on skill level, learning rate and their interaction.
August 22, 2024 at 3:48 PM
(The model is essentially a concatenation of two previous models I've worked on with colleagues. The Expected Value of Control for Learning [EVCL] model: escholarship.org/content/qt7w...
And the Learning Drift Diffusion Model [LDDM]:
elifesciences.org/articles/649...)
escholarship.org
August 22, 2024 at 3:48 PM
The model had a control component (with some objective, e.g. maximize total cumulative reward), a processing component (to make decisions, e.g. a DDM), and a learning component.
August 22, 2024 at 3:47 PM
We incorporated these ideas into a model of control allocation grounded in perceptual learning in order to test its predictions empirically.
August 22, 2024 at 3:47 PM
Current theories account for future discounted reward, but they tend to assume proficiency is a stable quantity, not one that is actually dynamically shaped by our mental effort choices. And if this is the case, then learning expectations should in turn affect those choices.
August 22, 2024 at 3:47 PM
We advance that there is no paradox (at least in the case of learning), and this is why:
August 22, 2024 at 3:47 PM
So much so that an "effort paradox" was identified several years ago to try to reconcile situations where people exerted mental effort when it didn't seem to make sense based on our current theories.
sciencedirect.com/science/arti...
a close up of a cat 's face with mathematical equations on it
ALT: a close up of a cat 's face with mathematical equations on it
media.tenor.com
August 22, 2024 at 3:46 PM
And yet this special type of intertemporal choice (where costs and benefits are spread over time) is not readily solvable with current cognitive control theories because it requires engaging in an activity that is both less immediately rewarding and cognitively more effortful.
August 22, 2024 at 3:46 PM
The choice to invest in learning something or engage in familiar activities surrounds us like water surrounds fish. Should I make pasta or learn a new recipe? Should I continue hunting and pecking or learn to type properly? Should I stay in my job or learn new skills?
August 22, 2024 at 3:45 PM