{"creation_time": 1632341648, "last_updated": 1632341648, "name": "Pavlovian bias", "definition_text": "Pavlovian bias (also called motivational bias) denotes that phenomenon that \r\n- reward-related cues (eliciting reward anticipation) invigorate action (lead to more active \"Go\" responses and speed up these Go responses)\r\n- punishment-related cues (eliciting punishment anticipation) suppress action (lead to less \"Go\" / more \"NoGo\" responses and slow down Go responses).\r\n\r\nThis phenomenon is often believed to arise based on asymmetric nature of the direct (\"Go\") and indirect (\"NoGo\") pathway in the basal ganglia (Frank, 2005, Collins & Frank, 2014). The direct pathway is assumed to \"gate\" / release actions, while the indirect pathway is believed to suppress/inhibit actions. The direct pathway features more dopamine D1 receptors (activated by high dopamine levels as in positive prediction errors elicited by rewards), while the indirect pathway features more dopamine D2/D3 receptors (activated by low dopamine levels as in negative prediction errors elicited by punishments). Hence, rewards should make the direct pathway more sensitive to input and thus facilitate action release, while punishments should make the indirect pathway more  sensitive to input and thus facilitate action suppression.\r\n\r\nPavlovian biases are typically measured with the motivational go/nogo learning task.\r\nfMRI studies featuring this task having typically not found BOLD signal from the striatum/ basal ganglia to reflect reward vs. punishment anticipation (as predicted by the above basal ganglia model), but instead to reflect the executed response (Go vs. NoGo) (Guitart-Masip et al., 2011; Guitart-Masip, Huys et al., 2012; Guitart-Masip, Chowdhury et al., 2012; Moutoussis et al., 2018; Algermissen et al., 2021). Instead, cue valence (Win vs. Avoid) has been found to be encoded in vmPFC BOLD (positively) and ACC BOLD (negatively).\r\n\r\nPavlovian bias in behavior could arise from a response bias (i.e. reward/ punishment prospects biasing response selection), but also from biased action-outcome learning: A learning bias such that learning of Go responses after reward feedback is enhanced, while unlearning of NoGo responses after punishment feedback is attenuated, will also give rise to motivational biases (Swart et al., 2017, 2018; de Boer et al., 2019).\r\nPavlovian bias has been suggested as a response strategy in face of little control over the environment (Csifcs\u00e1k et al., 2019; Dorfman & Gershman, 2019; Gershman et al., 2021).", "id": "trm_MaWfLaH0xKHTK", "type": "concept", "concepts": [{"creation_time": 1558288760493, "last_updated": 1558288760493, "name": "aversive salience", "definition_text": "attention that confers avoidance behavior to an unpleasant stimulus", "id": "trm_om88i12KUeI1R", "relationship": "KINDOF", "direction": "parent"}, {"id_concept_class": "", "creation_time": 1512660643944, "event_stamp": "2015-07-09T23:56:02", "def_id_user": "usr_51bc76ae9636c", "def_event_stamp": "2015-07-09T23:56:02", "last_updated": 1512660643944, "def_id": "def_559f0a12a4149", "name": "response bias", "alias": "", "definition_text": "A behavioral phenomena for which a participant in an experiment is biased to respond in a particular way.\r\n\r\n** Concepts in the Cognitive Atlas that are more behavioral in nature should be tagged as "behavioral phenomena"", "id_user": "usr_51bc76ae9636c", "id": "trm_559f0a129c136", "relationship": "KINDOF", "direction": "parent"}], "contrasts": [{"creation_time": 1632340974, "last_updated": 1632340974, "name": "Action", "id": "cnt_EpU5mN1GWiNpd", "relationship": "MEASUREDBY", "task_id": "tsk_uzbPk1YB47Iqd"}], "citations": [{"creation_time": 1632342236, "citation_pmid": "", "last_updated": 1632342236, "citation_desc": "Intermittent Absence of Control during Reinforcement Learning Interferes with Pavlovian Bias in Action Selection", "citation_type": "", "citation_url": "https://direct.mit.edu/jocn/article/32/4/646/95397/Intermittent-Absence-of-Control-during", "citation_comment": "", "citation_authors": "G\u00e1bor Csifcs\u00e1k, Eirik Mels\u00e6ter and Matthias Mittner", "citation_pubdate": "2020-04-01", "citation_pubname": "Journal of Cognitive Neuroscience", "name": "Intermittent Absence of Control during Reinforcement Learning Interferes with Pavlovian Bias in Action Selection", "id": "cit_6hFkKJYt3cWDk", "citation_source": "", "doi": "10.1162/jocn_a_01515", "relationship": "HASCITATION"}, {"creation_time": 1632342226, "citation_pmid": "", "last_updated": 1632342226, "citation_desc": "Controllability governs the balance between Pavlovian and instrumental action selection", "citation_type": "", "citation_url": "http://www.nature.com/articles/s41467-019-13737-7", "citation_comment": "", "citation_authors": "Hayley M. Dorfman and Samuel J. Gershman", "citation_pubdate": "2019-12-01", "citation_pubname": "Nature Communications", "name": "Controllability governs the balance between Pavlovian and instrumental action selection", "id": "cit_J85PARBLoEQ0V", "citation_source": "", "doi": "10.1038/s41467-019-13737-7", "relationship": "HASCITATION"}, {"creation_time": 1632342198, "citation_pmid": "", "last_updated": 1632342198, "citation_desc": "Dorsal striatal dopamine D1 receptor availability predicts an instrumental bias in action learning", "citation_type": "", "citation_url": "http://www.pnas.org/lookup/doi/10.1073/pnas.1816704116", "citation_comment": "", "citation_authors": "Lieke de Boer, Jan Axelsson, Rumana Chowdhury, Katrine Riklund, Raymond J. Dolan, Lars Nyberg, Lars B\u00e4ckman and Marc Guitart-Masip", "citation_pubdate": "2019-01-02", "citation_pubname": "Proceedings of the National Academy of Sciences", "name": "Dorsal striatal dopamine D1 receptor availability predicts an instrumental bias in action learning", "id": "cit_FLWTnBKWq0C5Z", "citation_source": "", "doi": "10.1073/pnas.1816704116", "relationship": "HASCITATION"}, {"creation_time": 1632341910, "citation_pmid": "", "last_updated": 1632341910, "citation_desc": "The misbehavior of value and the discipline of the will", "citation_type": "", "citation_url": "https://linkinghub.elsevier.com/retrieve/pii/S0893608006001481", "citation_comment": "", "citation_authors": "Peter Dayan, Yael Niv, Ben Seymour and Nathaniel D. Daw", "citation_pubdate": "2006-10-01", "citation_pubname": "Neural Networks", "name": "The misbehavior of value and the discipline of the will", "id": "cit_QKBpzFCHy2g5o", "citation_source": "", "doi": "10.1016/j.neunet.2006.03.002", "relationship": "HASCITATION"}, {"creation_time": 1632341892, "citation_pmid": "", "last_updated": 1632341892, "citation_desc": "Frontal network dynamics reflect neurocomputational mechanisms for reducing maladaptive biases in motivated action", "citation_type": "", "citation_url": "https://dx.plos.org/10.1371/journal.pbio.2005979", "citation_comment": "", "citation_authors": "Jennifer C. Swart, Michael J. Frank, Jessica I. M\u00e4\u00e4tt\u00e4, Ole Jensen, Roshan Cools, Hanneke E. M. den Ouden and Marios Philiastides", "citation_pubdate": "2018-10-18", "citation_pubname": "PLOS Biology", "name": "Frontal network dynamics reflect neurocomputational mechanisms for reducing maladaptive biases in motivated action", "id": "cit_iLrJ2U0WLDXvf", "citation_source": "", "doi": "10.1371/journal.pbio.2005979", "relationship": "HASCITATION"}, {"creation_time": 1632341882, "citation_pmid": "", "last_updated": 1632341882, "citation_desc": "Catecholaminergic challenge uncovers distinct Pavlovian and instrumental mechanisms of motivated (in)action", "citation_type": "", "citation_url": "https://elifesciences.org/articles/22169", "citation_comment": "", "citation_authors": "Jennifer C Swart, Monja I Frob\u00f6se, Jennifer L Cook, Dirk EM Geurts, Michael J Frank, Roshan Cools and Hanneke EM den Ouden", "citation_pubdate": "2017-05-15", "citation_pubname": "eLife", "name": "Catecholaminergic challenge uncovers distinct Pavlovian and instrumental mechanisms of motivated (in)action", "id": "cit_iQSQXRrZC4TUI", "citation_source": "", "doi": "10.7554/eLife.22169", "relationship": "HASCITATION"}, {"creation_time": 1632341851, "citation_pmid": "", "last_updated": 1632341851, "citation_desc": "Effects of dopamine on reinforcement learning in Parkinson\u2019s disease depend on motor phenotype", "citation_type": "", "citation_url": "https://academic.oup.com/brain/article/143/11/3422/5956227", "citation_comment": "", "citation_authors": "Annelies J van Nuland, Rick C Helmich, Michiel F Dirkx, Heidemarie Zach, Ivan Toni, Roshan Cools and Hanneke E M den Ouden", "citation_pubdate": "2020-11-01", "citation_pubname": "Brain", "name": "Effects of dopamine on reinforcement learning in Parkinson\u2019s disease depend on motor phenotype", "id": "cit_lpbUxZLJKzkDQ", "citation_source": "", "doi": "10.1093/brain/awaa335", "relationship": "HASCITATION"}, {"creation_time": 1632341842, "citation_pmid": "", "last_updated": 1632341842, "citation_desc": "Neural activity and fundamental learning, motivated by monetary loss and reward, are intact in mild to moderate major depressive disorder", "citation_type": "", "citation_url": "https://dx.plos.org/10.1371/journal.pone.0201451", "citation_comment": "", "citation_authors": "Michael Moutoussis, Robb B. Rutledge, Gita Prabhu, Louise Hrynkiewicz, Jordan Lam, Olga-Therese Ousdal, Marc Guitart-Masip, Peter Fonagy, Raymond J. Dolan and Jean Daunizeau", "citation_pubdate": "2018-08-02", "citation_pubname": "PLOS ONE", "name": "Neural activity and fundamental learning, motivated by monetary loss and reward, are intact in mild to moderate major depressive disorder", "id": "cit_dIQFpWSPv7VOf", "citation_source": "", "doi": "10.1371/journal.pone.0201451", "relationship": "HASCITATION"}, {"creation_time": 1632341832, "citation_pmid": "", "last_updated": 1632341832, "citation_desc": "Change, stability, and instability in the Pavlovian guidance of behaviour from adolescence to young adulthood", "citation_type": "", "citation_url": "https://dx.plos.org/10.1371/journal.pcbi.1006679", "citation_comment": "", "citation_authors": "Michael Moutoussis, Edward T. Bullmore, Ian M. Goodyer, Peter Fonagy, Peter B. Jones, Raymond J. Dolan, Peter Dayan and Samuel J. Gershman", "citation_pubdate": "2018-12-31", "citation_pubname": "PLOS Computational Biology", "name": "Change, stability, and instability in the Pavlovian guidance of behaviour from adolescence to young adulthood", "id": "cit_HlGDLQFg4xQDR", "citation_source": "", "doi": "10.1371/journal.pcbi.1006679", "relationship": "HASCITATION"}, {"creation_time": 1632341800, "citation_pmid": "", "last_updated": 1632341800, "citation_desc": "Go and no-go learning in reward and punishment: Interactions between affect and effect", "citation_type": "", "citation_url": "https://linkinghub.elsevier.com/retrieve/pii/S105381191200420X", "citation_comment": "", "citation_authors": "Marc Guitart-Masip, Quentin J.M. Huys, Lluis Fuentemilla, Peter Dayan, Emrah Duzel and Raymond J. Dolan", "citation_pubdate": "2012-08-01", "citation_pubname": "NeuroImage", "name": "Go and no-go learning in reward and punishment: Interactions between affect and effect", "id": "cit_NkVgw96SRtXBo", "citation_source": "", "doi": "10.1016/j.neuroimage.2012.04.024", "relationship": "HASCITATION"}, {"creation_time": 1632341791, "citation_pmid": "", "last_updated": 1632341791, "citation_desc": "Action Dominates Valence in Anticipatory Representations in the Human Striatum and Dopaminergic Midbrain", "citation_type": "", "citation_url": "https://www.jneurosci.org/lookup/doi/10.1523/JNEUROSCI.6376-10.2011", "citation_comment": "", "citation_authors": "M. Guitart-Masip, L. Fuentemilla, D. R. Bach, Q. J. M. Huys, P. Dayan, R. J. Dolan and E. Duzel", "citation_pubdate": "2011-05-25", "citation_pubname": "Journal of Neuroscience", "name": "Action Dominates Valence in Anticipatory Representations in the Human Striatum and Dopaminergic Midbrain", "id": "cit_c6ccUYlZOQTjO", "citation_source": "", "doi": "10.1523/JNEUROSCI.6376-10.2011", "relationship": "HASCITATION"}, {"creation_time": 1632341781, "citation_pmid": "", "last_updated": 1632341781, "citation_desc": "Differential, but not opponent, effects of l-DOPA and citalopram on action learning with reward and punishment", "citation_type": "", "citation_url": "http://link.springer.com/10.1007/s00213-013-3313-4", "citation_comment": "", "citation_authors": "Marc Guitart-Masip, Marcos Economides, Quentin J. M. Huys, Michael J. Frank, Rumana Chowdhury, Emrah Duzel, Peter Dayan and Raymond J. Dolan", "citation_pubdate": "2014-03-01", "citation_pubname": "Psychopharmacology", "name": "Differential, but not opponent, effects of l-DOPA and citalopram on action learning with reward and punishment", "id": "cit_cGDov9wnHLhgW", "citation_source": "", "doi": "10.1007/s00213-013-3313-4", "relationship": "HASCITATION"}, {"creation_time": 1632341768, "citation_pmid": "", "last_updated": 1632341768, "citation_desc": "Action controls dopaminergic enhancement of reward representations", "citation_type": "", "citation_url": "http://www.pnas.org/cgi/doi/10.1073/pnas.1202229109", "citation_comment": "", "citation_authors": "M. Guitart-Masip, R. Chowdhury, T. Sharot, P. Dayan, E. Duzel and R. J. Dolan", "citation_pubdate": "2012-05-08", "citation_pubname": "Proceedings of the National Academy of Sciences", "name": "Action controls dopaminergic enhancement of reward representations", "id": "cit_PDtkNzyJvtFws", "citation_source": "", "doi": "10.1073/pnas.1202229109", "relationship": "HASCITATION"}, {"creation_time": 1632341756, "citation_pmid": "", "last_updated": 1632341756, "citation_desc": "Action versus valence in decision making", "citation_type": "", "citation_url": "https://linkinghub.elsevier.com/retrieve/pii/S1364661314000205", "citation_comment": "", "citation_authors": "Marc Guitart-Masip, Emrah Duzel, Ray Dolan and Peter Dayan", "citation_pubdate": "2014-04-01", "citation_pubname": "Trends in Cognitive Sciences", "name": "Action versus valence in decision making", "id": "cit_JKNoMWfvqYH2f", "citation_source": "", "doi": "10.1016/j.tics.2014.01.003", "relationship": "HASCITATION"}], "conceptclasses": [{"creation_time": 1512660843794, "last_updated": 1512660843794, "display_order": 8, "name": "Motivation", "description": "Motivation", "id": "ctp_C10", "relationship": "CLASSIFIEDUNDER"}], "relationships": [{"id_concept_class": "ctp_C10", "creation_time": 1512660626711, "event_stamp": "2009-06-22T19:12:54", "def_id_user": "usr_49a467bf4e0db", "def_event_stamp": "2012-03-28T15:53:31", "last_updated": 1512660626711, "def_id": "def_4f7333fbe50f4", "name": "appetitive motivation", "alias": "", "definition_text": "behavior directed toward goals that are usually associated with positive hedonic processes.  ", "id_user": "usr_0000000000", "id": "trm_4a3fd79d09877", "relationship": "PARTOF", "direction": "child"}, {"id_concept_class": "", "creation_time": 1512660642327, "event_stamp": "2015-06-12T20:59:03", "def_id_user": "usr_51bc76ae9636c", "def_event_stamp": "2015-09-08T21:43:01", "last_updated": 1512660642327, "def_id": "def_55ef566582fe9", "name": "economic value processing", "alias": "", "definition_text": "the process of comparing, at an idiosyncratic level, the economic value of two or more options.", "id_user": "usr_51bc76ae9636c", "id": "trm_557b4817db34d", "relationship": "PARTOF", "direction": "parent"}, {"creation_time": 1558288760493, "last_updated": 1558288760493, "name": "aversive salience", "definition_text": "attention that confers avoidance behavior to an unpleasant stimulus", "id": "trm_om88i12KUeI1R", "relationship": "KINDOF", "direction": "parent"}, {"id_concept_class": "", "creation_time": 1512660643944, "event_stamp": "2015-07-09T23:56:02", "def_id_user": "usr_51bc76ae9636c", "def_event_stamp": "2015-07-09T23:56:02", "last_updated": 1512660643944, "def_id": "def_559f0a12a4149", "name": "response bias", "alias": "", "definition_text": "A behavioral phenomena for which a participant in an experiment is biased to respond in a particular way.\r\n\r\n** Concepts in the Cognitive Atlas that are more behavioral in nature should be tagged as "behavioral phenomena"", "id_user": "usr_51bc76ae9636c", "id": "trm_559f0a129c136", "relationship": "KINDOF", "direction": "parent"}]}