Papers Read

From Jeong-Yoon Lee's Wiki

Contents 1 Motor Adaptation 1.1 Dual Adaptation 1.2 Explicit vs Implicit Motor Adaptation 1.3 Biological Evidence 2 Reinforcement Learning: TD learning 2.1 TD Model 2.2 DA Neural Data

Motor Adaptation

Dual Adaptation

• Hinder MR et al. The efficacy of colour cues i..., Exp Brain Res. 2008

Explicit vs Implicit Motor Adaptation

• Mazzoni P et al. An implicit plan overrides an.., J Neurosci. 2006

Biological Evidence

• Hadipour-Niktarash A et al. Impairment of retention but n.., J Neurosci. 2007
  • TMS disruption of M1 produces more fragile motor memory that shows poor retention
  • No such effect for the disruption of PMd
  • No such effect for the delayed(> 700ms) disruption of M1
  • Processing in M1 contributes to retention in a time-dependent manner, with a strong contribution early in the intertrial interval when there is a high probability of receiving error feedback, and weaker contribution at later times.

• Tseng YW et al. Sensory prediction errors dri.., J Neurophysiol. 2007
  • Only sensory errors were needed for learning, not motor correction.
  • Cerebellum and cerebella cortex -> forward model, kinematics
  • Motor cortex and other motor area -> inverse model, dynamics
  • The cerebellar group qualitatively appears to have lost an initial fast-adaptive component

Reinforcement Learning: TD learning

TD Model

• [Doya K, Neural Comp. 2000]
• [Daw ND et al., Neural Comp. 2003]
• [Bertin M et al., Neural Networks 2007]

DA Neural Data

• [Fiorillo CD et al., Science 2003]
• [Fiorillo CD et al., Nat Neuro 2007]