Below is a list of R markdown files that output each figure. - Figure 1: illustaration_actor_critic_Qlearning_fit.Rmd - Figure 2: actor_critic_simulation_constant_V.Rmd - Figure 3: actor_critic_reward_impact_diagram.Rmd - Figure 4: actor_critic_simulation_varying_alpha.Rmd - Figure 5: actor_critic_Qlearning_fit_alpha_cv_normalized_ll.Rmd - Figure 6A: actor_critic_Qlearning_fit_parameter_correspondence_varying_alpha.Rmd - Figure 6B: actor_critic_Qlearning_fit_parameter_correspondence_varying_policy_rate.Rmd - Figure 7,8: initial_value_effects_actor_critic_Qlearning.Rmd - Figure 9: actor_critic_simulation_varying_alpha_asymmetry.Rmd - Figure 10: actor_critic_simulation_varying_policy_asymmetry.Rmd - Figure 11A: actor_critic_Qlearning_fit_parameter_correspondence_varying_alpha_asymmetry.Rmd - Figure 11B: actor_critic_Qlearning_fit_parameter_correspondence_varying_policy_rate_asymmetry.Rmd - Figure 12: actor_critic_Qlearning_model_recovery.Rmd - Figure 13: actor_critic_parameter_recoverly.Rmd - Figure 14: Qlearning_actor_critic_fit_parameter_correspondence.Rmd