Actor-Critic Methods: Two Networks, One Loop
An actor-critic method trains two things at once: a policy that acts, and a value function that predicts how well things are going. The value function is not there to choose actions. It is there to tell the policy which of its results were better than expected. The problem the critic is hired to solve A policy gradient scales each action’s gradient by the return that followed it. That return is a…
We haven't written up this one. Dev.to has the full story — the link below goes straight to it.
