Each stage starts from the best checkpoint of the one before.
Figure 3: Two imitation stages, then two reinforcement-learning stages, first on the teachers' traces and then on the model's own attempts.