This is unholy

I'm having a weird problem with training DQN on minatar (specifically the gymnax version). In space invaders and breakout, my eval metrics are extremely unstable while my train metric is very smooth. See an example of space invaders below (eval left, train right).

Any ideas of what went wrong?

I just learned that this is allowed in Python. Who do I talk to to get this banned?