I wrote a new blog post on using the logit lens to interpret protein language models!

liambai.com/logit-lens/

It has some interactive visualization you can play around with.