"Experimental results on language modeling, common-sense reasoning, genomics,
and time series tasks show that Google Titans are more effective than Transformers […]. They further can effectively scale to larger than 2M context" -> Talking about attention, this news should definitely get attention