The amount of effort that is going into working around the fact that only Siri can respond to voice on an iPhone is incredible. Imagine the innovation we would have had by now if users could pick whatever service they wanted.

There will be a nasty feedback loop of companies being less interested in hiring junior engineers because of increased automation, and then finding that the ones they do hire aren't very good.

Schools that can build a reputation early on of actually teaching folks to program will benefit.

youtubetranscriptoptimizer.com/blog/05_the_... has some thoughts. It's super long, but search for "Multi-head Latent Attention".