That’s a fun example for MCP! Maybe let people text it (?) 😀

note: was pointed at www.swebench.com

Whether that can be applied in anyone else's configuration... well, I'm looking for a reliable source of information that is not just one or two people's story, and coming up empty.

Everyone seems to have a story of 'I found x works better', which was probably true for them given a particular configuration (model, parameters, system prompt, targeted codebase language/size/shape, context size, assistant tool).

Does it recording screen recording permission?

That is one of my current nits with the bartender app that does something similar.

Like any metric, it can be gamed... but this particular one is _even more opaque_ than most, since contributions to a private repo are shown in that graph and you can't drill into the detail.

I mean.... this one looks real, right?

Note: icon is from their media kit which can found here: drive.google.com/drive/folder...