It’s a good point and maybe to start it would be enough to have one benchmark that specifically measures this across a range of queries with repetitions.

I’m extremely impressed with Patrice Gagne. Also excellent editing on the show

The way statistics works…if you do enough studies of the same thing eventually one of them will show the result you’re looking for.

en.wikipedia.org/wiki/Data_dr...

Cool, thanks! It will eventually come to plus tier and I will try it with search

Oh, do you notice a difference in search?

With prices what they are, what are your main use cases?

We know LLMs with private pretraining may have been trained purposefully with bias, but to do so in the system prompt, in real time, in order to avoid press you don’t like? It’s a total joke and bald-faced hypocrisy from the man that rails against closed AI

We are going to see the same thing we do everywhere else: the bifurcation of the English speaking internet into liberal and “conservative” sides, in this case a right wing AI. These tools will serve to further radicalize the right, like TruthSocial and x and other alternative fact zones online

It’s a really stunning discovery. With moves like these, who is going to choose grok to run their business processes?

Here’s the full system prompt: www.reddit.com/r/LocalLLaMA...

It’s gorgeous