Empirically nondeterministic, at least :) batching + floating point non-commutativity (and disagg serving!) can make it sufficiently difficult to bitwise reproduce logits that 'nondeterministic' is a decent approximation

This article being written by chatGPT isn't just ironic—it's shocking