AI Nondeterminism: Understanding Creativity and Errors #shorts

We were thinking about let's give this thing a name and the name for it is obviously non-determinism. And when you're trying to configure something with natural language, if you are uh if you push your technological level to human interaction level, let's not discuss on how far we reach this level yet, that's not the point. But the point is that there will be uh issues coming up per se with this approach. And one of those issues is non-determinism. One is that non-determinism is a technical thing in those systems. You do have uh non-determinism in there and sometimes even OpenAI doesn't know why it's there, but it's there. So, this is a the tweet from 2022 where like people

were discussing that there seems to be uh non-determinism in certain versions of GPT. And uh they were basically discussing this topic. So, it it is well known that there is from a technological deep technological aspect, there is non-determinism in those systems. It is there, right? And you will actually want it. I mean, it's one of the parameters where you put like the temperature in there as an analogy to like thermodynamics. If it's more hot, it will like wiggle around more and it will do more stuff and be more creative, but at the same time also be more wrong. Exactly. So, and the thing here is that this is actually also the strength of the system, right? The the strength of

the system is that that that it's the strength is not that it is that you cannot measure uh like or that it is non-deterministic, uh but you actually want to to have this. You don't want to have like for one question, you're not necessarily wanting the same answer. You want it to have a human factor. You want to have human interaction. You want to push it to the next level. And that's why you have this non-deterministic behavior inbuilt, so to say, either on one side technically because they sometimes don't understand why and sometimes they do, but that's a problem or maybe not. And on the other hand, you actually want this because it's the strength of the system, right?