fun facts
Can one get a deterministic output from an LLM?
Not really. “The response itself depends on the amount of layers offloaded onto the GPU, and your drivers. Basically you can only get the same output with the exact same input with exactly the same setup, that’s consistent, but change […]