Why does my prompt work sometimes/never?
David McCarthy
•
Last updated on May 15, 2025 at 6:00 PM
There are two reasons for this situation:
- While it may be instinctual to assume there is a bug involved, in these situations it's important to keep in mind that generative AI is designed to create varied responses to mimic natural conversation; this can include variance in how it interprets your words. A general rule of thumb is that the stronger and more 'airtight' a prompt injection is, the less variance the model will display in its output.
- LLMs function by assigning probability scores to 'the most likely' next word in a sentence, in response to what you say to it. This inherently results in randomized, not-so-predictable outcomes from time to time.