https://aibussin.com/categories/testing/ Recent content in Testing on AIBussin — AI applications, systems and books Hugo en-US Sun, 04 Oct 2026 09:00:00 +0100 https://aibussin.com/books/pi/41-chapter/ Sun, 04 Oct 2026 09:00:00 +0100 https://aibussin.com/books/pi/41-chapter/ <p>The tests in chapters 36 to 40 all passed. They tell you less than you might hope, and it is worth being exact about what.</p> <p>They show how your <em>code</em> handles the model responses you scripted. They cannot establish how often a real model will produce those responses. A scripted provider can simulate refusals, rambling answers and wrong tool calls, but only when you write those cases into the script. If you stop at green tests, you have not yet measured the stochastic part.</p>