Defining Enough: Testing in the GenAI Era | SatParkash Maurya | Testflix 2025 | #testingcommunity
In machine learning, an 85% accurate model is often considered a success because we accept that data is messy, the real world is unpredictable, and chasing perfection is rarely worth the cost. However, in software testing, especially in the GenAI era, the question of “Can we test 100%?” still comes up. With AI systems producing probabilistic outputs where the same input can lead to different results, absolute coverage is unrealistic. Confidence scores already tell us that uncertainty is part of the system, and testing needs to acknowledge that reality.