Measuring the Impact of AI in QA and Automation | Jaydeep Chakrabarty | Testflix 2025
In this fireside chat with Jaydeep, we’ll dive into how AI is changing the way we measure success in both QA processes and live generative AI bots. On the QA side, we’ll look at cycle time reduction—the “time goalie” metric that shows how quickly we move from discovering a bug to fixing it. We’ll also talk about predictive quality accuracy, which shifts QA from being reactive to proactive by predicting which code changes are most likely to introduce bugs. And of course, we’ll touch on test creation velocity—how much faster teams are able to create meaningful automation with AI’s support.
On the generative AI side, we’ll explore what success really looks like when these bots go live. That means checking task completion rate—did the bot actually help users achieve what they wanted? We’ll also cover user trust score, which combines user satisfaction signals like thumbs up/down with the bot’s error or hallucination rate. Finally, we’ll discuss adoption and retention, the ultimate indicators of long-term value: are people not only trying the bot but also returning to use it again?
#AutomationTesting #TestAutomation #ITindustry #TheTestTribe #Leadership
This video is of one of the sessions presented at #Testflix - World’s Leading Virtual Software Testing Conference.
About the Speaker:
Jaydeep Chakrabarty is currently serving as the Director of AI in Tech at Piramal Capital & Housing Finance Limited, based in Bengaluru, Karnataka. With an extensive 18-year career spanning diverse roles such as Fullstack Developer, Infrastructure Developer, Experience and Visual Designer, Project Manager, Quality Analyst, Security Specialist, and Data Scientist, Jaydeep brings a comprehensive technological perspective to his leadership role.
Connect with Jaydeep on LinkedIn - https://www.linkedin.com/in/jchakrabarty/
Testflix 2025 Proud Sponsors:
Premier Sponsor – BrowserStack: https://www.browserstack.com/
Platinum Sponsor – AutoTester.ai: https://autotester.ai/
Platinum Sponsor – UiPath: https://www.uipath.com/
Gold Sponsor – ACCELQ: https://www.accelq.com/
Gold Sponsor – Sahi Pro: https://www.sahipro.com/
Silver Sponsor – Beeceptor: https://beeceptor.com/
Bronze Sponsor – Baseline11: https://baseline11.com/
Learn from industry experts with Thrive EdSchool courses, grow your network with software testers at The Test Tribe events, and join Asia's largest testing community on Discord.
Upskill yourself with Thrive EdSchool courses: https://bit.ly/thrivettt
Grow your network with software testers with the events at The Test Tribe: https://bit.ly/tttevents
Become a member of Asia's largest testing community: https://bit.ly/3FONxJP
About The Test Tribe:
The Test Tribe is the World’s Largest Software Testing Community turned EdTech Startup. Founded in 2018, our mission is to give the Testing Craft the glory it deserves while empowering testers globally through courses, memberships, cohorts, meetups, hackathons, and global conferences. With 800+ events and 165K+ members across 152+ countries, we’re helping testers collaborate, learn, and grow together.