Systems | Development | Analytics | API | Testing

LLM Evaluation and Testing for Reliable AI Apps

As LLMs become central to AI-driven products like copilots and customer support chatbots, data science teams need to ensure the LLM performs well for the use case. The process of LLM evaluation ensures reliability, safety and performance in production AI systems. In this guide, we explore how to approach evaluations across development and production lifecycles, what frameworks to use, and how the integration between open-source MLRun and Evidently AI enables more scalable, structured testing.

Counties Energy Powers The Future With Snowflake's AI Data Cloud

With the help of its technology partner, dataengine, Counties Energy was able to implement the Snowflake AI Data Cloud platform, and now relies on it as the foundational tool for managing the company's operations and growth. Snowflake serves as a solid data foundation that is enabling more employees to make data-driven decisions by using natural language to query complex data.

AI Agent Is Hitting Your APIs - Are You Ready?

It’s no longer theoretical – artificial intelligence has left research labs and entered production systems, generating a new breed of consumers – autonomous and intelligent agents. These autonomous AI agents are increasingly interacting with real-world APIs (application programming interfaces), which are sets of protocols and tools for building and integrating software applications.

How ThoughtSpot turns bold ideas into AI innovation

Innovation isn't a buzzword at ThoughtSpot; it's the lifeblood of our business. It’s woven into our culture, driving us to constantly push boundaries and deliver exceptional value to our customers, our partners, and our team. Recently, I had the privilege of sitting down with a powerhouse panel of senior functional leaders for an “Innovation Spotlight” session. Our goal? To share how bold thinking translates into real-world impact across the many different facets of our organization.

How to Build a Multi-LLM AI Agent with Kong AI Gateway and LangGraph

In the last two parts of this series, we discussed How to Strengthen a ReAct AI Agent with Kong AI Gateway and How to Build a Single-LLM AI Agent with Kong AI Gateway and LangGraph. In this third and final part, we're going to evolve the AI Agent with multiple LLMs and Semantic Routing policies across them. In this blog post, we'll also explore new capabilities introduced in Kong AI Gateway 3.11 that support other GenAI infrastructures.

Kong AI Gateway: Prompt Compression

High token consumption from long prompts can degrade model performance and lead to expensive, inefficient LLM operations. This video demonstrates how to solve that problem using Kong's AI Gateway. AI Prompt Compressor Plugin: See how this plugin intelligently compresses incoming prompts before they hit the model. It summarizes context, removes redundant information, and trims excess tokens—all while preserving the original meaning.This could lead to significant cost savings and improved performance.

Ricoh's AI-Powered Transformation: A Seamless User Experience with ThoughtSpot

Discover how @ricoheurope transformed its user experience with ThoughtSpot Embedded Analytics! In this video, Ricoh's Director of Innovation shares how our developer-friendly embedding creates a seamless, branded look, and how the Spotter AI Agent empowers users to get instant data insights, freeing up internal teams.

AI That Works: The CFO's Guide to Smarter, Faster Finance

The hype around AI in finance is everywhere—but what actually works? In this short video, we explore Agentic Workflows: AI-driven systems that empower CFOs to make faster, smarter decisions without the noise. Learn how insightsoftware is helping finance teams automate intelligently and scale with confidence.