Systems | Development | Analytics | API | Testing

Chatbots are quickly becoming more sophisticated and integrated into business workflows, enhancing productivity and scalability. However, they also expand the attack surface for organizations. This new exploitation vector requires data engineers and security teams to incorporate various security guardrails when building their gen AI architecture. In this blog post, we discuss the risk of data leakage through AI chatbots.

We are proud to announce a new integration between MLRun, the open-source AI orchestration framework, and NVIDIA NeMo microservices, by extending NVIDIA Data Flywheel Blueprint. This integration streamlines training, evaluation, fine-tuning and monitoring of AI models at scale, ensuring high-performance, low latency and lowering costs while significantly reducing the manual effort required through intelligent automation.

In less than three years, gen AI has become a staple technology in the business world. In November of 2022, OpenAI launched ChatGPT, with explosive growth of over 1 million users in just five days, galvanizing the widespread use of gen AI. Over the course of 2023 enterprises entered the experimentation stage and kicked off POCs with API services and open models including Llama 2, Mistral, NVIDIA and others.

We’re proud to announce that the next version of MLRun has been released to community users. On the heels of MLRun v1.7’s focus on monitoring, MLRun v1.8 adds features to make LLM and ML evaluation and monitoring more accessible, practical and resource-efficient. New Highlights: MLRun is an open-source AI orchestration tool that provides AI practitioners with capabilities to accelerate and streamline the development, deployment and management of gen AI and ML applications.

Generative AI models are not just tools for producing text, audio or video—they're systems that learn patterns, improvise, and generate unexpected outcomes. When we look at LLMs, we're struck by their capacity to generate surprisingly creative and context-aware results. They can weave coherent narratives, propose novel solutions, mimic human conversation, and even offer nuanced insights across a wide range of topics. While this creativity is their strength, it also introduces variability and risk.

Gen AI call center co-pilots can provide enterprises with operational visibility and insights while automating repetitive tasks, to improve the customer experience. In this session, we’ll show how a large health insurance provider implemented an agentic co-pilot designed scale across multiple call centers and environments. To dive deep into the architecture and see a demo of the co-pilot, you can watch the webinar this blog is based on.

The manufacturing industry can benefit from AI, data and machine learning to advance manufacturing quality and productivity, minimize waste and reduce costs. With ML, manufacturers can modernize their businesses through use cases like forecasting demand, optimizing scheduling, preventing malfunctioning and managing quality. These all significantly contribute to bottom line improvement.

The retail industry has been shaped and fundamentally transformed by disruptive technologies in the past decade. From AI assisted customer service experiences to advanced robotics in operations, retailers are pursuing new technologies to address margin strains and rising customer expectations.

Two years after Seagate first shared their AI and MLOps success story, the data storage leader is now revealing how far they've come since then. In this blog post, you’ll see how the team manages thousands of AI models in production with only a few team members. This is thanks to their AI factory, whichdoes the heavy lifting of automated processes like monitoring, testing, mocking and more.

RAG and Agentic AI shape how intelligent systems interact with data and users. RAG enhances LLMs by retrieving external information to improve accuracy and contextual relevance, while Agentic AI introduces autonomy, decision-making, and adaptability into AI-driven workflows. Agentic RAG combines the power of both, transforming RAG into a multi-step, autonomous, complex process that can self-improve.