New Relic today launched 'New Relic AI Monitoring' (AIM), an industry-first APM solution for AI-powered applications. The platform provides engineers unprecedented visibility and insights across the AI application stack, making it easier to troubleshoot and optimise their AI applications for performance, quality, cost, responsible use of AI, and forthcoming AI regulations and standards. With over 50 integrations and features like LLM response tracing and model comparison, AIM helps teams build and run LLM-based applications with confidence.
Engineers can access a single view to troubleshoot, compare, and optimise different LLM prompts and responses for performance, cost, security, and quality issues including hallucinations, bias, toxicity, and fairness. It provides engineers with full visibility on all components of the AI stack alongside services and infrastructure so that they have the data they need for the responsible use of AI and to prove their compliance with forthcoming AI regulations.
50+ integrations and quickstarts are enabled on the AIM, including orchestration framework LangChain; LLM models such as OpenAI, PaLM2, HuggingFace; machine learning libraries such as Pytorch, TensorFlow; model serving such as Amazon SageMaker, AzureML; vector databases such as Pinecone, Weaviate, Milvus, FAISS; and AI infrastructure such as Azure, AWS, GCP.
AIM is now available in early access to New Relic users across the globe. Users can sign up here to request early access, which is included as a part of New Relic’s simplified, consumption based pricing.
Stephen Elliot, Group VP, IDC
Just about every organisation is integrating AI applications into their tech stacks to provide better customer experiences and improve efficiency, with the hope of improving their bottom line. The trade-off is that AI creates complexity in their tech stack and must be adopted responsibly with security, quality, compliance, and cost top of mind. Applying observability to AI applications is a smart and efficient way to address these complexities so that companies can scale and drive innovation. Any company that provides these solutions is ultimately enabling organisations to deliver better products and customer experiences.
Edo Liberty, Founder and CEO, Pinecone
By seamlessly integrating the Pinecone vector database with New Relic AI monitoring, we are providing transparency and actionable insights to help developers build better search and Generative AI applications in the enterprise. We have seen incredible demand for vector databases as companies build and deploy AI applications since it is a core part of the AI stack. Now developers can build better search and Generative AI solutions by ensuring relevant and fast responses alongside their AI observability practice.
Peter Marelas, Chief Architect and Head of Technical Specialists APAC, New Relic
Across the Asia Pacific region, AI has become a key priority with many organisations actively exploring its use in software applications. AIM is an innovative APM solution that provides essential observability for the most popular AI technologies powering todays AI experiences. Software engineers will for the first time, have full visibility into the AI stack, enabling them to troubleshoot and deliver safe, secure and reliable AI experiences.
