Chatbot and LLM Analytics with Eric Griffing

From the granular details of measuring intent and LLM-based chatbot effectiveness to the strategic implementation of AI across business units, Eric provides an in-depth analysis on the importance of data-driven decisions in the era of AI transformation.Join us as we discuss how businesses can leverage analytics to optimise customer interactions, the common pitfalls in current AI strategies, and the future of AI in customer service.In this episode00:00 Introduction and UNPARSED conference - Find out more at https://unparsedconf.com4:32 Welcom Eric Griffing7:25 Best practice for measuring LLM agents12:10 Differences tracking ML and LLM bots14:00 Goal completion19:00 What's missing22:00 How to set up tracking on chatbots24:50 Tracking LLM chatbots30:37 Air Canada's chatbot issues33:38 LLM guardrails37:00 Using data to inform your AI strategy41:00 Effort over satisfaction44:30 Tracking customer effort in chatbots48:40 Market demand for AI analytics55:40 Wrap upSubscribe to https://vux.world/subscribe for weekly updates on how to implement AI effectively in your organisation.Learn more from Dashbot:https://www.dashbot.io/blog/360-bot-frameworkhttps://www.dashbot.io/blog/inside-the-black-box-analyzing-your-llm-bothttps://www.dashbot.io/blog/navigating-the-shift-from-intent-based-to-language-model-chatbotsUnparsed, the world's most loved conversational AI conference returns with more punch, more passion and more impact! Buy your tickets now here Hosted on Acast. See acast.com/privacy for more information.