Impel’s Sales AI: Revolutionizing Automotive Retail with Fine-Tuned LLMs
Impel, an automotive retail transformation company, has significantly enhanced its customer experience using a fine-tuned Meta Llama large language model (LLM) deployed on Amazon SageMaker. Their Sales AI product offers personalized customer engagement across the entire vehicle lifecycle, handling inquiries about vehicles, trade-ins, and financing. Key features include summarization of past customer interactions, automated follow-up generation to maintain engagement, and personalized responses aligned with retailer messaging. The shift to a fine-tuned Meta Llama model on SageMaker addressed previous cost concerns associated with per-token pricing and limitations on model customization. Impel achieved a 20% accuracy improvement across core features, benefiting from cost predictability, greater control over model training, secure data processing within their AWS account, and automatic scaling to handle demand spikes. The solution leverages SageMaker LMI containers for optimized inference performance, LoRA fine-tuning for efficient model adaptation, and AWQ for reduced model size. Impel deployed inference endpoints on powerful ml.g6e.12xlarge instances, ensuring efficient handling of large models. Rigorous evaluation showed significant accuracy improvements: personalized replies (73% to 86%), summarization (70% to 83%), and follow-up generation (59% to 92%). This transition to a domain-specific, fine-tuned model enhanced data security, reduced reliance on external APIs, and provided greater operational control. Impel plans to expand this approach to other products, incorporating RAG, advanced function calling, and agentic workflows for even more sophisticated customer interactions. While the case study highlights significant benefits, potential drawbacks could include the initial investment in infrastructure and expertise needed for fine-tuning and deploying LLMs on SageMaker. Overall, Impel's success showcases the power of fine-tuned LLMs in transforming customer experiences within the automotive industry.
The automotive industry is experiencing a transformation through ai automation sales technologies that streamline customer interactions and boost dealership efficiency.
While chatgpt automation automotive solutions have gained popularity, Impel's specialized AI goes beyond generic tools to deliver industry-specific customer experiences.
