Impel’s Sales AI: Revolutionizing Automotive Retail with Fine-Tuned LLMs
Impel, an automotive retail innovator, has significantly enhanced its customer experience using a fine-tuned Meta Llama large language model (LLM) deployed on Amazon SageMaker. Their Sales AI product offers personalized customer engagement across the entire buying journey, acting as a 24/7 digital concierge. Key features include summarization of past customer interactions, automated follow-up generation to maintain engagement, and personalized responses tailored to retailer messaging and customer specifications. The shift from a third-party LLM to a fine-tuned Meta Llama model on SageMaker addressed two critical needs: cost optimization and model customization. The per-token pricing of their previous solution became unsustainable with increasing transaction volumes, and the lack of fine-tuning capabilities hindered the use of proprietary data. SageMaker’s hosted pricing offers cost predictability, eliminating per-token charges. The fine-tuning process, leveraging SageMaker’s comprehensive feature set, including LoRA and AWQ, resulted in a remarkable 20% accuracy improvement across core features. The solution employs SageMaker LMI containers for optimized LLM inference, deploying on ml.g6e.12xlarge instances for efficient large model serving and automatic scaling to manage fluctuating demand. The implementation also ensured secure processing of proprietary data within Impel’s AWS account. Impel’s rigorous evaluation process, including structured human evaluations and latency/throughput testing, confirmed improvements in personalized replies (73% to 86%), conversation summarization (70% to 83%), and follow-up generation (59% to 92%). This transition to a domain-specific model offers enhanced data security, reduced reliance on external APIs, and greater operational control. Impel plans to expand these AI capabilities across its Customer Engagement Product suite using RAG, advanced function calling, and agentic workflows. The success story highlights the advantages of fine-tuned LLMs on SageMaker for achieving both accuracy improvements and cost-effective scalability in the automotive retail sector.
Impel’s innovative platform demonstrates how ai automation sales technology can transform customer interactions and boost conversion rates in automotive dealerships.
While chatgpt automation sales have transformed many industries, Impel’s specialized automotive AI delivers targeted solutions specifically designed for car dealerships.
