Atos AI League: Intelligent Insurance Underwriter fine-tuning with Amazon SageMaker AI
Organizations pursuing AI transformation can face a familiar challenge: how to upskill their workforce at scale in a way that changes how teams build, deploy, and use AI. Atos partnered with AWS to deliver a hands-on, gamified learning experience through the AWS AI League to accelerate applied AI skills across the organization. Atos selected a use case called the Intelligent Insurance Underwriter to fine-tune a large language model capable of analyzing insurance scenarios and providing underwriting guidance.
Reported outcomes
+93%
win rateOther quantified impact
Strategic outcomes
Primary read
Use case focus
Showing 2 of 2
- 1AI model training
- 2Training infrastructure modernization
- Upskill workforce at scale with hands-on, gamified generative AI fine-tuning rather than only training/certifications.
- Create domain-specific underwriting capability.
- Using AWS AI League, Atos participants fine-tuned Meta Llama models via SageMaker JumpStart and built an Intelligent Insurance Underwriter assistant.
- Dataset creation in JSONL, fine-tuning workflows in SageMaker Studio, deployment to SageMaker endpoints for inference, and iterative evaluation/leaderboard to tune hyperparameters.
- 400+ participants (409 on leaderboard), 4,100+ fine-tuned models created.
- Top fine-tuned 3B models achieved >93% win rate vs much larger 90B models.
- Accelerated practical skill-building from months to two weeks and 85% of participants felt more confident implementing GenAI solutions with customers.
Architecture
Participants fine-tuned Meta Llama 3.2 3B Instruct models using Amazon SageMaker JumpStart and Amazon SageMaker Studio, with datasets stored in Amazon S3. The workflow included JSONL dataset creation, hyperparameter tuning, deployment to SageMaker endpoints for inference, and leaderboard-based evaluation during the AWS AI League. The article also notes use of an AWS provided PartyRock application for dataset generation support.
Sources & evidence1
AI-generated summary. Verify important details with the linked sources before relying on this case.
Explore related AI use cases
Was this useful?