Normalized claim
Accuracy: 30% increase
Improved query accuracy by about 30%.
Nexthink, a Swiss digital employee experience platform, built Nexthink Assist to let users ask natural-language questions and receive DEX insights without needing to know Nexthink Query Language (NQL). The team first used prompt engineering and RAG, then fine-tuned a specialized 7B LLaMA model on a golden dataset to improve accuracy, consistency, and coverage across the data model. They also built an automated labeling workflow using Amazon SageMaker Ground Truth and Amazon Bedrock with Claude 3.5 Sonnet as an LLM-as-a-judge, supported by S3, AWS Lambda, and Amazon SQS.
Reported outcomes
Accuracy: Approximately 30% higher
Quality & accuracy
Catalog median for quality & accuracy deployments: +40% across 55 reported metrics. Compare benchmarks →
No explicit deployment-stage evidence found.
Primary read
Showing 3 of 6
An S3-based annotation pipeline triggers AWS Lambda preprocessing, routes tasks through Amazon SQS to Amazon SageMaker Ground Truth for SSO-authenticated labeling, stores standardized labels back in S3, and uses Amazon Bedrock Claude 3.5 Sonnet for automated labeling/LLM-as-a-judge before fine-tuning a 7B LLaMA model in Amazon SageMaker AI with distributed training and LoRA.
AI-generated summary. Verify important details with the linked sources before relying on this case.
Was this useful?
Community
No published comments yet.