ProductionEvidence: Medium50/100

NewDay builds a generative AI customer-service agent assist with over 90% accuracy

NewDay created a real-time generative AI assistant for contact center agents to answer customer questions from about 200 knowledge articles during live calls. The team used a serverless RAG design on AWS, iterated through eight experiment loops, improved accuracy from below 60% to over 90%, and cut answer retrieval time from 90 seconds to 4 seconds.

Organization
NewDay
Industry
Finance
Published
June 2025

Reported outcomes

Accuracy: More than 60% higher

Quality & accuracy

Accuracy: More than 90% higherTime: Approximately 90 secondsTime: Approximately 4 seconds
Why do we believe this?Outcome claims, sources, and evidence checks

Normalized claim

Accuracy: 60% increase

AWS Machine Learning BlogJun 24, 2025Blog postInferred claimMedium evidence strength

Accuracy improved from below 60% to over 90%.

Normalized claim

Accuracy: 90% increase

AWS Machine Learning BlogJun 24, 2025Blog postInferred claimMedium evidence strength

Accuracy improved from below 60% to over 90%.

Normalized claim

Time: 90 seconds

AWS Machine Learning BlogJun 24, 2025Blog postInferred claimMedium evidence strength

Answer retrieval time fell from about 90 seconds to 4 seconds.

Normalized claim

Time: 4 seconds

AWS Machine Learning BlogJun 24, 2025Blog postInferred claimMedium evidence strength

Answer retrieval time fell from about 90 seconds to 4 seconds.

Why do we believe this deployment?Customer identity, provider attribution, maturity, and source checks
Customer
NewDay
Provider
AWS
Maturity
Production

The solution rolled out to more than 150 agents and is planned for broader customer operations use

Customer identity supportedSource describes one deploymentMaturity supported

Primary read

Use case focus

Showing 3 of 3

  • 1Agent Assist
  • 2Customer Service Automation
  • 3RAG
  • Built NewAssist as a real-time RAG chatbot/agent assist using Amazon Bedrock with Claude 3 Haiku.
  • Used Amazon API Gateway, Amazon OpenSearch Serverless, AWS Fargate, and AWS Lambda in a serverless architecture.
  • Created a golden dataset, custom data parsing for widget-based knowledge articles, and iterative evaluation gates before production.
  • Accuracy improved from below 60% to over 90%.
  • Answer retrieval time fell from about 90 seconds to 4 seconds.
  • Running cost was kept under $400 per month.
Architecture

NewDay built NewAssist as a real-time retrieval-augmented generation assistant for contact center agents. The system uses Amazon API Gateway, Amazon OpenSearch Serverless, AWS Fargate, AWS Lambda, and Amazon Bedrock with Claude 3 Haiku. The team created a golden dataset, customized parsing for widget-based knowledge articles, and used weekly human review plus pre-production evaluation gates to improve accuracy before rollout.

Sources & evidence1
Evidence: Medium50/100Evidence strength
  • Customer explicitly identified
  • Deployment status explicitly supported
  • Quantified outcome available
  • Technical implementation details available
Type: Blog PostPublished: Jun 24, 2025Publisher: AWSEvidence: VendorConfidence: Medium

AI-generated summary. Verify important details with the linked sources before relying on this case.

Explore related AI use cases

Was this useful?

Community

Comments

No published comments yet.