AWS Data Pipeline Architecture

Data Sources
1
Medical Claims Data
Member Eligibility
Pharmacy Claims
Provider Data
Clinical Documents
Financial/Audit Data
Bronze Zone
2
Glue
SQS
Database Migration Service
S3 - Raw
Glacier
Catalog & Quality
3
Glue Crawler
Glue Data Quality
Glue DataBrew
Silver Zone
4
S3 - Clean
Glacier
Transform
5
Glue Crawler
Glue
Entity Resolution
Gold Zone
6
Glue Crawler
S3
Redshift
Athena
QuickSight
Operational EDW
Analytics
7
Redshift
Athena
QuickSight
DataZone
AI/ML Insights
8
QuickSight
AI/ML Foundation Models
SageMaker
Bedrock
Governance, Automation and Security
9
Lake Formation
GuardDuty
Step Functions
Macie
IAM
Security Hub
CloudWatch
CloudTrail
Click to view full size