AWS · Data & Analytics
Serverless Data Lake ETL Pipeline
Kinesis Firehose streaming to S3 Data Lake, Glue ETL transforming data, and Athena querying results. This diagram is written in ArchLex and passes AWS provider checks.
Diagram and source
provider aws
direction LR
stream: kinesis-firehose
raw_lake: s3["Raw Data Lake"]
etl: glue
processed_lake: s3["Processed Data Lake"]
query: athena
stream -[streams]-> raw_lake
raw_lake -[transforms]-> etl
etl -[writes]-> processed_lake
query -[reads]-> processed_lakeWhat is in this diagram.
Resources
- stream Amazon Kinesis Data Firehose
- Raw Data Lake Amazon S3
- etl AWS Glue
- Processed Data Lake Amazon S3
- query Amazon Athena
Relationships
- stream streams Raw Data Lake
- Raw Data Lake transforms etl
- etl writes Processed Data Lake
- query reads Processed Data Lake
Render it yourself.
Save the source as aws-data-lake-etl.arch and render it with the CLI, or ask your agent to adapt it through the ArchLex MCP server.
npx @archlex/cli render aws-data-lake-etl.arch --output aws-data-lake-etl.svgRelated examples.
- Event-Driven Data Ingestion PipelineHigh-throughput event streaming with API Gateway, EventBridge, SNS, SQS, Lambda workers, DynamoDB, and S3 Data Lake
- GCP Event-Driven Data PipelineGKE publishing events to Pub/Sub, processed by Cloud Functions into BigQuery
- Modern Data Warehouse with DataflowPub/Sub streaming to Dataflow for transformation, loading into BigQuery, visualized by Looker
- Minimal Vertical SliceRDS Proxy, RDS Database, and ECS Service