Google Cloud · Data & Analytics
Modern Data Warehouse with Dataflow
Pub/Sub streaming to Dataflow for transformation, loading into BigQuery, visualized by Looker. This diagram is written in ArchLex and passes Google Cloud provider checks.
Diagram and source
provider gcp
direction LR
events: pubsub["Event Stream"]
transform: dataflow
warehouse: bigquery
viz: looker
govern: dataplex
events -[streams]-> transform
transform -[processes]-> warehouse
warehouse -[analyzes]-> viz
warehouse -[governs]-> dataplexWhat is in this diagram.
Resources
- Event Stream Pub/Sub
- transform Dataflow
- warehouse BigQuery
- viz Looker
- govern Dataplex
- Dataplex Dataplex
Relationships
- Event Stream streams transform
- transform processes warehouse
- warehouse analyzes viz
- warehouse governs Dataplex
Render it yourself.
Save the source as gcp-data-warehouse.arch and render it with the CLI, or ask your agent to adapt it through the ArchLex MCP server.
npx @archlex/cli render gcp-data-warehouse.arch --output gcp-data-warehouse.svgRelated examples.
- Event-Driven Data Ingestion PipelineHigh-throughput event streaming with API Gateway, EventBridge, SNS, SQS, Lambda workers, DynamoDB, and S3 Data Lake
- Serverless Data Lake ETL PipelineKinesis Firehose streaming to S3 Data Lake, Glue ETL transforming data, and Athena querying results
- GCP Event-Driven Data PipelineGKE publishing events to Pub/Sub, processed by Cloud Functions into BigQuery
- GCP Serverless Cloud Run + Cloud SQLCloud Run service connected to a Cloud SQL database