Starter prompts
4 ways to start with DataEng.
dbt model
→ Daily revenue
▸ Preview prompt
Write a dbt model that aggregates daily revenue from raw Stripe events with tests for uniqueness, not-null, and accepted values.
Streaming
→ CDC pipeline
▸ Preview prompt
Design a CDC pipeline from Postgres to Snowflake with Debezium + Kafka, including schema evolution and a backfill plan.
Cost cut
→ Half the bill
▸ Preview prompt
Our Snowflake bill doubled this quarter. Lay out the highest-ROI ways to halve it without losing reporting freshness.
Quality
→ Quarantine bad rows
▸ Preview prompt
Design a data-quality layer that quarantines rows failing checks, emits metrics, and alerts on regression — not on every blip.
What it does
Tasks DataEng ships every week.
Pipelines
- Airflow/Dagster DAG design
- dbt models + tests
- CDC from Postgres
- Streaming w/ Kafka/Flink
Trust
- Data quality checks
- Lineage + docs
- Backfill + reprocess
- Cost vs freshness trade-off
Worked sample
A real DataEng chat.
Pairs well with