Dagster

Dagster is a platform for authoring, scheduling, and monitoring workflows. It integrates with MotherDuck for scheduling DuckDB and MotherDuck tasks in repeatable data workflows.

How it works with MotherDuck

1. Create a task, DAG, flow, or job in Dagster that runs a DuckDB or MotherDuck step.
2. Store the MotherDuck token in the orchestrator's secret manager.
3. Use a small validation query before scheduling larger ingestion, transformation, or export jobs.

Related content

• View the full process in the Dagster documentation
• Loading data into MotherDuck
• MotherDuck authentication