Save the Date: Join Us At Small Data SF in September to Build Bigger with Small Data and AIGet Tickets

Dagster

ORCHESTRATION

INGESTION

Dagster is an open-source data orchestrator designed for the development, production, and observation of data assets. It helps data teams to define, schedule, and monitor complex data workflows, ensuring data reliability and quality. Dagster provides a rich development experience with type-safe pipelines, integrated testing, and seamless collaboration.

Dagster + MotherDuck

Dagster integrates with MotherDuck by leveraging DuckDB's capabilities within its orchestration workflows. This integration allows data engineers and analysts to run efficient, in-memory SQL queries on data stored in MotherDuck, enabling seamless data processing and analytics within Dagster's pipeline framework. The combined use of Dagster and MotherDuck enhances the ability to manage and analyze data workflows with high performance and flexibility.

Blog

Card image