A duck in the hand is worth two in the cloud
2024/11/08What if I told you that you could complete a JSON parse and extract task on your laptop before a distributed compute cluster even finishes booting up? DuckDB is a lightweight, in-process analytical database that runs on your laptop inside of Python and can wrangle large datasets efficiently, both from local and remote data sources. In this talk, we will show you how to query a dataset with DuckDB to extract, load and transform data right on your laptop. We'll then show you how to move your workloads to the Cloud, so you can run them at scale. By developing locally and pushing to the Cloud it's not only easy to develop, debug and iterate, but also makes it easy to quickly switch back and forth between workloads that do and don't require Cloud compute resources, cutting both cost and time.
Related Videos
00:14:18
2024-10-25
pg_duckdb: Postgres analytics just got faster with DuckDB
Postgres analytics 10x faster?! 🤯 pg_duckdb is here! This open-source extension adds DuckDB's analytics to Postgres, supporting Parquet, CSV, Iceberg reads, and direct MotherDuck queries—all within Postgres!
YouTube
Ingestion
SQL
Ecosystem
00:29:54
2024-10-23
Machine learning and AI at MotherDuck
MotherDuck's Till Döhmen talks at DuckDB Meetup #1 Amsterdam about all the clever ways the AI team is extending SQL to include AI features.
YouTube
AI, ML and LLMs
Meetup
Talk
00:40:09
2024-10-14
Duckfooding at MotherDuck
In this talk at our MotherDuck NYC meetup [warning: bad sound], Nicholas Ursa talked about the paradigm shift from distributed computing and the Big data era to MotherDuck. He then explains how we build our internal data warehouse.
YouTube
Data Pipelines
Meetup
Talk