A duck in the hand is worth two in the cloud
2024/11/08What if I told you that you could complete a JSON parse and extract task on your laptop before a distributed compute cluster even finishes booting up? DuckDB is a lightweight, in-process analytical database that runs on your laptop inside of Python and can wrangle large datasets efficiently, both from local and remote data sources. In this talk, we will show you how to query a dataset with DuckDB to extract, load and transform data right on your laptop. We'll then show you how to move your workloads to the Cloud, so you can run them at scale. By developing locally and pushing to the Cloud it's not only easy to develop, debug and iterate, but also makes it easy to quickly switch back and forth between workloads that do and don't require Cloud compute resources, cutting both cost and time.
Related Videos
08:48
2024-12-11
Why web developers should care about analytical databases
You often start your web application with an OLTP database like Postgres, but should you crunch your analytics there? In this video, Mehdi explains what OLAP databases are, when to use them, and more.
YouTube
Wasm
SQL
25:18
2024-11-15
Big Data is Dead: Long Live Hot Data 🔥
Over the last decade, Big Data was everywhere. Let's set the record straight on what is and isn't Big Data. We have been consumed by a conversation about data volumes when we should focus more on the immediate task at hand.
Talk
YouTube
14:18
2024-10-25
pg_duckdb: Postgres analytics just got faster with DuckDB
Postgres analytics 10x faster?! 🤯 pg_duckdb is here! This open-source extension adds DuckDB's analytics to Postgres, supporting Parquet, CSV, Iceberg reads, and direct MotherDuck queries—all within Postgres!
YouTube
Ingestion
SQL
Ecosystem