YouTubeBI & VisualizationAI, ML and LLMsSQLPythonTalk

A duck in the hand is worth two in the cloud

2024/11/08

What if I told you that you could complete a JSON parse and extract task on your laptop before a distributed compute cluster even finishes booting up? DuckDB is a lightweight, in-process analytical database that runs on your laptop inside of Python and can wrangle large datasets efficiently, both from local and remote data sources. In this talk, we will show you how to query a dataset with DuckDB to extract, load and transform data right on your laptop. We'll then show you how to move your workloads to the Cloud, so you can run them at scale. By developing locally and pushing to the Cloud it's not only easy to develop, debug and iterate, but also makes it easy to quickly switch back and forth between workloads that do and don't require Cloud compute resources, cutting both cost and time.

Related Videos

"Why web developers should care about analytical databases" video thumbnail

08:48

2024-12-11

Why web developers should care about analytical databases

You often start your web application with an OLTP database like Postgres, but should you crunch your analytics there? In this video, ‪Mehdi explains what OLAP databases are, when to use them, and more.

YouTube

Wasm

SQL

"Big Data is Dead: Long Live Hot Data 🔥" video thumbnail

25:18

2024-11-15

Big Data is Dead: Long Live Hot Data 🔥

Over the last decade, Big Data was everywhere. Let's set the record straight on what is and isn't Big Data. We have been consumed by a conversation about data volumes when we should focus more on the immediate task at hand.

Talk

YouTube

"pg_duckdb: Postgres analytics just got faster with DuckDB" video thumbnail

14:18

2024-10-25

pg_duckdb: Postgres analytics just got faster with DuckDB

Postgres analytics 10x faster?! 🤯 pg_duckdb is here! This open-source extension adds DuckDB's analytics to Postgres, supporting Parquet, CSV, Iceberg reads, and direct MotherDuck queries—all within Postgres!

YouTube

Ingestion

SQL

Ecosystem