This Month in the DuckDB Ecosystem: October 2023

2023/10/30 - 4 min read

BY

Subscribe to the newsletter

Hey, friend πŸ‘‹

It’sΒ MarcosΒ again, aka β€œDuckDB News Reporter” with another issue of β€œThis Month in the DuckDB Ecosystem for October 2023.

As always we share here, this is a two-way conversation: if you have any feedback on this newsletter, feel free to send us an email toΒ duckdbnews@motherduck.com.

Post Image

Ted Conbeer

Ted Conbeer is a mechanical engineer turned management consultant, who eventually became an analytics engineer and startup executive and advisor. But don't be misled by the latter title; he's also a prolific contributor to open-source coding!

In 2021, he created sqlfmt, an autoformatter for dbt SQL, which has been downloaded over 1,500,000 times. By 2023, he went on to develop harlequin, a terminal-based SQL IDE for DuckDB. If you're aiming to enhance your DuckDB development experience, giving harlequin a try is highly recommended!

You can connect with Ted on GitHub,X, or LinkedIn.


DuckDB’s CSV sniffer

Whether we like it or not, CSV files are here to stay. The DuckDB team understands this well, which is why they've significantly enhanced their CSV reader. It now detects CSV dialect options, identifies column types, and even bypasses corrupt data. Pedro Holanda guides us through these latest updates.

DuckDB β€” Data Processing in Python Without Pains

While DuckDB is renowned for its impressive SQL interfaces, it's not as well-known in the Python community. However, this blog by Trung Nguyen, demonstrates how it can accelerate and enhance workflows based on Pandas.

NPLG 10.5.23: A New Way to Monetize Open Source (MotherDuck)

A very interesting conversation between Tino Tereshko (VP of Product at MotherDuck) and Zachary Dewitt (Partner at Wing VC)

Transforming Data Engineering: A Deep Dive into dbt with DuckDB

Are you interested in the combination of dbt and DuckDB? Well, Felix Gutierrez gave us a very good introduction to the topic in this article

DuckDB for Spatial Data Management

If you are interested on this topic, you must watch the course that Quisheng Wu (an Associate Professor of the University of Tennessee) taught about it. It’s on YouTube

DuckDB extensions for AWS Lambda

Tobias MΓΌller created this very cool project in order to run DuckDB on AWS Lambda

Analyst mulls data collection for socioeconomic development

DuckDB can be very advantages for governemtn focused innitiaves, and this articles shares the perspective of a Nigerian called Oluwajuwon Ogunseye talking precisely about it. Now, there is further development for it: he announced a challenge called #30DaysofDuckDBChallenge to get more people excited about it.

Building an IoT Platform Using Modern Data Stack β€” Part 1

A good example of a end-to-end project done by NiΓ±o Francisco Liwa using DuckDB, FastAPI, Prefect & Streamlit. This involves using public dataset from telemetry sensors provided by Brisbane City Council.

Unleashing the Power of DuckDB for Interactive SQL Notebooks

This a video talk where Rik Bauwens walked us through how they implemented neat features into Datacamp’s notebook interface using DuckDB.

Upcoming events

Webinar: Semantic Layers with Cube and MotherDuck + DuckDB

1 November 2023 | Online 🌐

The Cube and MotherDuck teams are hosting a webinar on how to use Cube's semantic layer [access control, pre-aggregates] with MotherDuck and DuckDB.

Scale By the Bay | In Process Analytical Data Management with DuckDB

13-15th November 2023 | Oakland πŸ‡ΊπŸ‡²

Discover DuckDB with Alex Monahan’s talk: Learn about this innovative analytical data management system that seamlessly integrates with languages like Python, R, Java, and more. Find out how DuckDB enhances data workflows with fast, efficient operations and automatic parallelization. Join us for an insightful talk on the power of DuckDB!

MotherDuck / DuckDB User Meetup DE November 2023 Edition

20th November 2023 | Berlin πŸ‡©πŸ‡ͺ

MotherDuck is happy to announce the second MotherDuck/DuckDB meetup in Berlin!. Talk about DuckDB, MotherDuck and all the things data! Cο»Ώo-creator of DuckDB Hannes MΓΌhleisen will join us, and Michael Hunger author of "DuckDB in action" will give a talk! Iο»Ώf you want to quack a talk, feel free to reach out to events@motherduck.com or submit your proposition in sessionize.

CONTENT
  1. Hey, friend πŸ‘‹
  2. Upcoming events

Subscribe to the newsletter