2023/09/30 - Marcos Ortiz
This Month in the DuckDB Ecosystem: September 2023
DuckDB news: v0.9 adds Azure storage and Iceberg support. MotherDuck raises Series B, opens to public. Harlequin terminal IDE launches. Vector similarity search.
Hey, friend 👋
It’s Marcos again, aka “DuckDB News Reporter” with another issue of “This Month in the DuckDB Ecosystem for October 2023.
As always we share here, this is a two-way conversation: if you have any feedback on this newsletter, feel free to send us an email to duckdbnews@motherduck.com.
Featured Community Member
Ted Conbeer
Ted Conbeer is a mechanical engineer turned management consultant, who eventually became an analytics engineer and startup executive and advisor. But don't be misled by the latter title; he's also a prolific contributor to open-source coding!
In 2021, he created sqlfmt, an autoformatter for dbt SQL, which has been downloaded over 1,500,000 times. By 2023, he went on to develop harlequin, a terminal-based SQL IDE for DuckDB. If you're aiming to enhance your DuckDB development experience, giving harlequin a try is highly recommended!
Top DuckDB Links this Month
DuckDB’s CSV sniffer
Whether we like it or not, CSV files are here to stay. The DuckDB team understands this well, which is why they've significantly enhanced their CSV reader. It now detects CSV dialect options, identifies column types, and even bypasses corrupt data. Pedro Holanda guides us through these latest updates.
DuckDB — Data Processing in Python Without Pains
While DuckDB is renowned for its impressive SQL interfaces, it's not as well-known in the Python community. However, this blog by Trung Nguyen, demonstrates how it can accelerate and enhance workflows based on Pandas.
NPLG 10.5.23: A New Way to Monetize Open Source (MotherDuck)
A very interesting conversation between Tino Tereshko (VP of Product at MotherDuck) and Zachary Dewitt (Partner at Wing VC)
Transforming Data Engineering: A Deep Dive into dbt with DuckDB
Are you interested in the combination of dbt and DuckDB? Well, Felix Gutierrez gave us a very good introduction to the topic in this article
DuckDB for Spatial Data Management
If you are interested on this topic, you must watch the course that Quisheng Wu (an Associate Professor of the University of Tennessee) taught about it. It’s on YouTube
DuckDB extensions for AWS Lambda
Tobias Müller created this very cool project in order to run DuckDB on AWS Lambda
Analyst mulls data collection for socioeconomic development
DuckDB can be very advantages for governemtn focused innitiaves, and this articles shares the perspective of a Nigerian called Oluwajuwon Ogunseye talking precisely about it. Now, there is further development for it: he announced a challenge called #30DaysofDuckDBChallenge to get more people excited about it.
Building an IoT Platform Using Modern Data Stack — Part 1
A good example of a end-to-end project done by Niño Francisco Liwa using DuckDB, FastAPI, Prefect & Streamlit. This involves using public dataset from telemetry sensors provided by Brisbane City Council.
Unleashing the Power of DuckDB for Interactive SQL Notebooks
This a video talk where Rik Bauwens walked us through how they implemented neat features into Datacamp’s notebook interface using DuckDB.
Upcoming events
Webinar: Semantic Layers with Cube and MotherDuck + DuckDB
1 November 2023 | Online 🌐
The Cube and MotherDuck teams are hosting a webinar on how to use Cube's semantic layer [access control, pre-aggregates] with MotherDuck and DuckDB.
Scale By the Bay | In Process Analytical Data Management with DuckDB
13-15th November 2023 | Oakland 🇺🇲
Discover DuckDB with Alex Monahan’s talk: Learn about this innovative analytical data management system that seamlessly integrates with languages like Python, R, Java, and more. Find out how DuckDB enhances data workflows with fast, efficient operations and automatic parallelization. Join us for an insightful talk on the power of DuckDB!
MotherDuck / DuckDB User Meetup DE November 2023 Edition
20th November 2023 | Berlin 🇩🇪
MotherDuck is happy to announce the second MotherDuck/DuckDB meetup in Berlin!. Talk about DuckDB, MotherDuck and all the things data! Co-creator of DuckDB Hannes Mühleisen will join us, and Michael Hunger author of "DuckDB in action" will give a talk! If you want to quack a talk, feel free to reach out to events@motherduck.com or submit your proposition in sessionize.
