This Month in the DuckDB Ecosystem: October 2023
2023/10/30 - 4 min read
BYSubscribe to the newsletter
Hey, friend π
ItβsΒ MarcosΒ again, aka βDuckDB News Reporterβ with another issue of βThis Month in the DuckDB Ecosystem for October 2023.
As always we share here, this is a two-way conversation: if you have any feedback on this newsletter, feel free to send us an email toΒ duckdbnews@motherduck.com.
Featured Community Member
Ted Conbeer
Ted Conbeer is a mechanical engineer turned management consultant, who eventually became an analytics engineer and startup executive and advisor. But don't be misled by the latter title; he's also a prolific contributor to open-source coding!
In 2021, he created sqlfmt, an autoformatter for dbt SQL, which has been downloaded over 1,500,000 times. By 2023, he went on to develop harlequin, a terminal-based SQL IDE for DuckDB. If you're aiming to enhance your DuckDB development experience, giving harlequin a try is highly recommended!
Top DuckDB Links this Month
DuckDBβs CSV sniffer
Whether we like it or not, CSV files are here to stay. The DuckDB team understands this well, which is why they've significantly enhanced their CSV reader. It now detects CSV dialect options, identifies column types, and even bypasses corrupt data. Pedro Holanda guides us through these latest updates.
DuckDB β Data Processing in Python Without Pains
While DuckDB is renowned for its impressive SQL interfaces, it's not as well-known in the Python community. However, this blog by Trung Nguyen, demonstrates how it can accelerate and enhance workflows based on Pandas.
NPLG 10.5.23: A New Way to Monetize Open Source (MotherDuck)
A very interesting conversation between Tino Tereshko (VP of Product at MotherDuck) and Zachary Dewitt (Partner at Wing VC)
Transforming Data Engineering: A Deep Dive into dbt with DuckDB
Are you interested in the combination of dbt and DuckDB? Well, Felix Gutierrez gave us a very good introduction to the topic in this article
DuckDB for Spatial Data Management
If you are interested on this topic, you must watch the course that Quisheng Wu (an Associate Professor of the University of Tennessee) taught about it. Itβs on YouTube
DuckDB extensions for AWS Lambda
Tobias MΓΌller created this very cool project in order to run DuckDB on AWS Lambda
Analyst mulls data collection for socioeconomic development
DuckDB can be very advantages for governemtn focused innitiaves, and this articles shares the perspective of a Nigerian called Oluwajuwon Ogunseye talking precisely about it. Now, there is further development for it: he announced a challenge called #30DaysofDuckDBChallenge to get more people excited about it.
Building an IoT Platform Using Modern Data Stack β Part 1
A good example of a end-to-end project done by NiΓ±o Francisco Liwa using DuckDB, FastAPI, Prefect & Streamlit. This involves using public dataset from telemetry sensors provided by Brisbane City Council.
Unleashing the Power of DuckDB for Interactive SQL Notebooks
This a video talk where Rik Bauwens walked us through how they implemented neat features into Datacampβs notebook interface using DuckDB.
Upcoming events
Webinar: Semantic Layers with Cube and MotherDuck + DuckDB
1 November 2023 | Online π
The Cube and MotherDuck teams are hosting a webinar on how to use Cube's semantic layer [access control, pre-aggregates] with MotherDuck and DuckDB.
Scale By the Bay | In Process Analytical Data Management with DuckDB
13-15th November 2023 | Oakland πΊπ²
Discover DuckDB with Alex Monahanβs talk: Learn about this innovative analytical data management system that seamlessly integrates with languages like Python, R, Java, and more. Find out how DuckDB enhances data workflows with fast, efficient operations and automatic parallelization. Join us for an insightful talk on the power of DuckDB!
MotherDuck / DuckDB User Meetup DE November 2023 Edition
20th November 2023 | Berlin π©πͺ
MotherDuck is happy to announce the second MotherDuck/DuckDB meetup in Berlin!. Talk about DuckDB, MotherDuck and all the things data! Cο»Ώo-creator of DuckDB Hannes MΓΌhleisen will join us, and Michael Hunger author of "DuckDB in action" will give a talk! Iο»Ώf you want to quack a talk, feel free to reach out to events@motherduck.com or submit your proposition in sessionize.
CONTENT
- Hey, friend π
- Featured Community Member
- Top DuckDB Links this Month
- Upcoming events
Subscribe to the newsletter