Pushing the Boundaries of Geo Data with MotherDuck and Geobase!

2024/07/03

BY

Subscribe to MotherDuck Blog

In this post, we will demonstrate how Geobase and MotherDuck can work together to create previously impossible applications! MotherDuck handles online analytical processing (OLAP) queries efficiently, while Geobase excels at spatial-temporal queries for movement analytics.

With this integration, all API calls are routed through Geobase, enabling stored procedures to generate vector tiles on the front end seamlessly, providing a straightforward solution for developers and businesses.

Demo video

Use Case: The Danish Straits' Impact on World Trade and Shipping

Over 80% of the volume of international trade in goods is transported by sea. For Western Europe, most of this volume passes through the Danish Straits. Like road transport networks, this trade moves from the main trade routes to ports and from there into channels and rivers.

This region is home to some of the largest offshore energy farms, such as the Lillgrund Wind Farm. It also hosts major engineering projects like the Oresund Bridge.

The raw ship traffic data for this region of international waters is available on the Danish Maritime Authority’s website as monthly CSV extracts. We wanted to use Geobase and MotherDuck to bring this data to life! Once the data was visualized, we discovered things we never knew existed, like maintenance ships working at the offshore wind farm from 7 AM to 3 PM or ship captains' preference to take certain routes over others. These are all very human stories hidden within the data.

The Ship Tracks site is now live so that you can discover more patterns and stories in the data.

How we Built This

MotherDuck and Geobase were instrumental in visualizing the movement of around 5,000 ships over a 24-hour period in the Danish Straits. This visualization highlights the density of ships and their common paths. This would not have been possible without Geobase!

Embedded demo

Getting Started

Getting started with Geobase and MotherDuck is straightforward. Users can leverage the integration to create compelling geospatial applications and visualizations without managing their servers. The integration offers a practical and efficient solution for developers and businesses looking to harness the power of large datasets in the geospatial industry.

Architecture diagram The figure above outlines how MotherDuck and the Geobase platform integrate.

1. MotherDuck (powered by DuckDB):

  • Offers a data warehouse service that extends DuckDB to the cloud
  • Securely connects to the Geobase platform

2. Geobase Platform:

  • Handles both external ('big data' at cloud scale) and internal tables
  • Uses stored functions for business logic

3. Vector Tiles API:

  • Processes data into vector tiles
  • Includes a caching mechanism for efficiency

4. Applications:

  • Web, mobile, and VR applications access vector tiles and API functions from the Geobase platform to visualize and interact with the data
Ships moving

Geobase and MotherDuck overview

Geobase and MotherDuck have key features that are highly complementary: Overview table

Integration Benefits

The Geobase and MotherDuck integration offers several advantages. MotherDuck excels at running OLAP queries, making it ideal for data analysis at cloud scale. Geobase is particularly strong in handling the spatial-temporal queries required for movement analytics in the geospatial industry. It also supports H3 integration for efficient spatial indexing. Combining these capabilities allows API calls through Geobase to MotherDuck. Geobase can also process the data to create vector tiles in response to the front end, thus allowing visualization of large datasets. It's all possible without touching the server!

Additional Use Cases

This integration supports various practical applications, such as real-time maritime activity analysis, global trade insights, and event impact assessment. For example, it can monitor and analyze vessel movements in real time, track performance at major ports, and evaluate the impact of events like natural disasters or geopolitical conflicts on maritime activities. Of course, the maritime industry is just one of a dozen other industries that create, store & analyze, and build upon geospatial data. These capabilities enable governments, researchers, and businesses to make informed decisions based on comprehensive and timely data.

Conclusion

Our example is just one highlight of the available tools and functionality in Geobase and MotherDuck, which offer greater possibilities, such as identifying high-density areas, spotting stationary ships, tracking individual ship trajectories, and investigating anomalous ship behavior.

As we launch Geobase, we will educate our community on using these tools better and improving the know-how needed to create such powerful applications.

CONTENT
  1. Use Case: The Danish Straits' Impact on World Trade and Shipping
  2. How we Built This
  3. Getting Started
  4. Geobase and MotherDuck overview
  5. Integration Benefits
  6. Additional Use Cases
  7. Conclusion

Subscribe to MotherDuck Blog