BLOG
← Back to Glossary
data sources
Data sources are the origin points of information in a data pipeline or analytics workflow.
Data sources are the origin points of information in a data pipeline or analytics workflow. They can include databases, APIs, files, or streaming platforms that provide raw or structured data for processing and analysis. Common examples include relational databases like PostgreSQL, cloud storage services like Amazon S3, SaaS application APIs like Salesforce, and streaming platforms such as Apache Kafka. In the context of DuckDB, data sources can be directly queried using SQL statements, often without the need for explicit data loading. For instance, you can query a CSV file stored on disk or in cloud storage using syntax like:
Copy code
SELECT * FROM 'path/to/file.csv';
Or query a Parquet file:
Copy code
SELECT * FROM 'data.parquet';
Understanding various data sources and how to connect to them is crucial for aspiring data professionals, as it forms the foundation for data integration and analysis workflows.
Related terms
data ingestion →
Data ingestion is the process of importing raw data from various sources into a system where it can be stored and analyzed.
data pipeline →A data pipeline is a series of interconnected processes that extract data from various sources, transform it into a usable format, and load it into a…
pipelines →Data pipelines are automated workflows that move and transform data from various sources to one or more destinations.
ETL →ETL (Extract, Transform, Load) is a data integration process that combines data from multiple sources into a single destination, typically a data warehouse…
Cloud Storage →Cloud storage refers to a model of data storage where digital information is kept on remote servers accessed through the internet, rather than on local hard…
dataset →A dataset is a collection of related data points or records, typically organized in a structured format for analysis or processing.
