DOCS
← Back to Glossary
S3 bucket
An S3 bucket is a fundamental storage container in Amazon Web Services' Simple Storage Service (S3).
An S3 bucket is a fundamental storage container in Amazon Web Services' Simple Storage Service (S3). It functions as a cloud-based folder for storing and organizing data objects, such as files, images, and documents. S3 buckets are globally unique, scalable, and designed to provide high durability and availability for data storage. They support various access control mechanisms and can be configured for different storage classes based on data access patterns and cost considerations. Data engineers often use S3 buckets as a central repository for raw data, processed datasets, or as part of data lakes. When working with DuckDB, you can directly query data stored in S3 buckets using syntax like:
Copy code
SELECT * FROM read_parquet('s3://your-bucket-name/path/to/file.parquet');
This seamless integration allows for efficient data processing without the need to download files locally.
Related terms
Amazon S3 →
Amazon S3 (Simple Storage Service) is a highly scalable, durable, and secure object storage service provided by Amazon Web Services (AWS).
Cloud Storage →Cloud storage refers to a model of data storage where digital information is kept on remote servers accessed through the internet, rather than on local hard…
storage layer →The storage layer refers to the component of a data system responsible for persistently storing and managing data.
Object storage →Object storage is a data storage architecture that manages data as discrete objects — each with data, metadata, and a unique identifier — in a flat namespace, accessed over HTTP APIs rather than a traditional file system hierarchy.
storage →DuckDB uses an efficient columnar storage format optimized for analytical queries.
NTILE →NTILE(n) is a window function that divides the rows in a partition into n roughly equal-sized buckets and returns the bucket number for each row.
