Apache Iceberg? Spread the word by giving it a on the apache/iceberg repo!
Project updates
Iceberg Java
- The Iceberg 1.4.3 release is live! Get more details and the latest bits here.
- Added the StandardEncryptionManager, which will manage data and metadata encryption (including native encryption on Parquet and ORC formats).
- View support has been added to both the REST and Nessie catalog implementations.
- Added support for specifying the spec_id to the RewriteManifestProcedure so that a rewrite can be performed on manifests with older spec_ids.
- Updated to support Flink 1.18, the latest version.
- Added support to the Flink Iceberg Source for emitting watermarks and ensuring that they are in order.
- Parallelized file reading in the add_files() procedure.
- Performance improvements to delete file planning. This will greatly increase planning performance when position delete files are targeted to a single data file.
- New APIs for tracking partition stats in table metadata. This will enable engines to more easily get partition stats for query optimizations.
- Removed support for Spark 3.2.
Bergy Blogs
- How to Integrate Databricks with Snowflake-managed Iceberg Tables – A good example of the architectural flexibility Iceberg brings.
- Getting Started with Flink SQL, Apache Iceberg, and DynamoDB Catalog.
- Explore the Wonders of Apache Iceberg.
- What’s so cool about Apache Iceberg?
- Get hands-on with Iceberg and Snowflake.
- David Gomes delivers a great overview of file formats, table formats, and how they come together to create a data lakehouse. For an added bonus, check out this discussion thread regarding the article.
Ecosystem Updates
- Introducing WAP Pattern Support with Apache Iceberg.
- More on Apache Iceberg support in AWS Redshift.
- Snowflake presents the Open Data Lakehouse – How to use Snowflake as a data lakehouse with Iceberg tables.
Vendor Updates
- Dremio predicts that Apache Iceberg will become the most adopted table format in 2024.
- Check out Starburst’s new Iceberg / Trino demo video.
Iceberg Resources
Get Started with Apache Iceberg
Learn more about Apache Iceberg on the official Apache site
Watch and subscribe to the Iceberg YouTube Channel
Read up on some community blog posts
Contribute to Iceberg
SELECT * FROM you JOIN
iceberg_community
Subscribe to the Apache Iceberg mailing list