August 2023 - Iceberg Community News


Iceberg updates

PyIceberg updates

PyIceberg 0.5.0 is inbound! With 0.4.0 just released, many new features already accumulated on the main branch. With stuff like:

  • Full support for schema evolution through PyIceberg
  • GCS Support
  • HDFS Support (through PyArrow)
  • Support for GZIP compressed metadata
  • Changes to make PyIceberg run in AWS Lambda
  • 10x speed improvements for the Avro parsing by using Cython
  • Support for the SQLCatalog (JDBC Catalog in Java)
  • Moving to Pydantic v2, which offers speed improvements when parsing the metadata JSON.
  • And many fixes and improvements both to the code and documentation.

Make sure to subscribe to the devlist to test and validate the Release Candidates that will be announced soon.

More information can be found on the project site, and the package is available on PyPI.

Rust and Go

There is some amazing progress on both the Rust and Go implementations. If you’re interested, make sure to star and watch to the repository.

Iceberg in the industry

Blogs from the community

Iceberg in the news

Keep up to date on all things iceberg

Watch for new videos on the Iceberg YouTube Channel

Read blog posts added to the Blogs page

See the community Contribute guide to learn how to start contributing to Iceberg

Join the Apache Iceberg workspace on Slack using the invite link

Subscribe to the Apache Iceberg mailing list


Senior Software Engineer, OSS

Improve Apache Iceberg by building new capabilities for Tabular and the community

Senior Software Engineer, Product

Design services and using cloud infrastructure to build a resilient and scalable data platform

Senior UI Engineer

Design and implement Tabular’s user experience, where people will create, monitor, and manage their data platform

Developer Advocate

Build examples to solve real-world challenges, write tutorials that help developers succeed, and be a community liaison

Developer Experience Engineer

Build technical documentation and tutorials, assist in maintaining the release processes, and lower the time to dopamine (TTD) of developers using Apache Iceberg