August 2023 – Iceberg Community News

Iceberg updates

PyIceberg updates

PyIceberg 0.5.0 is inbound! With 0.4.0 just released, many new features already accumulated on the main branch. With stuff like:

  • Full support for schema evolution through PyIceberg
  • GCS Support
  • HDFS Support (through PyArrow)
  • Support for GZIP compressed metadata
  • Changes to make PyIceberg run in AWS Lambda
  • 10x speed improvements for the Avro parsing by using Cython
  • Support for the SQLCatalog (JDBC Catalog in Java)
  • Moving to Pydantic v2, which offers speed improvements when parsing the metadata JSON.
  • And many fixes and improvements both to the code and documentation.

Make sure to subscribe to the devlist to test and validate the Release Candidates that will be announced soon.

More information can be found on the project site, and the package is available on PyPI.

Rust and Go

There is some amazing progress on both the Rust and Go implementations. If you’re interested, make sure to star and watch to the repository.

Iceberg in the industry

Blogs from the community

Iceberg in the news

Keep up to date on all things iceberg

Watch for new videos on the Iceberg YouTube Channel

Read blog posts added to the Blogs page

See the community Contribute guide to learn how to start contributing to Iceberg

Join the Apache Iceberg workspace on Slack using the invite link

Subscribe to the Apache Iceberg mailing list