Apache Spark and Iceberg Supportability Matrix

[#1]

• Introduction
• Apache Iceberg History
• Apache Spark and Iceberg Supportability Matrix Table
• References

Introduction

The Spark and Iceberg Supportability Matrix provides comprehensive information regarding the compatibility and supportability of Spark and Iceberg versions with various operating systems, frameworks, and dependencies.

Apache Iceberg History

The development of Iceberg was started in 2017 by Netflix. The project was open-sourced and donated to the Apache Software Foundation in November 2018. In May 2020, the Iceberg project graduated to become a top-level Apache project.

1. Apache Iceberg 0.7.0 was released on Oct 26, 2019 (Incubating)

2. Apache Iceberg 0.8.0 was released on May 7, 2020 (Incubating).

3. Apache Iceberg 0.9.0 was released on Jul 14, 2020.

4. Apache Iceberg 0.9.1 was released on Aug 11, 2020.

5. Apache Iceberg 0.10.0 was released on Nov 12, 2020.

6. Apache Iceberg 0.11.0 was released on Jan 27, 2021.

7. Apache Iceberg 0.11.1 was released on Apr 3, 2021.

8. Apache Iceberg 0.12.0 was released on August 15, 2021.

9. Apache Iceberg 0.12.1 was released on November 8th, 2021.

10. Apache Iceberg 0.13.0 was released on February 4th, 2022.

11. Apache Iceberg 0.13.1 was released on February 14th, 2022.

12. Apache Iceberg 0.13.2 was released on June 15th, 2022.

13. Apache Iceberg 0.14.0 was released on July 16 2022.

14. Apache Iceberg 0.14.1 was released on Sep 12, 2022.

15. Apache Iceberg 1.0.0 was released on Nov 3, 2022.

16. Apache Iceberg 1.1.0 was released on November 28th, 2022.

17. Apache Iceberg 1.2.0 was released on March 20th, 2023.

18. Apache Iceberg 1.2.1 was released on April 11th, 2023.

19. Apache Iceberg 1.3.0 was released on May 30th, 2023.

20. Apache Iceberg 1.3.1 was released on July 25, 2023.

21. Apache Iceberg 1.4.0 was released on October 4, 2023.

22. Apache Iceberg 1.4.1 was released on October 23, 2023.

23. Apache Iceberg 1.4.2 was released on November 2, 2023.

24. Apache Iceberg 1.4.3 was released on December 27, 2023.

25. Apache Iceberg 1.5.0 was released on March 11, 2024.

26. Apache Iceberg 1.5.1 was released on April 25, 2024.

27. Apache Iceberg 1.5.2 was released on May 9, 2024.

Apache Spark and Iceberg Supportability Matrix Table

The following table explains the Iceberg Version Release Date Status Default Spark Version Supported Spark Version(s): 

Iceberg Version	Release Date	Status	Default Spark Version	Supported Spark Version(s)
0.7.0	Oct 26, 2019	Incubating	2.4	2.4
0.8.0	May 07, 2020	Incubating	2.4	2.4
0.9.0	Jul 14, 2020			2.4,3.0
0.9.1	Aug 11, 2020			2.4,3.0
0.10.0	Nov 12, 2020			2.4,3.0
0.11.0	Jan 27, 2021			2.4,3.0
0.11.1	Apr 03, 2021			2.4,3.0
0.12.0	Aug 15, 2021			2.4,3.0,3.1
0.12.1	Nov 08, 2021			2.4,3.0,3.1
0.13.0	Feb 04, 2022		3.2	2.4,3.0,3.1,3.2
0.13.1	Feb 14, 2022		3.2	2.4,3.0,3.1,3.2
0.13.2	Jun 15, 2022		3.2	2.4,3.0,3.1,3.2
0.14.0	Jul 17, 2022		3.3	2.4,3.0,3.1,3.2,3.3
0.14.1	Sep 12, 2022		3.3	2.4,3.0,3.1,3.2,3.3
1.0.0	Nov 03, 2022		3.3	2.4,3.0,3.1,3.2,3.3
1.1.0	Nov 28, 2022		3.3	2.4,3.1,3.2,3.3
1.2.0	Mar 20, 2023		3.3	2.4,3.1,3.2,3.3
1.2.1	Apr 11, 2023		3.3	2.4,3.1,3.2,3.3
1.3.0	May 30, 2023		3.4	3.1,3.2,3.3,3.4
1.3.1	Jul 25, 2023		3.4	3.1,3.2,3.3,3.4
1.4.0	Oct 04, 2023		3.5	3.2,3.3,3.4,3.5
1.4.1	Oct 23, 2023		3.5	3.2,3.3,3.4,3.5
1.4.2	Nov 02, 2023		3.5	3.2,3.3,3.4,3.5
1.4.3	Dec 27, 2023		3.5	3.2,3.3,3.4,3.5
1.5.0	Mar 11, 2024		3.5	3.3,3.4,3.5
1.5.1	Apr 25, 2024		3.5	3.3,3.4,3.5
1.5.2	May 09, 2024		3.5	3.3,3.4,3.5

References

1. Iceberg Releases
2. Github Iceberg

Thank you for taking the time to read this article. We hope you found it informative and helpful in enhancing your understanding of the topic. If you have any questions or feedback, please feel free to contact me. Remember, your support motivates us to continue creating valuable content. If this article helped you, please consider giving it a like and providing a kudos. We appreciate your support!