Compacting a large number of small files into fewer larger files can improve query performance in Apache Iceberg.

The small files problem can quietly add overhead to Apache Iceberg tables and slow down queries. This benchmark examines what happens when 1,000 files are compacted into just six. https://towardsdatascience.com/i-compacted-1000-apache-iceberg-files-into-6-heres-what-happened-to-query-performance/

What happens when you replace 1,000 small Apache Iceberg files with six larger ones? This experiment measures the impact on query performance across three different SQL workloads. https://towardsdatascience.com/i-compacted-1000-apache-iceberg-files-into-6-heres-what-happened-to-query-performance/