Compacting a large number of small files into fewer larger files can improve query performance in Apache Iceberg.
This thread discusses the impact of compacting 1,000 small Apache Iceberg files into six larger files on query performance. It presents a benchmark and experiment measuring performance across different SQL workloads.