Iceberg 14 + Spark 3.3 = FAST!

I upgraded the ngods data stack to Apache Spark 3.3.0 and Iceberg 14.0, which is now visibly faster!

ngods data stack architecture

I’ve also migrated from the Spark Thrift JDBC to the Apache Kyuubi, and the DBeaver shows the complete Spark schema. This issue took me a while to resolve.

The upgraded configuration is already committed to the ngods GitHub repository.

Enjoy!