Usually this will only happen if the PDF itself is incorrectly constructed such that the Page Tree is NOT balanced - but instead is either flat or in a non-balanced tree.
As for the improvements - PDFL7 is over a decade old!! You would think we'd improve the product in 10 years .