I think people talking about the two cameras tend to underestimate the physical limitations imposed by a smaller body. Even the common processor does not mean they are able to process at the same speed. Nikon has almost always gotten faster operation in flagship batteries with the more powerful battery. It's not just a matter of storage capacity - the EN-EL18 batteries have higher output which translates into faster focus, faster image processing, faster write speed, etc. If they design to the limits of the Z9, it's beyond the capability of Z8 hardware.
It's one thing to write software, but another thing altogether to make sure the software operates within the capacity of the hardware without overheating or causing tripping over other concurrent operations. If more processing power is required for advanced focus, what are the implications on image processing and write speed. Does the extra processing for focus mean image processing takes longer and generates even more heat? Those kinds of issues require developers and engineers to work very closely - and complicate the testing. They have to know it performs as required - not test it and see if it breaks something. Rather than pushing the limits with lots of new features via software, Nikon likely designs software enhancements within known frameworks or limitations around processor speed, data movement, etc.
Keep in mind many enhancements impact more than one aspect of hardware - frame rate impacts AF speed, processor speed, cache size and speed, compression, file size, bus speed for the memory card/cards, heat generation, heat shedding, etc. Any of these aspects may work fine in unit testing, but fail when you operate at 30 or 60 fps and concurrently generate larger files. If the person working on AF performance uses more processor capacity for more complicated AF subject recognition, it may limit the processor speed used for processing the file or cause overheating.