The solution (for me at least) is to follow this guide to install to eMMC, however what you want to do instead of grabbing the latest image is grab the 2021-11-19 factory image, and then after it’s installed and has booted up, then grab the latest sysupgrade image to update the box.
Also double check you have the Ethernet cables plugged into the right slots that the default config expects.