No one has replied
So one of our guys tracked it down. It was a typo in the .htaccess file that we received from the customer.
If you install using the above method, it never tells you the random password assigned to your management interface. But no fear, there is a tool that sets that for you and is super, duper easy.
It is interactive. And voila.