OK, I found out that there is a bug out there for this. Anyone else have this problem and have a workaround?

Network and disk devices may change on reboot
On systems with multiple disk or network controllers, the kernel/udev may assign a different device node on reboot of the system than was used during installation due to difference in load order of drivers.
This can lead to failure to boot the system or to the network not coming up automatically. In most cases this can be rectified changing the bootloader configuration and /etc/fstab, or /etc/network/interfaces, possibly using the rescue mode of the installer.
Note however that this problem may occur again on subsequent boots. Fixing this issue has priority for the next release of Debian installer.