MCE, it seems to be a boot compatibility with the operating system installed on the USB. I don’t think your motherboard is defective, since you were able to install other operating systems such as Ubuntu or DOS as you mentioned on your post.
Please keep in mind that ESXi 5.5 is an OS for server systems.