I upgraded my system to the latest version of Ubuntu 9.04. It seems the alsa drivers which ships with this are somehow broken as you will have no sound. There is a bug report on the myhpmini forums which detail a few people having the same issue. If you upgrade the also drivers to 1.0.19 it seems to work fine.