Hi Symon,
As per my experience it is not required to install maxdb first like MS SQL.
sapinst will ask you for maxdb rdbms dvd.
Now you need to verify whether database it installed or not? if possible install db studio and check.
if database installed check Xuser settings are fine.
Thanks,
Venkat