I play all Cave games (DonPachi, DonDonPachi, Esprade, etc) in .40 FBA core in Retroarch daily.
It definitely must be your romset, which could be incompatible with the FBA core.
edit: just checked and DonPachi works in .30 FBA core, .38, .39 as well.