In current capability, but not in size as I’m assuming we’re looking at TO-220 packages for all of these regulators or voltage references.
The LM1084 is indeed more expensive than the LM1117, (e.g. $2.60 vs $1.54 in single quantity at Digikey) but depending on the total current draw, its lower dropout voltage might give us just enough margin to be able to use Schottky diodes for power supply reversal protection which I prefer over the 10 ohm resistors/fuses (or the mostly harmless (to be polite) ferrite beads - although a MIDI to CV module with its microprocessor might be one of the rare modules where ferrite bead actually have a non-zero (but probably still negligible) effect).