That requires a large amount of power, so you'd still have a big amplifier.

Well, not really.

See how big automotive amplifiers are for a given power. What makes home appliances big is usually a huge transformer inside (which for audio quality is good, even though switched power sources are getting better) AND the feeling that light/small is not good

A modern consumer audio system is around 80% empty space inside.