In my mind, it's a much better engineered solution to have a centralized, repeatable set of configurations than to have them spread out wherever in the filesystem.

Whenever I hear "centralized configurations" I think of the Registry and shudder. But the issue there isn't the centralization, so it's probably unfair.