"it's equally easy to point to income inequality for this."

Of course - they're connected. Taking advantage of labor is a big part of income inequality, including the way H1B is used/abused.