They do care - they care because they have an inflated impression of their own importance and you seem guilty, so you must be.