Indeed, if apathy is the absence of caring, and caring is part of both love and hate, then I don't think any of these are opposites of each other, they are merely things that can not co-exist.