Under US law, you have no expectation to privacy for data that you give to a third party (in this case Google). I think you hit the nail on the head here, there's not much legal difference between Google and a nosy neighbor other than scale.