Internal monologue (or dialogue, as it can play out as imagined conversations) is an apt name for it. Imagine reading a play. Everything is expressed as language, and ideas and concepts are expressed through that language.