Oh yeah, we had some fun with it, talking about what the technology is doing (to the limits of my ability and his to understand, obviously) and how we could use that to inform the wording of the questions.
But I still let him ask all the questions, even so. He's such a creative thinker, I was pretty impressed at some of the things it was able to come up with plausible sounding responses for.