The issue is that your private communications are now audible by the people around you. It’s one thing when it’s to another person and you can whisper and share social context, it’s another when it’s at a good volume and contextless.
These don't seem like real issues to me. They are the exact same issues you have when you are talking to humans. And the way we solve that issue with humans is that we only have conversations around other humans that we are comfortable having. We save sensitive conversations for when we are not in public.
The issues isn’t “communicating with the device” it’s “communicating around other people”.
I have almost negative interest in having to recite the technical specifics of my web search to my phone on the train to work. I have even less interest in having to listen to the person next to me trying to do the same.
Typing already allows sensitive conversations with computers in public as long as no one is directly peeking at your screen. When I talk to humans in public, I'm not using them as an utility tool to manage information for me, because computers do a better job. These aren't comparable scenarios.