This is a great point. And, I guess this will not change. With chatbots, this issue is present as well. They just monotonously respond to commands and have pre-defined “tone”. They do not have reactive tone.
Both voice and textual bots will suffer until NLP *really* gets there and we have some digital screen with robotic facial expressions on the wall.