Conversations with Robots: Assessing Virtual Agent Systems.
We use the word “conversational” to characterize virtual agent interfaces, but are we really having a conversation with the agents behind them? Not quite, but these interactions can feel enough like a conversation that our expectations are engaged in ways that they wouldn’t be if we were navigating a menu.
In this talk, I’ll cover a variety of challenges to assessing the effectiveness and usability of virtual agent systems. I’ll also discuss some of the cognitive processes underlying communication, and show you how you can use an understanding of the assumptions we make in conversation as a framework for assessing conversational systems.
Key takeaways from the session:
People will come away with considerations for assessing the usability of an intelligent agent or chatbot system that they can put into practice in their own projects. They will have an understanding of the cognitive processes underlying communication, which will help give them a framework for assessing conversational systems.