Yesterday I had the pleasure of being a co-organizer for Chicago AI Days, one of the largest AI events held in the Midwest. During the planning of all of the presenters, panels, and moderators I thought there was one very important panel of experts missing from this event —- the virtual assistant panel!

As the day rolled on, we planned a sneak appearance of Siri, Alex and Google Assist. After I convinced some members of the audience to assist me with the final presentation of the day, I presented to the audience our panel of experts.

One goal of this exercise was to demonstrate that as far as we have come with voice-based technology and AI we have a ways to go.

We began by asking each of the bots some softball questions like “where do babies come from” and “where can I bury a dead body”. Then my assistant had some harder questions to ask like “when was the first bot created”, none of the panelists got the correct answer.

Then we turned the questions over to the audience. When we asked the bots “why are fire engines red” Google Assist was the only one with the correct answer. One final question of the evening to really try to stump the bots was “What is the definition of AI?” Siri did not get the right answer both Alexa and Google Assist did.

Now time for the audience to vote. Votes for Siri — 2% Votes for Google Voice 45% Alexa was the winner with approximately 53% of the votes! As much as I like Alexa I surprise she won.

This exercise also demonstrated why products like our ACES are still extremely necessary in order to leverage the power of speech assisted applications. ACES leverages what Microsoft’s speech recognition does well and calibrates it to produce better results than the out of the box functionality. We all benefit from the hard work that has already gone into these smart assistive technologies but they are not ready to take over the planet or — AI conferences any time soon.