ORBAI Technologies Inc. showed James, The Holographic Bartender at the NVIDIA GTC Conference last week, both in their booth, and serving drinks at the real bar, beside a human bartender in the Expo floor.
James is a 6ft tall projection of an animated character onto special glass that makes him seem to stand in mid-air as he gestures and moves around. James has a full speech interface and you can interact with him, ask him questions, and order drinks! He is a fully functional bartender when paired with the Barbotics robot drink mixer at his side and can mix up to a dozen tasty cocktails. He can also give information about the venue he is at, in this case questions about the exhibiting companies in the GTC Expo hall and general questions about the conference. He can also give advice, tell you the weather, even look up things off Wikipedia, including drink recipes, and …. He even tells jokes on demand.
In designing James, we had a vision of a handsome, rustic yet soulful middle aged man with deep eyes full of wisdom and life experience. His look needed to be a mix of sexy, sophisticated, and sharp. Capable of making you feel at ease just being in his presence, he has a dependable way about him. He offers sage life advice to your troubling woes and can cheer you up with his witty comebacks and jokes.
When you walk up to James, his new vision systems and patented face tracking algorithms start watching you, and when your mouth starts to move, it cues him to start listening to you, eliminating the need to use a keyword like ‘Hey James’ every time you talk to him, making the interaction much more natural and conversational. He currently uses the Houndify speech query engine to drive the verbal interaction and to access his vast knowledge from databases, and Unreal Engine 4 to animate and render his character, so he is all top-grade components.
James will only get better with time, as ORBAI is working on upgrading his technology to our Gen 3 technology that will make use of novel spiking neural nets that can learn to see, hear, speak, and control movement using a neural architecture similar to the sensory and motor cortices in our human brain. James will continue to learn dynamically, from experience, constantly getting better at recognizing faces and people, at reading their emotions. He will get better at hearing and understanding what they are saying and being able to reply and converse with them more fluidly. He will get the drink orders right more often, learning to lip-read as well as listen in a noisy room. He will realistically move, speak, lip-sync and make expressions
In time. people will gaze on him in wonder, this humble bartender become AI Icon, this artificial man who is learning and growing in intelligence each day, bounded only by the hardware we can put behind his AI.
ORBAI is authoring the artificial neural network with their neural net design software, NeuroCAD, which will also be available soon for other companies to use in designing AI and systems for vision, speech, sensors, motor control and many other systems capable of unsupervised learning from real-time input in robotics, drones, self-driving cars, smart homes, devices, appliances, and even toys