One year after Tay, Microsoft is still big on bots — and here is where it’s focusing now


Xuedong Huang, Microsoft technical fellow of artificial intelligence, spoke at the AI NEXT conference in Bellevue, Wash., this weekend. (GeekWire Photo / Geof Wheelwright)

Microsoft has learned a lot about chatbot technology since the unfortunate rollout of the short-lived “Tay” chatbot one year ago this week, when Internet users were able to teach Tay to make racist and misogynistic remarks. This weekend, the company offered insights on the lessons learned from that experience, as well as the huge amount of artificial intelligence work Microsoft is now undertaking.

With encouragement from CEO Satya Nadella, the company’s artificial intelligence team moved on from Tay and started offering a new chatbot aimed at millennials called Zo late last year. Zo is based on the company’s popular XiaoIce Chinese-language bot (which Microsoft rolled out on WeChat in 2014).

“Tay is gone, Zo is the one we are embracing and supporting,” said Xuedong Huang, Microsoft technical fellow of artificial intelligence, during a presentation on Saturday at the AI NEXT tech conference in Bellevue, Wash. “AI is (about) learning from data. We learned from what happened. (With Tay), we didn’t do a super, super good job. With Zo, we are doing a much better job.”

Microsoft doubled-down on artificial intelligence last fall with the formation of a new 5,000-person AI and Research Group.

Huang demonstrated a number of major applications of Microsoft’s AI and chat technologies, including a new implementation Microsoft is now using on its company-wide support website. He showed how you can just click on the “Get started” button to start an immediate chatbot session. Once in the chat, you can ask questions such as “How do I upgrade from Windows 8?”

In the demonstration, not all the answers provided the best possible resolution to the question, but Huang says it is a work in progress and does demonstrate the promise of the technology — and the way Microsoft is committed to using bots to meet mainstream enterprise business requirements.

Li Deng, Microsoft chief Scientist of Artificial intelligence. (GeekWire Photo / Geof Wheelwright)

Li Deng, Microsoft’s chief scientist of artificial intelligence, told the conference that today’s AI and chat solutions are the culmination of several decades of evolution in artificial intelligence — with each stage of AI marking a new generation of solutions.

Deng said that the first generation of AI lasted from the early part of the 1990s until almost the turn of the decade, and was primarily centered on rules and templates.

Such systems offered limited function in terms of the inputs allowed and the outputs provided (think of early voice-based train schedule information systems) and relied on those with expert domain knowledge to design them. They were hard to scale to more than one area of expertise, or domain. You couldn’t, for example, use the framework for a flight-booking system to architect a telephone banking system. Data was only used to design the rules that created the system — not to learn and evolve the way the system operated.

“The problem was this approach was that it was very brittle,” he said. “There are still many systems today based on this approach because it’s easy to interpret the results.”

The next generation of AI came in the late 1990s and was based on “data-driven, shallow learning” and used in conjunction with speech recognition, he said. Its goals were really about using data to reduce the cost of hand-crafting complex dialogues and making systems less sensitive to speech recognition errors. It also did try to leverage data a lot more.

“If you have a lot of data, you automatically learn a lot of things,” he said. “It pushed the state of the art in a very nice direction because it was data-driven.”

But Deng explained that this second generation of AI produced results that were not always easy to interpret or debug — and these systems were hard to update. They also didn’t really replace first-generation systems, but rather ran in parallel with them.

All of that leads to today’s third generation of artificial intelligence, from which Microsoft’s current chat solutions came. Deng says that in these systems, the key difference is data-driven deep learning.

Deng says this deep learning approach powers today’s conversational bots into four categories: social chatbots (such as Microsoft’s Zo and XiaoIce); InfoBots (aimed primarily at retrieving information); task completion bots (that are all about helping you accomplish a particular task, such as booking a flight or troubleshooting a technical issue); and personal assistant bots (which can combine informational retrieval and task completion with recommendations — such as suggesting the best Italian restaurant near you).

Microsoft faces tough competition in all of the above categories for use of bot technology — and notably AI driven by voice. Deng acknowledged the broad field by identifying Amazon’s Echo, Apple’s Siri, Google Now, VocalIQ and IBM Watson Analytics as competitors that play in the same space as Microsoft’s Cortana.

Deng also talked about how Microsoft has combined AI with speech recognition and machine translation technologies. By taking speech recognition technology to turn spoken words into text, Microsoft can then use its machine translation tools to translate those words from one language to another.

Speech synthesis technology then allows those newly-translated words to be converted into spoken words in another language. All of those functions have now been rolled into the latest features for Microsoft Translator, which rolled out late last year for Android, Amazon, iOS and Windows devices.

Related Tags


Top Stories

Doctor Who review: Bill and the Timelord must grin and bear it in Smile

“There’s a giant smiley abattoir, and I’m having this childish impulse to blow it up.”
  • 4 days ago
  • 13

Former Bill & Melinda Gates executive sues organization, claims he was misled about his role

A former Bill & Melinda Gates Foundation chief digital officer has filed a lawsuit against the organization, claiming he was misled about the scope of his job during his recruitment and that he was terminated for clashing with executives who didn’t believe in his new role. Todd Pierce, the former chief digital officer, joined the Gates Foundation in early 2015. He was previously a senior vice president at Salesforce, where he claimed in court documents he was making a $1.5 million annual salary and had several million in future stock options that hadn’t vested yet. His time at the foundation ended… Read More
  • 1 day ago
  • 13

Waymo opens self-driving car trial in Phoenix – and scores in Uber legal battle

It’s been a good day on the streets and in the courts for Waymo, the driverless-car company that was spun out from Google as another Alphabet subsidiary last year. First off, Waymo opened up its closed trial for autonomous driving in the Phoenix metropolitan area for public signup. This means Arizonans can apply to become “early riders” in the self-driving minivans and SUVs that Waymo is testing. In a blog post, Waymo CEO John Krafcik said the rider pool will be expanded from a handful to hundreds over the course of the trial. “The goal of this program is to give… Read More
  • 1 day ago
  • 9

Mozak turns brain cell mapping into video game, thanks to UW and Allen Institute

A game called Mozak is turning thousands of Internet users into “tracers” who help neuroscientists map out the tangled circuitry of brain cells. The citizen-science project was created by the University of Washington’s Center for Game Science in partnership with the Allen Institute for Brain Science. Mozak took a share of the spotlight at last October’s White House Science Fair, but the project is just now coming out of beta. In a news release, UW says results gleaned from the game have helped the Allen Institute’s researchers reconstruct neurons 3.6 times faster than previous methods. Guided by online tutorials, the game’s tracers… Read More
  • 2 days ago
  • 9

Hey, fancy pants, these $425 Nordstrom jeans with fake mud will make you look like a harder worker

Tech geeks who work behind a desk all day don’t exactly generate a mess worthy of having their occupation considered a dirty job. So if the idea of coming across as a harder-working working stiff appeals to you, perhaps a pair of $425 jeans from Nordstrom will do the trick. The Barracuda Straight Leg Jeans from PRPS — a luxury denim brand out of New York — are billed as “heavily distressed” thanks to the faux mud that is baked into the design. The description on the Nordstrom website says the jeans “embody rugged, Americana workwear that’s seen some hard-working action… Read More
  • 1 day ago
  • 8
farawayyachtingcharters - Easy Branches
botoxfillerveintheraphyinphuket - Easy Branches

Latest in Technology

Amazon’s camera-equipped Echo Look raises new questions about smart home privacy

 Given all of the security concerns raised by the rise of the Echo and other smart home hubs, Amazon surely knew that adding a camera to one of its devices was going to reinvigorate the privacy debate. After all, an always-listening microphone is one thing — the Echo Look, with a camera designed to sit in its owner’s bedroom, is another question entirely. Read More
  • 4 hours ago

Crunch Report | Instagram Grows To 700M Users

 Today’s Stories  Instagram’s growth speeds up as it hits 700 million users Twitter desperately needed a hit first-quarter and somehow managed to deliver Amazon’s new Echo Look has a built-in camera for style selfies Uber is making it easier to see your rider rating Investor Chris Sacca is retiring from venture capital Credits Written and Hosted by: Anthony Ha Filmed… Read More
  • 4 hours ago

A vigilante is putting a huge amount of work into infecting IoT devices

When it comes to features and robustness, Hajime surpasses its blackhat rivals.
  • 5 hours ago

Take a stand for a better view at work — just expense this suction-cup desk thing on Kickstarter

If you’ve been waiting for an office with a window or a standing desk, you’re going to want to sit down for this one. Oh, you already are. Sorry! Anyway, the Kickstarter for this item caught our attention this week after passing our singular criteria for Kickstarter items: Yes, the world could use that. Deskview is a window-mounted standing desk that creates a more inviting and healthy workspace for anyone who is tired of staring at a wall or the back of a co-worker’s head, or is having trouble getting HR to OK the price tag on a new work station.… Read More
  • 6 hours ago

F5 Networks disappoints investors with modest gains in quarterly revenue and net income

F5 Networks reported gains in revenue and net income for its second quarter Wednesday, but fell short of expected targets, and investors were not happy. Shares of the Seattle-based network infrastructure and security technology company plunged 7 percent in after-hours trading after the company reported its first financial results under new CEO Francois Locoh-Donou, who was named CEO earlier this year and assumed the role earlier this month. “My early internal and external interactions have reinforced my enthusiasm for joining the F5 team and my view that the company offers a compelling platform for growth,” he said in a statement.… Read More
  • 6 hours ago

Blue Origin and other space companies urge Congress to boost FAA’s funding

When senators asked executives from Blue Origin and other commercial space ventures what they could do to help them at a Senate hearing today, they received an unusual reply: Give more money to the regulators at the Federal Aviation Administration. “”It may be rare for companies to be pushing for more funding for their regulators, but we really think this is a case where it could be a good investment for the country,” Virgin Galactic CEO George T. Whitesides said during a Senate space subcommittee hearing. The FAA’s Office of Commercial Space Transportation, also known as AST, is responsible for regulating and… Read More
  • 6 hours ago

First live ultra-HD video from space features oohs, ahhs and zero-G ping pong

NASA and AWS Elemental showed off something completely different from the International Space Station today: the first live video in ultra-high-definition 4K detail beamed down from space. The technical achievement was as important as what the audience at the National Association of Broadcasters’ annual Las Vegas expo saw on the big screen – and what internet users around the world could see on 4K UHD devices. “My thought was, ‘Wow, am I glad all this was working,'” Rodney Grubbs, program manager for NASA Imagery Experts, said afterward during an NAB panel. NASA has put plenty of 4K UHD videos online, but this was… Read More
  • 8 hours ago

UW study finds food in your Instagram feed helps some users track and maintain healthy habits

Whether your eyes roll or your stomach grumbles at the site of yet another food photo on Instagram, the popular practice appears to provide some benefit to people who are looking to meet healthy eating or fitness goals. A study by researchers at the University of Washington found that there’s more to a random banana and yogurt photo than meets the eye. The platform can serve as a creative and more fun way track food intake while also allowing users to be held accountable by followers who have a shared interest in eating right, losing weight, etc. UW Today reported the news… Read More
  • 8 hours ago

GeekWire Deals: Home security you can trust, with 20% off this smart WiFi camera

Peace of mind can be hard to find. When it comes to your home, there’s a lot to protect. Sure, you could enlist the resources of a fancy security system — or you could set up a simple camera. Get a reliable, safe, and affordable solution with today’s GeekWire Deals offer. Your second set of eyes is in the Oco WiFi Security Camera. This HD camera sits compact at under three inches wide, but packs a sharp 1920×1080 resolution. Breathe easy, knowing you have a 140-degree view of your home (even your pet, if it’s there without you). Store video… Read More
  • 9 hours ago

Picture this: Senate staffers’ ID cards have photo of smart chip, no security

Senate employees just use passwords, and their badges sport a picture of an alternative.
  • 9 hours ago

Seattle Mayor Ed Murray and Paul Allen announce $35M plan to support homeless families

Seattle Mayor Ed Murray and billionaire Microsoft co-founder Paul Allen announced a $35 million partnership Wednesday aimed at tackling the region’s ongoing homelessness crisis. Allen’s Family Foundation will provide $30 million toward the creation of a “supportive housing and onsite services community that will serve as a resource hub for Seattle-area families with children,” a news release said. The City of Seattle will add $5 million in capital and additional funds to support operation and maintenance of the center. GeekWire will have more on this developing story shortly. Watch a news conference that was streamed live on the mayor’s Facebook page: Very excited… Read More
  • 10 hours ago

Tech demo shows Scorpio’s superior graphics at both 4K and 1080p

The much more powerful GPU enables better textures, better models, and better anti-aliasing.
  • 10 hours ago