15 C
New Delhi
Friday 13 December 2019
Sci-Tech Artificial Intelligence: Microsoft's translator matches human performance

Artificial Intelligence: Microsoft’s translator matches human performance

Machine translation is a problem researcher have worked on for decades and for much of that time many believed human parity could never be achieved

Washington: In a first, Microsoft researchers have developed an artificial intelligence (AI) system that can translate news from Chinese to English with the same quality and accuracy as a human.

Researchers said that their system achieved human parity on a commonly used test set of news stories, which was developed by a group of industry and academic partners.

To ensure the results were both accurate and on par with what people would have done, the team hired external bilingual human evaluators, who compared Microsoft’s results to two independently produced human reference translations.

Xuedong Huang, a technical fellow in charge of Microsoft’s speech, natural language and machine translation efforts, called it a major milestone in one of the most challenging natural language processing tasks.

“Hitting human parity in a machine translation task is a dream that all of us have had. We just didn’t realise we’d be able to hit it so soon,” Huang said.

The translation milestone was especially gratifying because of the possibilities it has for helping people understand each other better, he said.

Machine translation is a problem researcher have worked on for decades and for much of that time many believed human parity could never be achieved.

Ming Zhou, assistant managing director of Microsoft Research Asia, cautioned that there are still many challenges ahead, such as testing the system on real-time news stories.

Arul Menezes, partner research manager of Microsoft’s machine translation team, said that they set out to prove that its systems could perform about as well as a person when it used a language pair – Chinese and English – for which there is a lot of data, on a test set that includes the more commonplace vocabulary of general interest news stories.

“Given the best-case situation as far as data and availability of resources goes, we wanted to find out if we could actually match the performance of a professional human translator,” said Menezes, who helped lead the project.

The research team can apply the technical breakthroughs they made for this achievement to Microsoft’s commercially available translation products in multiple languages.

That will pave the way for more accurate and natural-sounding translations across other languages and for texts with more complex or niche vocabulary.

To reach the human parity milestone, researchers worked added a number of other training methods that would make the system more fluent and accurate.

These methods mimic how people improve their own work iteratively, by going over it again and again until they get it right.

“Much of our research is really inspired by how we humans do things, said Tie-Yan Liu, a principal research manager with Microsoft Research Asia in Beijing.

The researchers also developed two new techniques to improve the accuracy of their translations, Zhou said.

These techniques could be useful for improving machine translation in other languages and situations as well. He said they also could be used to make other AI breakthroughs beyond translation.

PTI

Subscribe to our newsletter

You will get all our latest news and articles via email when you subscribe

The email despatches will be non-commercial in nature
Disputes, if any, subject to jurisdiction in New Delhi

Leave a Reply

Opinion

Justice That Is Instant Is Travesty

But neither the state nor society can wash their hands off this social craving for settling scores in the name of doing justice to the victim

Karnataka Voters Punished INC, JDS Leaders

Even the BJP was not confident of the result even as their leaders kept saying for public consumption they were winning all the 15 seats

The United States Of The World

The United States, stereotyped as the land of plenty and plentiful guns, is still a destination of choice for people from across the world

प्याज़ के आँसू न रोएँ — महंगाई से किसान, उपभोक्ता दोनों को फ़ायदा

जिस अल्प मुद्रास्फीति की वजह से वे सरकार से बहुत खुश थे, उसी 1.38 प्रतिशत की खाद्यान्न मुद्रास्फीति के कारण किसानों को अपने पैदावार के लिए समुचित मूल्य नहीं मिल रहे थे

CAB Can Correct Wrongs Of NRC

… if the government can fix the inept bureaucracy and explain what happens to those marked as aliens, as the neighbours are not taking them back
- Advertisement -

Elsewhere

India responds to Pakistani take on CAB late, but how!

India responded also to Bangladesh foreign minister's cancellation of India visit, but this response was measured and reconciliatory

Ayodhya verdict: SC dismisses all 18 review petitions

The rejection of the review petitions has removed the last hurdle in building the Ram temple Hindus have been promised in Ayodhya

Hanging Nirbhaya case convicts: The procedure

What happens on the day designated for execution by hanging at Tihar: From waking the convict up at 5 AM to issuing of the death certificate

Indian citizens now: Pre-2015 non-Muslim refugees from Pakistan, Bangladesh, Afghanistan

'Modi government trusts the Constitution of the country and I assure you that this country will never be Muslim-free,' Shah said, however, allaying the fears of the largest minority community in India

CAB: Assam erupts, curfew in Guwahati, internet blocked

A student protesting against CAB called the Sonowal government 'barbaric'; until CAB is withdrawn, the demonstrators won't yield, he said

You might also likeRELATED
Recommended to you

For fearless journalism

%d bloggers like this: