Future Tech

How Skype’s Star Trek Translator Works

Brad Merrill 10-03-2015

Skype has been breaking down geographical barriers since its inception, but the new Skype Translator is set to break down language barriers, and fundamentally change the way people communicate across national borders. Imagine having a real-time conversation with someone on the other side of the planet who doesn’t speak a word of your language. For the first time ever, Skype Translator makes that possible.


What Is It?

Skype Translator does something that has long been a dream of science fiction 3 Examples of Amazing Science Fiction Tech That Became Reality Technology is difficult to predict, because it often develops in response to new needs or changing situations that are difficult to imagine. There are, however, a few sci-fi books that were particularly prophetic. Read More : it allows people who speak different languages The 8 Best Language Learning Apps That Really Work Want to learn a language free? These are the best free language learning apps that will have you speaking a new language before you know it. Read More to communicate verbally. Each person’s words are translated in real time and repeated in the other’s native language — making for a very seamless, natural conversation. It’s not a perfect system, of course, but it has a lot of potential and will likely give Skype an edge amid growing competition from Apple’s FaceTime and smaller video chat startups Sick of Skype? 7 Best Free Skype Alternatives Skype alternatives can free you from mediocrity and greatly improve the video chat experience. This article covers eight options. Read More .

How It Works

What makes Skype Translator interesting, to me, is that none of its components are necessarily revolutionary on their own. It’s a set of preexisting technologies that Skype — with help from its parent company Microsoft — has skillfully combined to build a truly innovative product. This, you could argue, is how the best products are made — not by inventing something totally new, but by combing the resources you already have in a way no one has done before.

When you travel to a foreign country where you don’t speak the language, a translator is essential. A translator acts as a middleman, allowing communication between people who don’t speak a common language. Skype Translator works similarly: it adds a bot to your conversation — essentially a third participant in the call — and the bot performs the function of a human translator. It translates what you say when you’ve finished talking, and it translates what the other person says when they’ve finished talking. Then, using text-to-speech technology, it reads the translation aloud.

On the surface, it looks pretty simple — but there’s more to it than meets the eye.

Speech Recognition



Speech recognition — a critical component of Skype Translator — has been terrible for a long time. The range and ambiguity of human speech is a nightmare for speech recognition engineers, especially when filtered through the noisy, tin-can speakers of mobile devices. Recently, however, you may have noticed a major improvement in the quality of speech recognition, for services like Siri, Cortana, and Google Now.

This is due to the influence of a technology called “Deep Neural Networks Microsoft vs Google - Who Leads the Artificial Intelligence Race? Artificial intelligence researchers are making tangible progress, and people are starting to talk seriously about AI again. The two titans leading the artificial intelligence race are Google and Microsoft. Read More ” (DNN), a method shown to produce much more accurate, robust results than conventional speech-to-text systems. After applying more than 300 hours of speech-training to a DNN system for speech recognition, Microsoft researchers achieved a word-error rate of just 18.5 percent, down 33 percent when compared to results obtained from a leading conventional speech-to-text system.



After transcribing spoken words into text, Skype Translator translates that text from one language to another using the same technology that powers Bing Translator. The system is specifically trained for conversational language, which differs from other translation models designed for formal written text. It combines the broad language knowledge of Bing Translator with an additional layer of words and phrases commonly used in spoken conversations. On top of that, it automatically removes filler speech like ‘ahs’ and ‘umms’ and dead air.


Machine Learning

The secret sauce behind each of the components of the Skype Translator is Microsoft’s robust machine learning How Intelligent Software Is Going to Change Your Life Skynet is coming, and it's going to be incredibly popular. New AI technologies are emerging that will chance the way we live, play, and work, Read More  platform. The software learns from a variety of sources — including translated Web pages, videos with captions, and actual one-to-one training data — to better understand and translate the wide variety of topics, accents, and dialects of Skype’s users. All of this data is entered into the machine learning system and used to build a statistical model of the words and their contexts — so when you say something in a Skype Translator conversation, the software can search for something similar within that statistical model and provide an appropriate translation accordingly.

The Experience

Skype Translator is currently available as an early preview, and initial testers seem to love it. Peter Bright of Ars Technica, despite having some initial setup issues, was particularly impressed:

I don’t speak a word of Spanish—I took German at school instead—but with Skype Translator I was able to have a spoken conversation with a Spanish speaker as if I were in an episode of Star Trek (as long as that episode isn’t Darmok, amirite?). I spoke English. A moment later, an English language transcription would appear, along with a Spanish translation. Then a Spanish voice would read that translation.

It took a moment to get used to the pacing of the conversation—the brief delay for the translation means that if you understand the language of the other person, there’s a temptation to respond immediately, without waiting for the voice to read the translation—but once this rhythm was learned, the conversation was fluent and continuous.

By all accounts, the experience is incredible.

Is It Practical?

As excited as I am about Skype Translator, I’m not sure I’ll use it to talk to my foreign language friends. Why? Because I don’t have any foreign language friends. Most people don’t — language is a pretty big barrier for starting any relationship. Will this technology change that? Perhaps — but it will take some time.


Skype Translator could become a valuable asset for international business, so long as it’s accurate. Beyond that, as Peter Bright points out, it could find value in mixed language families where grandparents and grandchildren do not share a common tongue.

There are a lot of applications for this technology, and as other companies begin to do similar things — as they almost certainly will — it will open up possibilities for relationships that never would have been possible before. Who knows? Maybe in a few years I will have some foreign language friends.

If you’d like to register to be Skype Translator preview user, you can do so here.

In the meantime, we want to hear your thoughts! Will you use Skype Translator? Are you excited about it? Let us know in the comments below!


Image Credit: Skype, TechCrunch

Related topics: Artificial Intelligence, Microsoft, Skype, Translation.

Affiliate Disclosure: By buying the products we recommend, you help keep the site alive. Read more.

Whatsapp Pinterest

Leave a Reply

Your email address will not be published. Required fields are marked *

  1. Majid Kevin Buell
    March 11, 2015 at 5:00 pm

    Turkish and Mandarin and Japanese and and and please!

    • Brad Merrill
      March 12, 2015 at 1:11 am

      The preview is English and Spanish only, but I'm pretty confident those will find their way into the product in time. :-)

  2. AshenWonderland
    March 11, 2015 at 1:38 pm

    I've been avoiding Skype for a long time, since I'm not a huge fan of closed-source proprietary software, but this might be worth playing with a little bit!

    • Brad Merrill
      March 12, 2015 at 1:08 am

      For sure! And I'd say it's only a matter of time before we see competitors moving into this space -- even open source projects, perhaps...

  3. alex @minutizer
    March 11, 2015 at 9:30 am

    using it with friends you ALREADY have, no. But it will be very usefull to chat with people you want to BECOME friends.

    the future is bright, you will be able to use Skype translator and with our billing tool for skype (www.minutizer.com) you can be paid by the students.

    • Brad Merrill
      March 12, 2015 at 1:06 am

      It would definitely be cool to make friends internationally without learning a new language!

  4. Jerome (Barry) Newell
    March 11, 2015 at 8:49 am

    Sounds exciting. How can I install/use Translator? Using Skype on a Linux platform

    • Brad Merrill
      March 12, 2015 at 1:03 am

      The signup form for the preview is here: [Broken URL Removed]

      However, I don't see Linux in their list of platforms in the signup form. Not even an 'Other' option -- weird! I imagine they'll offer it for Linux users when the final product comes out, but perhaps not for the preview.

  5. Christa
    March 11, 2015 at 4:24 am

    I tutor foreign children with English but my native language is German. I would definitely love to have the translator in pashto or arabic available to help in the beginning when a child doesn't know so much English. I will definitely see if i can test it with Spanish. Sounds like a great idea.

    • Brad Merrill
      March 12, 2015 at 12:57 am

      That sounds like an awesome application of this technology, Christa!

  6. Earl Strassberger
    March 11, 2015 at 2:53 am

    it looks great. What languages are available?

    • Brad Merrill
      March 11, 2015 at 2:56 am

      It's only English and Spanish right now, with more languages in the works.