We often present clients with guidance on how to work with interpreters, and frequently get asked about AI. This is because many people are waiting for the day that they can simply go online and use AI to seamlessly translate between two different languages, but we would like to say it out loud here: THAT DAY HAS YET TO COME.

Please also check out this flip-book we’ve made https://heyzine.com/flip-book/20de67a12a.html

Please also check out our playlist for Chinese localization case studies: https://www.youtube.com/playlist?list=PLO-QGEbwcTr14xqfiR38Mp-EhHAmclsUY

We localized the Interpreters and Music video into traditional Chinese as an example to compare translation accuracy between humans versus AI and to identify some classic AI issues.

One of the biggest weaknesses of AI is that it often struggles with names. For instance, the name “Laura” was translated into both “蘿拉” and “勞拉.” When we saw this inconsistency in names, we looked at each other with amusement because this happens all the time. Some may say AI spelling names incorrectly isn’t a big deal since it’s an easy fix. However, for those people, we’d like to share a real-life example.

In a lease contract we worked on, Paragraph 1 said that the landlord shall be known as ‘A’ and the tenant as ‘B’. Paragraph 2 called the landlord ‘C’ and the tenant ‘D’. This was a document with 30,000 words that a client asked us to quote for reviewing the translation, which had probably been done by an AI. Just in terms of reviewing names, how much effort would it take to find out if there were places that call the landlord “E” and the tenant “F” and so on? Not to mention all the work it would take to find other mistakes that humans typically need several rounds of review to detect.

Our analysis also uncovered that AI defaults to using the pronoun “你,” referring to males and offering no female form “妳.”

AI have translated love song titles like “Suddenly Missing You” and “Stuck on You” into traditional Chinese, using the male form. The male singers may not prefer using the male form of “you” in their love song titles. Otherwise, a native speaker in traditional Chinese would feel kind of strange, reading it.

We inserted line breaks on messages that appear in the video. With line breaks, AI seemed to lose the context of the lines.

Line breaks are important. We are often requested to insert line breaks in Asian language marketing materials. Take Japanese line breaks as an example. There are some basic rules for line breaks or how to break words up, but at the same time, there are a lot of exceptions, which humans can easily catch if they understand Japanese, but not AI. In other words, humans break things apart (debriefing) and put them together in a creative way, which AI is just not capable of.

It turns out that AI struggles to translate any segment accurately and, at times, produces unnatural and contextually absurd translations. As shown in the screenshot below, even with a relatively short source text, the quality of AI translation was unbelievably subpar.

AI translated “interpretation” as “explanation” due to a lack of context.
AI translated “Performance” to machine’s performance rather than that of the interpreter’s.
AI mistakenly translated the meaning of “like” as “to be fond of” instead of “similar to.”
AI word-for-word translation for “big heart” doesn’t make sense to a Chinese audience.

It’s clear to us that AI is not able to handle messages that are broken down by line breaks. This then leads us to a question: How well could AI handle entire messages without line breaks?

We conducted a retest by removing all the line breaks on messages. In this attempt, the text was formatted in a more machine-friendly way to enhance AI’s understanding. But even so, post-editing remained an essential step, with 80% of the segments requiring significant human intervention. Without this crucial step, AI translations either come across as rigid and less relatable to our audience, or contain mistranslations. Below are some examples.

Example 1:
The AI translation appears rather stiff because the word “sync” was translated literally. The audience might wonder what it means to “sync” one language to another. Human translators are able to further explain the context of sync, that is, interpreters “listen to one language and convey it in another language.”

Example 2:
AI translated “more emotionally acute” as “more impatient,” which not only deviates from the intended meaning of the source, but also negates the impact of the word “music”. During post-editing, we replaced it with “more emotionally sensitive,” which is more contextually accurate.

Example 3:
AI did word-for-word translation again. It doesn’t sound like what a normal person would say in Chinese. As a dynamic language, Chinese favors verbs over nouns and usually keeps sentences short. Therefore, in post-editing, we restructured the sentence to make it fit a typical Chinese writing style, and flow more naturally.

Example 4:
AI’s translation of “concentration” lacked clarity. Without referring to the source, it was hard to grasp the intended meaning. So, we opted for a more precise choice of words.

Example 5:
AI does a literal translation, full of ambiguity and rigidity, which doesn’t make clear sense to a Chinese audience.

Translation is supposed to flow naturally to engage the audience. It is the more immersive and relatable experiences that make humans feel comfortable. These are exactly the areas where we as interpreters and translators can contribute to.

There may be a lot of gloom and doom from some in the community who think that their jobs are at risk, however, the reality is that we’re training AI to speak our language, but they aren’t able to fully understand it like we can. They can process it, try and find the corresponding pattern in their database, and come to a conclusion that they think is right, but they won’t always be. That’s where interpreters and translators will always have the edge over AI. Human creativity and our ability to understand what’s important, and the culture embedded in it, enables us to make sure that we are conveying the intended message.

We tried one of the latest AI platforms to translate one of our office videos into Mandarin.

While we were impressed by the seamless process and the voice cloning feature that enhanced voice modulation, we couldn’t help but notice pronunciation and translation errors in the generated video. Given that Mandarin Chinese is a tonal language, tones can become a source of misunderstanding if not pronounced correctly. The chosen video introduces the rental service of our conference room, making “conference” a high-frequency word. However, throughout the video, AI consistently pronounces the Chinese word for “conference,” as “memory,” with tones differing from the former. Also, “state-of-the-art” in Chinese is pronounced the same way that “cash” is. This could undoubtedly complicate the message we aim to convey if left alone.

The translation issues we caught are mostly recurring problems caused by machine translation as discussed above. Take the first sentence as an example. AI translated “Looking for a conference room to have a meeting over video or in person?” as “Can you look for a conference room via video or in person meeting?” AI’s rendition deviates from the original meaning, which is likely caused by line breaks, leading to confusion and miscommunication. Such discrepancies underscore the importance of post-editing and human intervention to refine machine-generated translations.

Our conclusion becomes clear.

In this age of AI becoming more prevalent, humans just need to work smarter to beat out AI. As individuals in an evolving world, it’s important to accept technological advancements, but also understand that AI lacks creativity, individuality, improvisation capability, and the understanding of human cultures. That’s how humans can break through and go beyond AI’s limitations.

1. Choose the right interpreter: Effective interpretation starts by choosing the right interpreter. Ensure that the interpreter has the necessary skills and experience to interpret accurately between the languages involved. Consider their expertise in the subject matter and their cultural sensitivity as well, as these factors can greatly impact the accuracy of the interpretation.
2. Provide background information: Background information such as subject matter, names and titles of participants, context and purpose of the event can greatly help with the accuracy of the interpretation. The more information interpreters have before the event, the better their performance will be. To provide and gather background information is considered a necessity in the interpretation process. To be exact, the interpretation process starts before the event itself.
3. Create favorable environment: Ensure that the interpreter has a clear line of sight and sound to all participants in the conversation. Experienced clients usually treat interpreters with courtesy and thoughtfulness in order to provide a favorable environment for the interpreter to work in. The goal is to help the interpreter enhance their performance and ensure that the interpretation is as accurate as possible.
4. Speak clearly and at a moderate pace: Interpreters must be able to understand the language they are interpreting. Speaking clearly and at a moderate pace can help the interpreter accurately convey the intended message. Avoid using overly complex language, because it can reduce the processing time in interpreter’s brain, help the interpreter render interpretation in an easy and smooth way.
5. Avoid distractions: Interpreters must concentrate to accurately convey both the content and tone of a conversation. Any distractions or interruptions can disrupt the flow of the interpretation process and impact interpretation in a negative way. For instance, if video interferes with audio output, then refrain from asking interpreters to appear on video. Asking interpreters to be on video usually is more distracting than not to be on video. Also avoid any activities that may be distracting, such as talking on the phone or texting.
6. Provide feedback: If there is any confusion or misunderstanding during the interpretation process, it is important to provide feedback to the interpreter. Collaboration rather than confrontation is more conducive to the outcome you would like to achieve in a communication event.

Keeping open channels of communication is of utmost importance. To ensure smooth communication, we are sure to leave notes and give explanations. We also have our process documented and written down. When we don’t know how to handle something, we can look to see if there is a relevant guide already written. If there is not, we can write one so that the next person with a similar problem will have more resources at their fingertips. Emails, text messaging, voice messages, and phone calls are ways to communicate and we choose our method depending on the urgency of the task at hand.

There are things that a single person can’t or doesn’t know how to handle alone. This is why we make it a point to always ask for help when we need it. This way, more challenging problems are dealt with sooner rather than putting them off or sweeping them under the rug. For example, we had to figure out our new tax responsibilities. Taxes are usually complex to deal with, but with several people working with different sources, we were able to check our information against each other. This led to clarity. During the process, we found different opinions, but it was that confusion that helped us identify the problem areas and showed us where we needed to focus and research in order to find the right answer.

Teamwork is important when there is too much work for one person, but that is not the only time teamwork matters. Another key aspect of effective teamwork is understanding everyone’s different roles and their strengths as an individual. Recently, for one graphic design project, we asked one of our team members who hadn’t worked on the project at all to read our instructions. A fresh pair of eyes on the project was needed to make sure that the instructions were clear and understandable to someone who hadn’t seen it before.

We always try to keep a positive attitude. Having the right state of mind can help turn a hectic, stressful day into a learning opportunity and a chance to solve new problems. For example, when we work with certain communities such as blind and deaf/ hard of hearing people, there are extra considerations we must think about. We must make sure that our work is compliant with the American with Disabilities Act. We needed to do some research on it, and took this as an opportunity to learn more about our legal system and about how to help different communities that we want to serve.

Staying positive can keep us energized, productive, and satisfied at work. Having a positive attitude also makes it a pleasure to work with our coworkers and clients, and that helps us build teamwork and respect, which in turn makes tackling challenges easier and more interesting. Last but not least, having passion for the projects encourages us to face challenges energetically. At Monterey Language Services, we know that no problem is insurmountable thanks to our energy, teamwork, and passion for our jobs.