The debate over the effectiveness of artificial intelligence (AI) vs. human capabilities is more relevant than ever. While it’s easy to fall into the trap of viewing them as rivals, the real question is how the two can work together to be more effective. A recent conversation inside Monterey Language Service highlighted this future trend, revealing the crucial role that human expertise plays in AI development.

Humans can make AI better

In copy editing, AI can analyze text for grammatical errors, and even adjust tone and style based on the context. However, as Gary pointed out, AI may handle at best 80-90% of the editing process, but the last step often requires a human touch: flexible, context-aware, and capable of grasping nuances that AI might overlook.

Mei-Ling, on the other hand, argued that the focus should be not on the limitations of AI copy editing but on celebrating its rapid development and the role humans can play in enhancing AI capabilities.

The Path Forward: Enhancing AI with Human Expertise

Mei-Ling emphasized the idea that humans can make AI even better by providing it with high-quality training data. This is an important insight: the future of AI doesn’t lie solely in its inherent capabilities but in its integration with humans.

While refining AI’s editing capabilities, we need to provide it with a variety of professional materials to cut its teeth on. There are several ways that humans can do this, and it all begins with giving AI high quality writing to train on.

But what specific steps should be taken to move forward? There are many things we can do including, but not limited to the following:

• Clearly sharing context information with AI concerning the relevant conversation or the audience
• Exposing AI to detailed examples of human conversation, including informal language, idioms, and regional dialects
• Training AI to recognize and respond to emotional cues
• Sharing cultural nuances and social norms
• Guiding AI to better understand references and humor
• To model turn-taking and back-and-forth dialogue to AI
• Helping AI understand the tone, rhythm and flow of human conversation
• Feeding high quality content to AI
• Providing feedback on how the AI’s responses come across

By combining these approaches, professional linguists can play a vital role in shaping AI. More than ever, we as human translators and interpreters have a lot of work to do, particularly in connection with individual creativity and uniqueness.

Our Previous Blogs about AI

Monterey Language Services has constantly kept an eye on AI development. Our blog series since August of 2023 has been aimed at showing how the synergy of human creativity can elevate AI performance.

Check out our previous blogs about AI:

Professional Copyediting after Content Creation: Staying ahead of the AI curve

Blue and White Porcelain: The Joy of Translation from Behind the Scenes

A Love Letter to Chinese Culture — Blue and White Porcelain Lyrics

Advice to Future Interpreters

Interpreters and Music: Translation Accuracy

Interpreters and Voices: On Human Aura

Interpreters and Voices: On Human Recording

AI Performing Music: On Human Individuality

Diversity and Richness: Interpreters and Music

Thoughts about AI: Interpreters and Music

AI and Translation

These blogs discuss AI’s capabilities, how we have worked with it and what our expectations are.

“AI is able to follow patterns to come up with solutions that others may have thought of and implemented before, but without managing to achieve such originality on their own. Is it possible for AI to progress towards greater individuality and uniqueness?” ( AI Performing Music: On Human Individuality)

“AI is capable, but then can AI interpret our tones, our feelings, our energy, our life, our passion, our emotions, and our sense of mission that professional interpreters have shared?” ( Thoughts about AI: Interpreters and Music)

 Conclusion

Rather than debating whether humans or AI did better in copy editing, the blog is intended to celebrate the collaborative efforts that can make AI development and human creativity progress together. Ultimately, it’s essential to value partnership over competition. The future of copy editing will depend on our ability to combine human expertise with artificial intelligence to create something truly remarkable.

We often present clients with guidance on how to work with interpreters, and frequently get asked about AI. This is because many people are waiting for the day that they can simply go online and use AI to seamlessly translate between two different languages, but we would like to say it out loud here: THAT DAY HAS YET TO COME.

Please also check out this flip-book we’ve made https://heyzine.com/flip-book/20de67a12a.html

Please also check out our playlist for Chinese localization case studies: https://www.youtube.com/playlist?list=PLO-QGEbwcTr14xqfiR38Mp-EhHAmclsUY

We localized the Interpreters and Music video into traditional Chinese as an example to compare translation accuracy between humans versus AI and to identify some classic AI issues.

One of the biggest weaknesses of AI is that it often struggles with names. For instance, the name “Laura” was translated into both “蘿拉” and “勞拉.” When we saw this inconsistency in names, we looked at each other with amusement because this happens all the time. Some may say AI spelling names incorrectly isn’t a big deal since it’s an easy fix. However, for those people, we’d like to share a real-life example.

In a lease contract we worked on, Paragraph 1 said that the landlord shall be known as ‘A’ and the tenant as ‘B’. Paragraph 2 called the landlord ‘C’ and the tenant ‘D’. This was a document with 30,000 words that a client asked us to quote for reviewing the translation, which had probably been done by an AI. Just in terms of reviewing names, how much effort would it take to find out if there were places that call the landlord “E” and the tenant “F” and so on? Not to mention all the work it would take to find other mistakes that humans typically need several rounds of review to detect.

Our analysis also uncovered that AI defaults to using the pronoun “你,” referring to males and offering no female form “妳.”

AI have translated love song titles like “Suddenly Missing You” and “Stuck on You” into traditional Chinese, using the male form. The male singers may not prefer using the male form of “you” in their love song titles. Otherwise, a native speaker in traditional Chinese would feel kind of strange, reading it.

We inserted line breaks on messages that appear in the video. With line breaks, AI seemed to lose the context of the lines.

Line breaks are important. We are often requested to insert line breaks in Asian language marketing materials. Take Japanese line breaks as an example. There are some basic rules for line breaks or how to break words up, but at the same time, there are a lot of exceptions, which humans can easily catch if they understand Japanese, but not AI. In other words, humans break things apart (debriefing) and put them together in a creative way, which AI is just not capable of.

It turns out that AI struggles to translate any segment accurately and, at times, produces unnatural and contextually absurd translations. As shown in the screenshot below, even with a relatively short source text, the quality of AI translation was unbelievably subpar.

AI translated “interpretation” as “explanation” due to a lack of context.
AI translated “Performance” to machine’s performance rather than that of the interpreter’s.
AI mistakenly translated the meaning of “like” as “to be fond of” instead of “similar to.”
AI word-for-word translation for “big heart” doesn’t make sense to a Chinese audience.

It’s clear to us that AI is not able to handle messages that are broken down by line breaks. This then leads us to a question: How well could AI handle entire messages without line breaks?

We conducted a retest by removing all the line breaks on messages. In this attempt, the text was formatted in a more machine-friendly way to enhance AI’s understanding. But even so, post-editing remained an essential step, with 80% of the segments requiring significant human intervention. Without this crucial step, AI translations either come across as rigid and less relatable to our audience, or contain mistranslations. Below are some examples.

Example 1:
The AI translation appears rather stiff because the word “sync” was translated literally. The audience might wonder what it means to “sync” one language to another. Human translators are able to further explain the context of sync, that is, interpreters “listen to one language and convey it in another language.”

Example 2:
AI translated “more emotionally acute” as “more impatient,” which not only deviates from the intended meaning of the source, but also negates the impact of the word “music”. During post-editing, we replaced it with “more emotionally sensitive,” which is more contextually accurate.

Example 3:
AI did word-for-word translation again. It doesn’t sound like what a normal person would say in Chinese. As a dynamic language, Chinese favors verbs over nouns and usually keeps sentences short. Therefore, in post-editing, we restructured the sentence to make it fit a typical Chinese writing style, and flow more naturally.

Example 4:
AI’s translation of “concentration” lacked clarity. Without referring to the source, it was hard to grasp the intended meaning. So, we opted for a more precise choice of words.

Example 5:
AI does a literal translation, full of ambiguity and rigidity, which doesn’t make clear sense to a Chinese audience.

Translation is supposed to flow naturally to engage the audience. It is the more immersive and relatable experiences that make humans feel comfortable. These are exactly the areas where we as interpreters and translators can contribute to.

There may be a lot of gloom and doom from some in the community who think that their jobs are at risk, however, the reality is that we’re training AI to speak our language, but they aren’t able to fully understand it like we can. They can process it, try and find the corresponding pattern in their database, and come to a conclusion that they think is right, but they won’t always be. That’s where interpreters and translators will always have the edge over AI. Human creativity and our ability to understand what’s important, and the culture embedded in it, enables us to make sure that we are conveying the intended message.

We tried one of the latest AI platforms to translate one of our office videos into Mandarin.

While we were impressed by the seamless process and the voice cloning feature that enhanced voice modulation, we couldn’t help but notice pronunciation and translation errors in the generated video. Given that Mandarin Chinese is a tonal language, tones can become a source of misunderstanding if not pronounced correctly. The chosen video introduces the rental service of our conference room, making “conference” a high-frequency word. However, throughout the video, AI consistently pronounces the Chinese word for “conference,” as “memory,” with tones differing from the former. Also, “state-of-the-art” in Chinese is pronounced the same way that “cash” is. This could undoubtedly complicate the message we aim to convey if left alone.

The translation issues we caught are mostly recurring problems caused by machine translation as discussed above. Take the first sentence as an example. AI translated “Looking for a conference room to have a meeting over video or in person?” as “Can you look for a conference room via video or in person meeting?” AI’s rendition deviates from the original meaning, which is likely caused by line breaks, leading to confusion and miscommunication. Such discrepancies underscore the importance of post-editing and human intervention to refine machine-generated translations.

Our conclusion becomes clear.

In this age of AI becoming more prevalent, humans just need to work smarter to beat out AI. As individuals in an evolving world, it’s important to accept technological advancements, but also understand that AI lacks creativity, individuality, improvisation capability, and the understanding of human cultures. That’s how humans can break through and go beyond AI’s limitations.

Behind the Scenes Part V

Please see samples here: https://www.youtube.com/playlist?list=PLO-QGEbwcTr2MdhbLPPGszMw8Rdc5J9aI

Behind these formal presentations of audio video recordings, there’s something very intriguing and interesting happening behind the scenes. In a very liberal sense, we are not too different from journalists or reporters who report on stories due to inspiration from those around them. What primarily drove us to begin and continue this project were the comments and feedback from interpreters and our colleagues. They have helped prompt and shape our actions, ultimately leading us to explore further, and continue our quest for answers on what the future will be like between AI and interpreters. Some interpreters are worried about not being able to make ends meet in the future, while others are asking why they should worry about AI. Will human language disappear? Will humans become like computers communicating with each other without having to verbally speak as certain individuals claim?

Whether we like it or not, AI will become more and more prevalent on public transportation, on social media, on our phones, in our daily life, and even in our industry. There seems to be a trend where humans make language simpler and friendlier for AI, so it becomes easier and more accurate for AI to translate or interpret. In this way, humans become a conduit for AI and AI becomes a useful tool for people worldwide to communicate with each other instantaneously. AI has evolved to become our translators and interpreters, and this application of AI has steadily become more popular over time. Ever since Google Translate was released, there have been increasingly new AI platforms such as AI video translation, AI spokesperson translation, and so on, that have surfaced. AI has been developed so quickly and accurately that it is just a matter of time until humans fully adopt AI. We tried our hand using one of the latest AI platforms to translate/interpret one of our office videos into Chinese. The results were impressive, but not without some imperfections. The AI voice did much better than the usual, generic robotic voice we typically hear, which most likely has to do with voice cloning.

In the face of rapid development of AI, does it mean that eventually we as interpreters will no longer be needed? How should we give guidance to the younger generation who aspire to become interpreters or translators? These are serious questions that make us really sit down and think and here is what we would like to share.

AI voices are serviceable, but they lack the beauty and liveliness that human voices have. That’s why human voices will always have a place in our world. This is what we set out to prove with the Interpreters and Voices series, and we think we have succeeded. In this blog, we are giving a conclusion about our thoughts on AI and human voices. Everyone knows AI voices are usually robotic and monotonous, but with voice cloning technology, AI could sound better and less robotic. This is why, even in the future, human voices will always play a role because they have that personal touch, which allows us to feel heard and assured. In the Interpreters and Voices series, 17 of our passionate interpreter colleagues have recorded themselves reading various blogs on AI nature and capabilities. Our colleagues have demonstrated how human voices are beautiful and lively compared to AI’s. It shows how big of a gap there is and how big of a gap there will always be between human voices and AI.

First, thanks to the participating interpreter Liling who introduces the concept of “aura” from a mechanical engineering point of view. She said AI-voice interpretations lack a key element – “Aura”.  Aura refers to a quality integral to an artwork that cannot be communicated through mechanical reproduction techniques and was used by Walter Benjamin in his influential 1936 essay “The Work of Art in the Age of Mechanical Reproduction”. Human-created artwork has its presence in time and space, its unique existence at the place where it happens to be, its ‘aura’.  Using this analogy, each interpreter recording has his/her unique interpretation in a unique space, time, and place, thereby creating an artwork with “aura”.

Second, while AI voices can only say exactly what they are programmed to say, interpreters are able to use their own individuality, smarts, and uniqueness to come up with clever phrasing that perfectly fits the situation, rather than just a word for word translation. Interpreters deliver words in a very exciting way that is palatable to the ear and also interesting to listen to. Each interpreter demonstrated their different interpretation of the script that we provided them. Some interpreters emphasized certain words. Others would, at times, speak at faster speeds. Some interpreters would ad-lib and sing certain parts while others would add a light laugh at a joke. Some interpreters go deeper with a dialogue style as if they are talking to each other, echoing each other, encouraging you to think further, or having a conversation with you. AI is not capable of this kind of responsiveness and communication. All the AI, regardless of which company develops them, lacks variation between them, making it easy to spot them almost right away even if it’s a clone of a human voice!

In the era of AI impacting every industry, including our translation and interpretation industry, these interpreters’ voices seem so wonderful and one of a kind. So we decided to create different collages of voices. We even have different colleagues work separately to create their own versions, and the results are stunning! Despite the colleagues making their own selections from the same pool of recordings, they arranged all the pieces together in different ways to convey their own take on the blog story. The entire project has been about human voices in range, richness, diversity and individuality.  It features different takes on the interpreters’ best individual moments, focuses on elevating each other to higher levels, and aggregates them to a beautiful, powerful collage as a whole. It serves as a reminder that we don’t want a world without human voices and also as a way to perhaps shed some light on the interpretation community. Quite a lot of work has been put into arrange everything for these purposes, but it’s a labor of love, and has been very enjoyable. We’re so excited to share it with everyone!

The video on Interpreters and Voices has a solo and two world versions. The solo version shows how powerful one person can sound while the world versions show how much excitement with many people from all over the world can generate. The world versions feature multiple interpreters from around the world, namely Asia, Europe, North and South Americas, and the Caribbeans. Each participating interpreter submitted their own unique and individual recording. Our colleagues combined them to the effect that it’s almost as if everyone is having a conversation with each other. It’s a truly beautiful collage of voices from around the world, all united for a forum discussion and you’ll feel like you’re right there with them!

It’s fairly easy to spot where different interpreters come from in the world, and it’s all thanks to their distinct styles. At times they are lighthearted, emphatic, or communicative that are embedded in their respective cultures. It’s truly a globally cultural feast! It’s also a showcase of the auras, emotions, and cultures prevailing in the world. Did you feel engaged listening to the interpreters? This collection of auras is something very difficult if not impossible for AI to mimic. We believe that as long as humans carry their own aura and pour it into their creations, AI will have a hard time getting a leg up over humans.

The video on Human Individuality, we’ve also created two versions: a trio and a quartet. The two versions feature three and four interpreters, respectively, and were also created by two different colleagues separately. The effect this makes is quite pronounced, and you feel as if you’re listening to two different pieces entirely.

For the short and sweet Thoughts about AI piece, we initially thought that with the way the content is structured, it’d be best for two interpreters to read it. But then what would happen if we added a third interpreter, someone who comes from another part of the world, instead of the duet of interpreters from the United States? The trio piece features wonderful chemistry between the three interpreters, and if you stay until the end, you’ll be rewarded with a surprise, which we are sure all listeners will enjoy! We have also made a solo version for those who might have been overstimulated by the different voices, and for those who might prefer just a single vocalist instead of an entire band. We enjoyed all of these so much, and absolutely recommend you check them out too! We’ve provided links to the audio and video series below for easy access!

Other than being fun, this project has also helped us see the bigger picture when dealing with translation and interpretation projects. Now we see our overall role very clearly and understand better what’s more important in the work we do. Therefore, we plan to show the series to younger generations, so they understand that translators and interpreters will always have work, and their value to this world will never change. The aura that naturally comes from being a human interpreter has and always will be something sought after. As long as we have energy and fun as humans and as interpreters, we will never have to worry about being replaced by AI. However, if we lose our energy or fun, we are doomed to surrender to AI superiority.

If you would like to encourage the next generation that there is a future for them, and they shouldn’t give up, we’d love to hear your advice to those who aspire to join our industry in the future. We will gather advice from all sources and present them in our next blog. We think that’s what we as translators and interpreters should aim for when we pass the torch on to the next generation in the face of a potentially AI dominated world! But we must always remember that interpretation is like art or music, or a fine-tuned performance, and that’s one thing area humans will remain dominant in for years to come!

Links to Audio Recordings:
1. Thoughts about AI (Solo Version): Posted
2. Thoughts about AI (Duet Version): Posted
3. Thoughts about AI (Trio Version): Posted
4. Diversity and Richness: Posted
5. Human Individuality (Trio Version): Posted
6. Human Individuality (Quartet Version): Posted
7. Interpreters and Voice (Solo Version): Posted
8. Interpreters and Voices (World Version 1): Posted
9. Interpreters and Voices (World Version 2): Posted
10. Human Aura: To Be Posted

Reference Video: Interpreters and Music

Audio link: https://www.youtube.com/watch?v=4UN-K8OIMCs

Ever since we began the video project on Interpreters and Music, we’ve felt a lot of energy from the interpreters who have been kind to join us on our initiative to explore the relation between AI and interpreters including such questions as: What will the future look like for these two? Will interpreters become a conduit for AI?

This all ultimately led us to compare AI and interpreters. We are on a journey to highlight professional interpreter’s strength over AI, and human voices are one of the areas we’d like to compare.

We have invited quite a few interpreters to participate in the “Interpreters and Voices” project. After only hearing the premise and description of the project, many interpreters have described the project as “interesting”, “great fun”, “wonderful”, “something new and exciting”, “fascinating”, and “riveting”. We thank all of the interpreters who we’ve reached for genuinely sharing their thoughts and we have included some of their ideas in this blog post.

Many of you may agree with us that AI recordings are usually boring, if not unsettling. The natural inflexions of speech are missing, and their robotic, monotonous tone drive us crazy! Even so, the threat of AI recording looms large as a dark cloud on the horizon. We don’t enjoy AI recordings at all and really wouldn’t want to see the world develop in a way where AI is primarily used over human voices. It would undoubtedly be a tremendous loss to humanity. It’s something that we truly hope won’t occur. It would really take away the joy and emotion that can only be experienced through the vehicle of human voices. By the way, if you know of any interesting AI recording samples, please do feel free to share them with us for our learning purposes.

AI is a wonderful tool of convenience and efficiency in modern times; but there are still certain things that AI simply cannot produce. Even though AI may be able to replicate the breathing, pauses, and quivering of human voices, these elements always sound timed and programmed. If spoken or read by a human, the words would be conveyed in different styles with emotions and be paced at different speeds. Let’s take the diversity and richness audio file as an example, it was read by 3 interpreters with 3 main styles, professional, expressive, and artistic. The reading speeds at times are normal, fast, or slow. Yet the combination, or mix, or interaction of these elements creates a charming, attractive, even sensational atmosphere that entices us to listen. Honestly, we’ve listened to it more than a handful of times! The more we listen to it, the more we feel the pleasure and ambience, as if we were brought to another world. We are totally immersed.

Distinctness between each speaker is something else that AI cannot replicate. In the recordings, we hear richness of styles—all of which communicate the individuality of the reader and storyteller. These styles can range from being personal, professional, emotional, poetic, artistic, expressive, explanatory, upbeat, engaging but not overemphasizing, measured, modulative, and sporadic in regards to pacing. We are also delighted to hear little off-script moments like singing instead of purely reading. Yeah, a little surprise is the spice that keeps the audience interested and entertained and it’s that exact element that keeps blowing us away!

For this project on human voices, the only instruction we gave the interpreters was to give the recording their best shot and then leave the rest for us. The recordings read by quite a few interpreters, not only sound different to the ear because of accent, gender, tone/pitch in their voices, but also the background each interpreter has come from. The interpreters are long time devotees to language and communication, and are also people with interests in poetry, storytelling, and cultural performances. The interpreters apply their own unique interpretations to reflect how they perceive the text. One interpreter might make a certain sentence or phrase sound more important or expressive, whereas another interpreter might read it in a lighter sense. We all parse and deliver messages differently despite general similarities.

Interpreters use their voices to produce work every day, therefore, it’s wonderful to aggregate their voices in a collage. We have rotated different voices, even deliberately paired up different voices, male and female, low and high, fast and slow, personal and professional to show contrast. The different takes on the recordings is where the teamwork gets really upgraded to exciting and magical levels. AI is limited in the sense that it lacks the kind of creativity and artistic expression that comes to humans so naturally. Humans are best at creating and putting our own spin on things. Having different interpreters read the same blog and then combining them all into one recording is a great way to showcase how individualistic we sound as humans even when we’re doing the same activity.

The participating interpreters took time out of their busy schedules to do the work pro bono. The common goal is to demonstrate that professional interpreters do so much better in recording than AI does. Hearing the interpreters’ recordings really helps drive home the difference between human individuality and the monotonous nature of AI. We really think this project is special because it helps to show something that everyone, not just people in our industry need to see. Please feel welcome to share this with everyone, but certainly not for the purposes of training AI! Last but not least, a final, big shout-out to the participating interpreters. Thank you so much for the wonderful and abundant voices. They are truly music to our ears. Working together, we have demonstrated the power and strength of professional interpreters in our voices over AI, and the journey must go on!

Originally we were thinking about comparing AI narration to humans by putting them one after another, but we realized that the contrast is not as significant as we initially believed. This is because humans are typically only able to endure AI narration for nothing more than a few paragraphs. After that, humans recognize the mechanical, robotic patterns that are inherent to AI narration. After realizing that, humans make the decision to stop listening. Please feel welcome to let us know after how much of the AI recording you listened to before you decided to give up! We think it will be a very interesting fact to explore!