Japanese Publishers Invest in AI Manga Translation Startup
Japanese Publishers Invest in AI Manga Translation Startup
Japanese Publishers Invest in AI Manga Translation Startup
Japanese publishers, including Shueisha and Shogakukan, have invested $4.9 million in Mantra, a startup leveraging AI to accelerate manga translation.
I don't read many mangas, so I don't know how good or bad the translations are, but I thought the news was interesting at least.
Not optimistic. How would this handle localization? Or turns of phrase?
Translators are a cultural bridge that far exceeds the two languages.
A good company will use both. AI does 80% and a human does the final check.
I once did that, still was quite bad.
This is actually one of the best use cases of LLM. Indeed there is culture and nuance that may be lost in translation, but so does every other translation. And most of the time, if we know the literary art being translated ahead of time, we can predict a higher use of more nuanced language and adjust accordingly or skim it by a human.
After all, most "AI" is basically feature embedding in higher dimensions. A different language that refers to the same concept should appear close to each other in those dimensions.
This is actually one of the best use cases of LLM.
No, it's quite simply not. At all.
LLM is an entirely statistical model. To the degree that it strings words together in an order that makes some sort of sense, it's ONLY because those words are statistically likely to be strung together in that order.
Japanese is an extremely imprecise and contextual language, particularly in its written form. Most kanji have multiple meanings, and often even a notably wide range of meanings, so a purely statistical model is already handicapped in any attempt to translate the intended meaning to another language. And Japanese creative writing, and manga especially, depends heavily on deliberately unusual uses of specific kanji to convey subtle bits of background information, moods, attitudes, hidden meanings or the like, or just as wordplay - puns, alliteration and the like.
And LLMs have no way to recognize any of that nuance. All they can do is regurgitate the most statistically likely string of words.
That will likely provide tolerable results with something that's written simply and straightforwardly, but as soon as it gets to any of the countless manga that rely on unusual kanji readings and wordplay to convey nuance, it's going to utterly and completely fail, since it has and can have no actual understanding of the author's intent, so no basis on which to choose the correct reading of the kanji. All it can do is regurgitate the most statistically likely one, which in those sorts of cases is the one that's absolutely guaranteed to be wrong.
I’ve seen enough "Google translations" to know I want nothing to do with this venture.
For those that are interested in a different perspective on this, not of the publishers, but the translators, Anime Herald actually interviewed several professional translators about this topic. I made a post about it here with some discussion as well.
It's a good read and the translators are realistic about what is coming:
Zack Morrison (translator): I would say that, like it or not, AI is coming. That genie is not going back in the bottle. And it is improving. The days of Google Translate being a joke are gone. Who knows what AI translation will be like ten years from now? Twenty? Something people need to think about. Hating it is not going to make it go away.
However, at the same time, the companies making use of it are too optimistic about its current capabilities:
Kim Morrissy (translator): Corporations should definitely be more aware of the current limitations of MTL/AI and not see them as a shortcut to reducing labour costs. It’s not just purely a matter of ethics but making people aware that current applications will either see a big drop in quality or require more human labour than they were led to believe.
that genie is not going back to the bottle
IDK, but the anti-GMO movement managed to mostly put back a genie into its bottle. We just need to fight harder.
AI translation has gotten extremely good. It even replaces the text into English in nearly the same style/font!
I actually used my translator on my phone to read a Japanese manga when I was traveling. It needed another level of human revision, but I was able to get most of the story.
If you where reading manga with a translator app why not go with a scanlation release instead
If you want to read manga in Japanese then I suggest learning Japanese
Hell yeah, AI-assisted Duwang
Someone needs to fine-tune a model on that translation.
The last MTL i read was fine but not great, but that already describes many official localizations out there. Even if the mtl is bad it'll probably get rid of the cheap, low quality localization teams and leave it in the hands of actual talent or passionate fans. Either way i don't see this a being a bad thing.
On the other hand, the biggest localization scandal (for lack of a better word) didn't happen at the translation, it happened when failed YA authors were allowed to rewrite the work, which will still probably be a problem. So it might not do very much good either.
On the other hand, the biggest localization scandal (for lack of a better word) didn’t happen at the translation, it happened when failed YA authors were allowed to rewrite the work, which will still probably be a problem. So it might not do very much good either.
I think this is an important point. If this can take the translator's ego out of the equation it would be a clear win. But then, they would probably insert it back again in the revision stage. My best case scenario would be that with the AI doing the heavy lifting there is enough human workforce going around so that those type of translators who rewrite the story find themself jobless.