{"id":12438,"date":"2025-07-24T16:01:35","date_gmt":"2025-07-24T14:01:35","guid":{"rendered":"https:\/\/it-u.at\/?page_id=12438"},"modified":"2026-09-05T13:20:09","modified_gmt":"2026-09-05T11:20:09","slug":"literary-translation-in-the-era-of-large-language-models","status":"publish","type":"page","link":"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/","title":{"rendered":"Talk 3"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><strong>Title<\/strong>:&nbsp; Literary Translation in the Era of Large Language Models&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Abstract: <\/strong>Automatic literary translation presents a unique challenge due to cultural nuances and the intricacies of literary language. Recently developed large language models (LLMs), such as GPT-4o, promise a new quality level for literary translation, however. This talk explores this central question: <em>How good are LLMs at translating literature, really?<\/em> To answer this question, I examine their performance through both human judgment and automatic evaluation metrics. The findings reveal that results vary significantly depending on the annotators (e.g. student vs. professionals) and the evaluation criteria (e.g. MQM annotation vs. pairwise preferences) used. Moreover, existing automatic metrics, such as XComet or Gemba, are largely inadequate for literary texts. I will then discuss how these metrics can be improved\u2014through fine-tuning on human-annotated data and carefully designed prompts\u2014to better assess the quality of automatic literary translations.&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Title:&nbsp; Literary Translation in the Era of Large Language Models&nbsp; Abstract: Automatic literary translation presents a unique challenge due to cultural nuances and the intricacies of literary language. Recently developed large language models (LLMs), such as GPT-4o, promise a new quality level for literary translation, however. This talk explores this central question: How good are [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":11630,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"class_list":["post-12438","page","type-page","status-publish","has-post-thumbnail","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Steffen Eger: Literary Translation in the Era of LLMs | IT:U<\/title>\n<meta name=\"description\" content=\"Invited talk by Steffen Eger (UTN) on literary translation in the era of large language models - IT:U Summer School 2025 on NLP.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Steffen Eger: Literary Translation in the Era of LLMs | IT:U\" \/>\n<meta property=\"og:description\" content=\"Invited talk by Steffen Eger (UTN) on literary translation in the era of large language models - IT:U Summer School 2025 on NLP.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/\" \/>\n<meta property=\"og:site_name\" content=\"IT:U\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/itu.austria\/\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-05T11:20:09+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/it-u.at\/wp-content\/uploads\/2025\/06\/30\/itu-summer-school_website-header-1500x800px_neu.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1500\" \/>\n\t<meta property=\"og:image:height\" content=\"800\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/literary-translation-in-the-era-of-large-language-models\\\/\",\"url\":\"https:\\\/\\\/it-u.at\\\/en\\\/literary-translation-in-the-era-of-large-language-models\\\/\",\"name\":\"Steffen Eger: Literary Translation in the Era of LLMs | IT:U\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/literary-translation-in-the-era-of-large-language-models\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/literary-translation-in-the-era-of-large-language-models\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/it-u.at\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/30\\\/itu-summer-school_website-header-1500x800px_neu.jpg\",\"datePublished\":\"2025-07-24T14:01:35+00:00\",\"dateModified\":\"2026-09-05T11:20:09+00:00\",\"description\":\"Invited talk by Steffen Eger (UTN) on literary translation in the era of large language models - IT:U Summer School 2025 on NLP.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/literary-translation-in-the-era-of-large-language-models\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/it-u.at\\\/en\\\/literary-translation-in-the-era-of-large-language-models\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/literary-translation-in-the-era-of-large-language-models\\\/#primaryimage\",\"url\":\"https:\\\/\\\/it-u.at\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/30\\\/itu-summer-school_website-header-1500x800px_neu.jpg\",\"contentUrl\":\"https:\\\/\\\/it-u.at\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/30\\\/itu-summer-school_website-header-1500x800px_neu.jpg\",\"width\":1500,\"height\":800},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/literary-translation-in-the-era-of-large-language-models\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"home\",\"item\":\"https:\\\/\\\/it-u.at\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Talk 3\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/it-u.at\\\/en\\\/\",\"name\":\"it:u\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/it-u.at\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":[\"Organization\",\"CollegeOrUniversity\"],\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/#organization\",\"name\":\"IT:U Interdisciplinary Transformation University Austria\",\"alternateName\":\"IT:U\",\"url\":\"https:\\\/\\\/it-u.at\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/it-u.at\\\/wp-content\\\/uploads\\\/2024\\\/09\\\/06\\\/itu-org-logo.jpg\",\"contentUrl\":\"https:\\\/\\\/it-u.at\\\/wp-content\\\/uploads\\\/2024\\\/09\\\/06\\\/itu-org-logo.jpg\",\"width\":696,\"height\":696,\"caption\":\"IT:U Interdisciplinary Transformation University Austria\"},\"image\":{\"@id\":\"https:\\\/\\\/it-u.at\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/itu.austria\\\/\",\"https:\\\/\\\/www.instagram.com\\\/itu.austria\\\/\",\"https:\\\/\\\/www.linkedin.com\\\/school\\\/itu-austria\\\/\",\"https:\\\/\\\/www.youtube.com\\\/@itu.austria\",\"https:\\\/\\\/bsky.app\\\/profile\\\/ituaustria.bsky.social\",\"https:\\\/\\\/www.wikidata.org\\\/wiki\\\/Q115669377\",\"https:\\\/\\\/de.wikipedia.org\\\/wiki\\\/Interdisciplinary_Transformation_University_Austria\"],\"legalName\":\"Institute of Digital Sciences Austria\",\"description\":\"Austria\u2019s emerging public university dedicated to understanding, driving, and evaluating digital transformation for the benefit of our societies, our economy, and our environment.\",\"foundingDate\":\"2022-07\",\"email\":\"office@it-u.at\",\"telephone\":\"+43 676 851 307 230\",\"vatID\":\"ATU79114879\",\"address\":{\"@type\":\"PostalAddress\",\"streetAddress\":\"Freist\u00e4dter Stra\u00dfe 400\",\"addressLocality\":\"Linz\",\"postalCode\":\"4040\",\"addressRegion\":\"Upper Austria\",\"addressCountry\":\"AT\"},\"location\":[{\"@type\":\"Place\",\"name\":\"IT:U Research Campus\",\"address\":{\"@type\":\"PostalAddress\",\"streetAddress\":\"Freist\u00e4dter Stra\u00dfe 400\",\"addressLocality\":\"Linz\",\"postalCode\":\"4040\",\"addressCountry\":\"AT\"}},{\"@type\":\"Place\",\"name\":\"IT:U Education Campus\",\"address\":{\"@type\":\"PostalAddress\",\"streetAddress\":\"Altenberger Stra\u00dfe 66c, Science Park 4\",\"addressLocality\":\"Linz\",\"postalCode\":\"4040\",\"addressCountry\":\"AT\"}}],\"identifier\":[{\"@type\":\"PropertyValue\",\"propertyID\":\"ROR\",\"value\":\"https:\\\/\\\/ror.org\\\/03jzk4720\"},{\"@type\":\"PropertyValue\",\"propertyID\":\"Wikidata\",\"value\":\"Q115669377\"}],\"memberOf\":{\"@type\":\"Organization\",\"name\":\"Complexity Science Hub\",\"url\":\"https:\\\/\\\/csh.ac.at\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Steffen Eger: Literary Translation in the Era of LLMs | IT:U","description":"Invited talk by Steffen Eger (UTN) on literary translation in the era of large language models - IT:U Summer School 2025 on NLP.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/","og_locale":"en_US","og_type":"article","og_title":"Steffen Eger: Literary Translation in the Era of LLMs | IT:U","og_description":"Invited talk by Steffen Eger (UTN) on literary translation in the era of large language models - IT:U Summer School 2025 on NLP.","og_url":"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/","og_site_name":"IT:U","article_publisher":"https:\/\/www.facebook.com\/itu.austria\/","article_modified_time":"2026-09-05T11:20:09+00:00","og_image":[{"width":1500,"height":800,"url":"https:\/\/it-u.at\/wp-content\/uploads\/2025\/06\/30\/itu-summer-school_website-header-1500x800px_neu.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/","url":"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/","name":"Steffen Eger: Literary Translation in the Era of LLMs | IT:U","isPartOf":{"@id":"https:\/\/it-u.at\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/#primaryimage"},"image":{"@id":"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/#primaryimage"},"thumbnailUrl":"https:\/\/it-u.at\/wp-content\/uploads\/2025\/06\/30\/itu-summer-school_website-header-1500x800px_neu.jpg","datePublished":"2025-07-24T14:01:35+00:00","dateModified":"2026-09-05T11:20:09+00:00","description":"Invited talk by Steffen Eger (UTN) on literary translation in the era of large language models - IT:U Summer School 2025 on NLP.","breadcrumb":{"@id":"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/#primaryimage","url":"https:\/\/it-u.at\/wp-content\/uploads\/2025\/06\/30\/itu-summer-school_website-header-1500x800px_neu.jpg","contentUrl":"https:\/\/it-u.at\/wp-content\/uploads\/2025\/06\/30\/itu-summer-school_website-header-1500x800px_neu.jpg","width":1500,"height":800},{"@type":"BreadcrumbList","@id":"https:\/\/it-u.at\/en\/literary-translation-in-the-era-of-large-language-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"home","item":"https:\/\/it-u.at\/en\/"},{"@type":"ListItem","position":2,"name":"Talk 3"}]},{"@type":"WebSite","@id":"https:\/\/it-u.at\/en\/#website","url":"https:\/\/it-u.at\/en\/","name":"it:u","description":"","publisher":{"@id":"https:\/\/it-u.at\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/it-u.at\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":["Organization","CollegeOrUniversity"],"@id":"https:\/\/it-u.at\/en\/#organization","name":"IT:U Interdisciplinary Transformation University Austria","alternateName":"IT:U","url":"https:\/\/it-u.at\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/it-u.at\/en\/#\/schema\/logo\/image\/","url":"https:\/\/it-u.at\/wp-content\/uploads\/2024\/09\/06\/itu-org-logo.jpg","contentUrl":"https:\/\/it-u.at\/wp-content\/uploads\/2024\/09\/06\/itu-org-logo.jpg","width":696,"height":696,"caption":"IT:U Interdisciplinary Transformation University Austria"},"image":{"@id":"https:\/\/it-u.at\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/itu.austria\/","https:\/\/www.instagram.com\/itu.austria\/","https:\/\/www.linkedin.com\/school\/itu-austria\/","https:\/\/www.youtube.com\/@itu.austria","https:\/\/bsky.app\/profile\/ituaustria.bsky.social","https:\/\/www.wikidata.org\/wiki\/Q115669377","https:\/\/de.wikipedia.org\/wiki\/Interdisciplinary_Transformation_University_Austria"],"legalName":"Institute of Digital Sciences Austria","description":"Austria\u2019s emerging public university dedicated to understanding, driving, and evaluating digital transformation for the benefit of our societies, our economy, and our environment.","foundingDate":"2022-07","email":"office@it-u.at","telephone":"+43 676 851 307 230","vatID":"ATU79114879","address":{"@type":"PostalAddress","streetAddress":"Freist\u00e4dter Stra\u00dfe 400","addressLocality":"Linz","postalCode":"4040","addressRegion":"Upper Austria","addressCountry":"AT"},"location":[{"@type":"Place","name":"IT:U Research Campus","address":{"@type":"PostalAddress","streetAddress":"Freist\u00e4dter Stra\u00dfe 400","addressLocality":"Linz","postalCode":"4040","addressCountry":"AT"}},{"@type":"Place","name":"IT:U Education Campus","address":{"@type":"PostalAddress","streetAddress":"Altenberger Stra\u00dfe 66c, Science Park 4","addressLocality":"Linz","postalCode":"4040","addressCountry":"AT"}}],"identifier":[{"@type":"PropertyValue","propertyID":"ROR","value":"https:\/\/ror.org\/03jzk4720"},{"@type":"PropertyValue","propertyID":"Wikidata","value":"Q115669377"}],"memberOf":{"@type":"Organization","name":"Complexity Science Hub","url":"https:\/\/csh.ac.at\/"}}]}},"_links":{"self":[{"href":"https:\/\/it-u.at\/en\/wp-json\/wp\/v2\/pages\/12438","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/it-u.at\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/it-u.at\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/it-u.at\/en\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/it-u.at\/en\/wp-json\/wp\/v2\/comments?post=12438"}],"version-history":[{"count":1,"href":"https:\/\/it-u.at\/en\/wp-json\/wp\/v2\/pages\/12438\/revisions"}],"predecessor-version":[{"id":12439,"href":"https:\/\/it-u.at\/en\/wp-json\/wp\/v2\/pages\/12438\/revisions\/12439"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/it-u.at\/en\/wp-json\/wp\/v2\/media\/11630"}],"wp:attachment":[{"href":"https:\/\/it-u.at\/en\/wp-json\/wp\/v2\/media?parent=12438"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}