Publicación:
Pron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing?

Vista sencilla de ítem
dc.contributor.authorMarco Remón, Guillermo
dc.contributor.authorGonzalo Arroyo, Julio Antonio
dc.contributor.authorMateo-Girona, M. Teresa
dc.contributor.authorCastillo Santos, Ramón José del
dc.contributor.funderEuropean Commissionen
dc.coverage.spatialMiami, Florida
dc.coverage.temporal2024-11-01
dc.date.accessioned2025-12-05T14:32:40Z
dc.date.available2025-12-05T14:32:40Z
dc.date.issued2024-11-01
dc.description.abstractAre LLMs ready to compete in creative writing skills with a top (rather than average) novelist? To provide an initial answer for this question, we have carried out a contest between Patricio Pron (an awarded novelist, considered one of the best of his generation) and GPT-4 (one of the top performing LLMs), in the spirit of AIhuman duels such as DeepBlue vs Kasparov and AlphaGo vs Lee Sidol. We asked Pron and GPT-4 to provide thirty titles each, and then to write short stories for both their titles and their opponent’s. Then, we prepared an evaluation rubric inspired by Boden’s definition of creativity, and we collected several detailed expert assessments of the texts, provided by literature critics and scholars. The results of our experimentation indicate that LLMs are still far from challenging a top human creative writer. We also observed that GPT-4 writes more creatively using Pron’s titles than its own titles (which is an indication of the potential for human-machine co-creation). Additionally, we found that GPT-4 has a more creative writing style in English than in Spanish.en
dc.description.sponsorshipThis work has been financed by the European Union (NextGenerationEU funds) through the “Plan de Recuperación, Transformación y Resiliencia”, by the Ministry of Economic Affairs and Digital Transformation and by UNED University.en
dc.description.versionversión publicada
dc.identifier.citationMarco, G., Gonzalo, J., del Castillo, R., & Mateo-Girona, T. (2024). Pron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing? In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, {EMNLP} 2024, Miami, FL, USA, November 12-16, 2024. pp 19654--19670, Association for Computational Linguistics. DOI https://doi.org/10.18653/v1/2024.emnlp-main.1096
dc.identifier.doihttps://doi.org/10.18653/v1/2024.emnlp-main
dc.identifier.urihttps://hdl.handle.net/20.500.14468/31033
dc.language.isoen
dc.publisherAssociation for Computational Linguistics
dc.relation.centerE.T.S. de Ingeniería Informática
dc.relation.congress2024 Conference on Empirical Methods in Natural Language Processing,
dc.relation.departmentLenguajes y Sistemas Informáticos
dc.rightsinfo:eu-repo/semantics/openAccess
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/deed.es
dc.subject1203.04 Inteligencia artificial
dc.titlePron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing?en
dc.typeactas de congresoes
dc.typeconference proceedingsen
dspace.entity.typePublication
relation.isAuthorOfPublication1eeaa429-26ee-4f3d-9868-f4d0182e58ba
relation.isAuthorOfPublication0e0d6c85-2d8e-4fb3-9640-8ad17e875fcc
relation.isAuthorOfPublicationcddebe14-47cb-4dbd-b4aa-d9e8fddc176b
relation.isAuthorOfPublication.latestForDiscovery1eeaa429-26ee-4f3d-9868-f4d0182e58ba
Archivos
Bloque original
Mostrando 1 - 1 de 1
Miniatura
Nombre:
Gonzalo_Arroyo_Julio_Pron_vs_Prompt_JULIO ANTONIO GONZAL.pdf
Tamaño:
531.52 KB
Formato:
Adobe Portable Document Format
Descargar
Bloque de licencias
Mostrando 1 - 1 de 1
No hay miniatura disponible
Nombre:
license.txt
Tamaño:
3.62 KB
Formato:
Item-specific license agreed to upon submission
Descripción:
Descargar
Colecciones
Actas y comunicaciones de congresos