AI Futures of Culture and Memory
a WASP-HS Research Cluster in Sweden.
news
Aug 15, 2025 | We kickstarted the WASP-HS cluster AI Futures of Culture and Memory together with Anna Foka, Coppelie Cocq, Andre Holzapfel, Koraljka Golub, and Kıvanç Tatar. |
---|
selected publications
- Neural audio instruments: epistemological and phenomenological perspectives on musical embodiment of deep learningVictor Zappi , and Kıvanç TatarFrontiers in Computer Science, Aug 2025Publisher: Frontiers
Neural Audio is a category of deep learning pipelines which output audio signals directly, in real-time scenarios of action-sound interactions. In this work, we examine how neural audio-based artificial intelligence, when embedded in digital musical instruments (DMIs), shapes embodied musical interaction. While DMIs have long struggled to match the physical immediacy of acoustic instruments, neural audio methods can magnify this challenge, requiring data collection, model training and deep theoretical knowledge that appear to push musicians toward symbolic or conceptual modes of engagement. Paradoxically, these same methods can also foster more embodied practices, by introducing opaque yet expressive behaviors that free performers from rigid technical models and encourage discovery through tactile, real-time experimentation. Drawing on established perspectives in DMI embodiment literature, as well as emerging neural-audio-focused efforts within the community, we highlight two seemingly conflicting aspects of these instruments: on one side, they inherit many “disembodying” traits known from DMIs; on the other, they open pathways reminiscent of acoustic phenomenology and soma, potentially restoring the close physical interplay often missed in digital performance.
@article{zappi_neural_2025, title = {Neural audio instruments: epistemological and phenomenological perspectives on musical embodiment of deep learning}, volume = {7}, issn = {2624-9898}, shorttitle = {Neural audio instruments}, doi = {10.3389/fcomp.2025.1575168}, language = {English}, urldate = {2025-08-22}, journal = {Frontiers in Computer Science}, author = {Zappi, Victor and Tatar, Kıvanç}, month = aug, year = {2025}, note = {Publisher: Frontiers}, keywords = {deep learning, artificial intelligence, embodied interaction, digital musical instruments, latent space, music performance, neural audio, neural audio instruments}, }
- Digital ethnography : a qualitative approach to digital cultures, spaces, and socialitesCoppélie Cocq , and Evelina LiliequistFirst Monday, Aug 2024
This paper introduces principles for the application and challenges of small data ethnography in digital research. It discusses the need to incorporate ethics in every step of the research process. As teachers and researchers within the digital humanities, we argue for the value of a qualitative approach to digital contents, spaces, and phenomena. This article is relevant as a guide for students and researchers whose studies examine digital practices, phenomena, and social communities that occur in, through, or in relation to digital contexts.
@article{Cocq1856780, author = {Cocq, Coppélie and Liliequist, Evelina}, institution = {Umeå University, Centre for Regional Science (CERUM)}, journal = {First Monday}, number = {5}, publisher = {University of Illinois Libraries}, title = {Digital ethnography : a qualitative approach to digital cultures, spaces, and socialites}, volume = {29}, doi = {10.5210/fm.v29i5.13196}, keywords = {Small data, Qualitative research, Digital research}, year = {2024}, }
- Afterword : future directions for surveillance in practice and researchStefan Gelfgren , Coppélie Cocq , Jesper Enbom , and 1 more authorIn Everyday life in the culture of surveillance : , Aug 2023
The contributions in this book shed light on the complexity of surveillance in a digital age and problematise power relations between the many actors involved in the development and performance of surveillance culture. More and more actors and practices play an increasing role in our contemporary digitalised society, and the chapters show how people negotiate surveillance in their use of digital media, often knowingly leaving digital footprints, and sometimes trying to avoid surveillance. The digital transformation will continue in the foreseeable future. The coordination and analysis of data is viewed by many government agencies, corporations, and other actors as important tools for improving public administration, health, and economic growth. For this development to be legitimate, it is important that hard values, such as technical and legal developments, and soft values, such as ethical and cultural values, are taken into consideration.
@incollection{Gelfgren1748863, author = {Gelfgren, Stefan and Cocq, Coppélie and Enbom, Jesper and Samuelsson, Lars}, booktitle = {Everyday life in the culture of surveillance : }, institution = {Umeå University, Department of culture and media studies}, pages = {205--211}, title = {Afterword : future directions for surveillance in practice and research}, doi = {10.48335/9789188855732-a}, keywords = {surveillance culture, digital transformation, counter-practices, data regulation, cybersecurity}, isbn = {978-91-88855-73-2}, year = {2023}, }
- Beyond the binary : queering AI for an inclusive futureEvelina Liliequist , Andrea Aler Tubella , Karin Danielsson , and 1 more authorinteractions, Aug 2023
@article{Liliequist1755693, author = {Liliequist, Evelina and Aler Tubella, Andrea and Danielsson, Karin and Cocq, Coppélie}, institution = {TechnAct, University of Gothenburg, Gothenburg, Sweden}, journal = {interactions}, number = {3}, pages = {31--33}, title = {Beyond the binary : queering AI for an inclusive future}, volume = {30}, doi = {10.1145/3590141}, keywords = {AI; queer perspectives}, year = {2023}, }
- Queer eye on AI : binary systems versus fluid identitiesKarin Danielsson , Andrea Aler Tubella , Evelina Liliequist , and 1 more authorIn Handbook of critical studies of artificial intelligence : , Aug 2023
It is becoming more common to replace or augment human-based decisions with algorithmic calculations and evaluations using artificial intelligence (AI). Facial analysis systems (FA) are examples of how AI in particular is intertwined with both the most mundane and the most critical aspects of human life. Exploring images for the purposes of face detection, recognition and/or classification, FA shows an entanglement between human identity, self-presentation and computation. In this chapter, we discuss automated facial analysis technology from a queer theoretical standpoint, focusing on the concerns and risks when systems like FA are used in a binary way to categorize, measure and make decisions based on computerized assumptions about gender and sexuality. Further, we discuss issues of privacy, bias and fairness related to FA technology as well as potential improvements, for example, by using participatory design. Finally, this chapter suggests that a queer perspective on FA can create new ways to relate to technology.
@incollection{Danielsson1816223, author = {Danielsson, Karin and Aler Tubella, Andrea and Liliequist, Evelina and Cocq, Coppélie}, booktitle = {Handbook of critical studies of artificial intelligence : }, institution = {Umeå University, Centre for Regional Science (CERUM)}, pages = {595--606}, title = {Queer eye on AI : binary systems versus fluid identities}, doi = {10.4337/9781803928562.00061}, keywords = {Chritical theory, Artificial intelligence, Queer theory, Participatory design, Kritisk teori, Artificiell intelligens, Queer teori, Deltagande design}, isbn = {9781803928562}, year = {2023}, }
- Tracing the bias loop : AI, cultural heritage and bias-mitigating in practiceAnna Foka , Gabriele Griffin , Dalia Ortiz Pablo , and 2 more authorsAI & Society: Knowledge, Culture and Communication, Aug 2025
This article investigates the pervasive issue of bias within AI-driven cultural heritage collections, emphasizing how digital technologies both inherit and amplify existing societal and historical prejudices embedded in analogue records. It outlines the multifaceted nature of bias—ranging from data selection and annotation to algorithmic design and user interaction—demonstrating how each stage of the AI pipeline can introduce or perpetuate distortions in representation. Through a critical review of current scholarship and practical case studies, particularly in image classification, the article evaluates technical strategies such as data augmentation, adversarial debiasing, and monitoring plans for bias mitigation. The findings reveal that while methods like noise injection and colour jittering can balance datasets and improve model fairness, effective bias mitigation ultimately depends on interdisciplinary collaboration between heritage professionals, subject experts, and data scientists. The article concludes that addressing bias requires an ongoing, holistic approach, integrating both technical and humanistic perspectives from data collection to model deployment. This ensures more inclusive, accurate, and ethically sound representations of cultural heritage, supporting the sector’s goals of diversity and accessibility for future audiences.
@article{Foka1959611, author = {Foka, Anna and Griffin, Gabriele and Ortiz Pablo, Dalia and Rajkowska, Paulina and Badri, Sushruth}, institution = {Uppsala University, Human-Computer Interaction}, journal = {AI & Society: Knowledge, Culture and Communication}, title = {Tracing the bias loop : AI, cultural heritage and bias-mitigating in practice}, doi = {10.1007/s00146-025-02349-z}, keywords = {Cultural heritage, Artificial intelligence, Bias mitigation, Machine learning, Data augmentation, Interdisciplinarycollaboration, Image classification}, year = {2025}, }
- AI and Image: : Critical Perspectives on the Application of Technology on Art and Cultural Heritage.Anna Foka , and Jan BonsdorffAug 2025
AI and Image illustrates the importance of critical perspectives in the study of AI and its application to image collections in the art and heritage sector. The authors’ approach is that such entanglements of image and AI are neither dystopian or utopian but may amplify, reduce or condense existing societal inequalities depending on how they may be implemented in relation to human expertise and sensibility in terms of diversity and inclusion. The Element further discusses regulations around the use of AI for such cultural datasets as they touch upon legalities, regulations and ethics. In the conclusion they emphasise the importance of the professional expert factor in the entanglements of AI and images and advocate for a continuous and renegotiating professional symbiosis between human and machines. This title is also available as Open Access on Cambridge Core.
@book{Foka1990260, author = {Foka, Anna and von Bonsdorff, Jan}, institution = {Uppsala University, Department of Art History}, title = {AI and Image: : Critical Perspectives on the Application of Technology on Art and Cultural Heritage.}, isbn = {9781009505468}, year = {2025}, }
- Anticipatory Technology Ethics Reflection By Eliciting Creative AI Imaginaries Through Fictional Research AbstractsPetra Jääskeläinen , Camilo Sanchez , and André HolzapfelIn Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency , Aug 2025
@inproceedings{jaaskelainen2025anticipatory, title = {Anticipatory Technology Ethics Reflection By Eliciting Creative AI Imaginaries Through Fictional Research Abstracts}, author = {J{\"a}{\"a}skel{\"a}inen, Petra and Sanchez, Camilo and Holzapfel, Andr{\'e}}, booktitle = {Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency}, pages = {125--136}, year = {2025}, }
- Singing for the Missing: Bringing the Body Back to AI Voice and Speech TechnologiesKelsey Cotton , Katja Vries , and Kıvanç TatarIn Proceedings of the 9th International Conference on Movement and Computing , Utrecht, Netherlands, May 2024
Technological advancements in deep learning for speech and voice have contributed to a recent expansion in applications for voice cloning, synthesis and generation. Invisibilised stakeholders in this expansion are numerous absent bodies, whose voices and voice data have been integral to the development and refinement of these speech technologies. This position paper probes current working practices for voice and speech in machine learning and AI, in which the bodies of voices are “invisibilised". We examine the facts and concerns about the voice-Body in applications of AI-voice technology. We do this through probing the wider connections between voice data and Schaefferian listening; speculating on the consequences of missing Bodies in AI-Voice; and by examining how vocalists and artists working with synthetic Bodies and AI-voices are ‘bringing the Body back’ in their own practices. We contribute with a series of considerations for how practitioners and researchers may help to ‘bring the Body back’ into AI-voice technologies.
@inproceedings{cotton_singing_2024, language = {en}, author = {Cotton, Kelsey and de Vries, Katja and Tatar, Kıvanç}, month = may, title = {Singing for the Missing: Bringing the Body Back to AI Voice and Speech Technologies}, year = {2024}, isbn = {9798400709944}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, doi = {10.1145/3658852.3659065}, booktitle = {Proceedings of the 9th International Conference on Movement and Computing}, articleno = {2}, numpages = {12}, keywords = {AI, STS, artificial intelligence, body, musical AI, voice}, location = {Utrecht, Netherlands}, series = {MOCO '24} }
- A Shift in Artistic Practices through Artificial IntelligenceKıvanç Tatar , Petter Ericson , Kelsey Cotton , and 6 more authorsLeonardo, Apr 2024
The explosion of content generated by artificial intelligence (AI) models has initiated a cultural shift in arts, music, and media, whereby roles are changing, values are shifting, and conventions are challenged. The vast, readily available dataset of the Internet has created an environment for AI models to be trained on any content on the Web. With AI models shared openly and used by many globally, how does this new paradigm shift challenge the status quo in artistic practices? What kind of changes will AI technology bring to music, arts, and new media?
@article{tatar_shift_2024, title = {A Shift in Artistic Practices through Artificial Intelligence}, issn = {0024-094X}, doi = {10.1162/leon_a_02523}, urldate = {2024-04-09}, journal = {Leonardo}, author = {Tatar, Kıvanç and Ericson, Petter and Cotton, Kelsey and Del Prado, Paola Torres Núñez and Batlle-Roca, Roser and Cabrero-Daniel, Beatriz and Ljungblad, Sara and Diapoulis, Georgios and Hussain, Jabbar}, month = apr, year = {2024}, pages = {293--297}, }
- Automated Subject Indexing : An OverviewKoraljka GolubCataloging & Classification Quarterly, Apr 2021
In the face of the ever-increasing document volume, libraries around the globe are more and more exploring (semi-) automated approaches to subject indexing. This helps sustain bibliographic objectives, enrich metadata, and establish more connections across documents from various collections, effectively leading to improved information retrieval and access. However, generally accepted automated approaches that are functional in operative systems are lacking. This article aims to provide an overview of basic principles used for automated subject indexing, major approaches in relation to their possible application in actual library systems, existing working examples, as well as related challenges calling for further research.
@article{Golub1620744, author = {Golub, Koraljka}, institution = {Linnaeus University, Department of Cultural Sciences}, journal = {Cataloging & Classification Quarterly}, number = {8}, pages = {702--719}, title = {Automated Subject Indexing : An Overview}, volume = {59}, doi = {10.1080/01639374.2021.2012311}, year = {2021}, }