Wednesday, July 16, 2025
LBNN
  • Business
  • Markets
  • Politics
  • Crypto
  • Finance
  • Energy
  • Technology
  • Taxes
  • Creator Economy
  • Wealth Management
  • Documentaries
No Result
View All Result
LBNN

Shakespeare in sign language, as seen through AI

Simon Osuji by Simon Osuji
August 26, 2024
in Artificial Intelligence
0
Shakespeare in sign language, as seen through AI
0
SHARES
0
VIEWS
Share on FacebookShare on Twitter


Shakespeare in sign language, seen through AI
Example of the AI tools the audience saw on the monitors during the performance. Credit: SignOn project

A new study uses co-creation with reference communities to develop an app for sign language machine translation (SLMT). The research team designed a theatrical performance in sign language, seen through the eyes of artificial intelligence (AI), as one of the methodologies.

Related posts

Another High-Profile OpenAI Researcher Departs for Meta

Another High-Profile OpenAI Researcher Departs for Meta

July 16, 2025
The Enshittification of American Power

The Enshittification of American Power

July 16, 2025

“Historically, deaf people have been excluded from the development of automatic translation technologies,” says Shaun O’Boyle, Research Fellow in the School of Inclusive and Special Education (Dublin City University DCU).

“This has often caused backlash and resistance from deaf communities, as the projects were designed and developed without any input from the very end-users they intended to serve—resulting in a technology no one wanted to use and a big waste of money,” adds Davy Van Landuyt, Project Manager at the European Union of the Deaf (EUD).

The team decided to reverse the standard approach. The results of their work are described in a paper published in the Journal of Science Communication.

O’Boyle, Van Landuyt, and the other partners of the European project SignON—including the Vlaams GebarentaalCentrum (Flemish Sign Language Center)—designed an innovative co-creation methodology based on this idea: If we were to introduce an AI to Shakespeare texts in Irish Sign Language, which extracts would we choose first? This engagement with the AI allowed them to connect with the audience and gather their opinions about the technology.

Shakespeare in sign language, seen through AI
All the World’s a Screen. Credit: SignOn project

“We looked hard at what deaf communities really wanted (and equally important didn’t want),” explains Van Landuyt.

“It was a group effort, and it was a lot of fun,” comments O’Boyle, an expert in science communication and community engagement, who co-authored the paper with Van Landuyt, Elizabeth Mathews (who works with O’Boyle at DCU) and others.

The co-creation activity of the project, which contributed to the development of an SLMT app prototype, mixed live theatrical performance with artificial intelligence tools in a setting that reversed the stereotypical perspective between deaf/hard of hearing people and hearing people.

“We combined performance with an audience discussion, so to have that element of a focus group technique but within the context of culture and art and seeing a show, and being out for the night,” explains O’Boyle.

The event, titled All the World’s a Screen, was held during Dublin’s Science Week and consisted of a theatrical performance based on the works of William Shakespeare, performed in Irish Sign Language by two deaf actors, Lianne Quigley and Alvean Jones, who are also co-authors of the research and who translated Shakespeare’s texts into Irish Sign Language. The audience was composed of deaf, hard of hearing, and hearing people.

Shakespeare in sign language, seen through AI
All the World’s a Screen. Credit: SignOn project

“For deaf people, it was really important to have a performance and science engagement in their own language rather than in English. In our performance, an interpreter provided access to hearing people,” explains O’Boyle.

“It shifted the dynamic, but it also gave people an opportunity to imagine the future of these technologies because we asked people to view the performance with their AI ‘co-spectator.'”

During the performance, in fact, spectators could access tools for real-time analysis of the performers’ movements, object recognition, and real-time transcription of the spoken English translation by the interpreters.

“We got so much interesting feedback and the great thing about doing it within the context of a research project was that all of that feedback went straight to our team. It informed the use cases for the app, it informed how we spoke about it, how we thought about it, and different aspects of the technology that was developed too,” says O’Boyle.

“The ethical side is also important,” adds Van Landuyt.

Shakespeare in sign language, seen through AI
All the World’s a Screen. Credit: SingOn project

“A major frustration of deaf communities are attitudes or motivations of some hearing researchers working on these technologies,” says Van Landuyt, who also explains that this leads to a waste of time and resources.

“Too often, ‘hearing’ decision-makers or researchers think that they know better than deaf communities and try to create something which is then rejected by the actual end-users of those technologies, simply because it is not what they want or even utterly useless in practice. I think about, for example, technologies such as signing gloves.

“Just including deaf people in a project is not a structural solution. It does not mean that they are leading the research. Deaf researchers are often only asked to collaborate after the initial idea has already been conceived, the team built, the research conducted, or even near the end of the project,” he adds.

By engaging in authentic co-creation and science communication with deaf communities, this can be mitigated. “We cannot stop the evolution of these technologies, so we need to figure out how to deal with them. It’s essential that deaf people can decide for themselves,” concludes Van Landuyt. “Nothing about us without us.”

More information:
A deaf-centred art-science approach to community engagement with sign language technologies, Journal of Science Communication (2024). DOI: 10.22323/2.23050804

Provided by
International School of Advanced Studies (SISSA)

Citation:
Shakespeare in sign language, as seen through AI (2024, August 26)
retrieved 26 August 2024
from https://techxplore.com/news/2024-08-shakespeare-language-ai.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.





Source link

Previous Post

Inline pumps for space-saving applications

Next Post

Taiwan – Germany deepens collaboration on smart manufacturing: Premier Cho unveils strategies to advance economy

Next Post
Taiwan – Germany deepens collaboration on smart manufacturing: Premier Cho unveils strategies to advance economy

Taiwan - Germany deepens collaboration on smart manufacturing: Premier Cho unveils strategies to advance economy

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

RECOMMENDED NEWS

VISA Makes Key Investment in Moniepoint to Fuel SME Growth in Africa

VISA Makes Key Investment in Moniepoint to Fuel SME Growth in Africa

6 months ago
Leading Sportswear Brand DESCENTE Opens at Galaxy Macau; Fusing Technical Aesthetics with Leisure & Travel Lifestyle

Leading Sportswear Brand DESCENTE Opens at Galaxy Macau; Fusing Technical Aesthetics with Leisure & Travel Lifestyle

4 days ago
Stakeholders Have a Role In Creating a Trustworthy Digital Financial Ecosystem; Edouard Docteur

Stakeholders Have a Role In Creating a Trustworthy Digital Financial Ecosystem; Edouard Docteur

1 year ago
Trump Nominates Pro-Bitcoin Howard Lutnick as Commerce Secretary

Trump Nominates Pro-Bitcoin Howard Lutnick as Commerce Secretary

8 months ago

POPULAR NEWS

  • Ghana to build three oil refineries, five petrochemical plants in energy sector overhaul

    Ghana to build three oil refineries, five petrochemical plants in energy sector overhaul

    0 shares
    Share 0 Tweet 0
  • When Will SHIB Reach $1? Here’s What ChatGPT Says

    0 shares
    Share 0 Tweet 0
  • The world’s top 10 most valuable car brands in 2025

    0 shares
    Share 0 Tweet 0
  • Top 10 African countries with the highest GDP per capita in 2025

    0 shares
    Share 0 Tweet 0
  • Global ranking of Top 5 smartphone brands in Q3, 2024

    0 shares
    Share 0 Tweet 0
  • Privacy Policy
  • Contact

© 2023 LBNN - All rights reserved.

No Result
View All Result
  • Home
  • Business
  • Politics
  • Markets
  • Crypto
  • Economics
    • Manufacturing
    • Real Estate
    • Infrastructure
  • Finance
  • Energy
  • Creator Economy
  • Wealth Management
  • Taxes
  • Telecoms
  • Military & Defense
  • Careers
  • Technology
  • Artificial Intelligence
  • Investigative journalism
  • Art & Culture
  • Documentaries
  • Quizzes
    • Enneagram quiz
  • Newsletters
    • LBNN Newsletter
    • Divergent Capitalist

© 2023 LBNN - All rights reserved.