Most people, at one point or another, have found themselves in that uncomfortable position during a conversation when they can鈥檛 tell whether or not someone is kidding. Should you laugh? Is the person serious?
It can feel impossible to tell, even if the conversation is in person.
In our increasingly virtual world, it is especially hard to detect jokes or sarcasm online 鈥 and harder still if you are a person on the autism spectrum.
This is the focus of research by Dr. Annuska Zolyomi, assistant teaching professor at the 糖心vlog视频. During her doctoral studies, she conducted and co-authored a study on autism-oriented Twitter conversations.
鈥淭here are a lot of interesting and rich discussions happening online within the autism community,鈥 she said. 鈥淚 used them as a guide to understand how autistic people use the internet to connect and communicate with one another.鈥
Serious or sarcastic?
One of the conversations that came up was centered on sarcasm, specifically how difficult it is to detect online. 鈥淭he autism community wants people to be more explicit about their emotions and their intentions behind what they are saying,鈥 Zolyomi explained. 鈥淭hey suggested Twitter implement a joke button or for users to simply write 鈥/s鈥 in their tweets to indicate sarcasm.鈥
This conversation in Zolyomi鈥檚 research article, #ActuallyAutistic Sense-Making on Twitter, attracted national attention. Her work was quoted in a Gizmodo article called A DARPA Sarcasm Detector is Good. The researchers who developed the detector in partnership with the Defense Advanced Research Projects Agency call the tool 鈥渁 profound public service.鈥 Its use is also backed by the autism community.
Zolyomi thinks of the detector as part of the 鈥渃urb cut effect鈥 鈥 the phenomenon of disability-friendly features being used and appreciated by a larger group than the people they were designed to assist.
鈥淭he dip in the sidewalks at intersections was fought for by people in wheelchairs, and now it also benefits people with strollers or on bicycles, etc.鈥 she said. 鈥淭he same would be true for a sarcasm indicator. I mean, imagine how many arguments on social media would be prevented if we knew the writer鈥檚 intention?鈥
In the spirit of prevention and ease, researchers in the United States are now developing an artificial intelligence system that can detect sarcasm based on cue words. 鈥淚t鈥檚 not the autistic person who should change or adapt to fit neurotypical social norms,鈥 Zolyomi said. 鈥淚t鈥檚 a social group as a whole that should work together to have a mutual understanding and establish common ground. I am glad to see a software that is moving in that direction.鈥
Studies for students
Prior to coming to UW Bothell, Zolyomi worked as an accessibility strategist for Microsoft. In that role, she helped to design technology for people with predominately physical impairments. She learned, however, that there was a lot less known about how technology can support people with cognitive disabilities.
鈥淭hat gap in knowledge inspired me to get my Ph.D.,鈥 Zolyomi said. 鈥淚 wanted to dig in and understand what fundamental research was needed to develop more concrete guidelines on how to include this group in design. Far too often they are left out of consideration.鈥
As a professor now, she wants to apply her doctoral research in the classroom setting. From the Twitter conversations, she learned that in-person collaboration was a point of tension in the autism community. It led her to think about what teamwork is like for neurodiverse students who struggle with social cues and communication.
鈥淚 learned that students on the autism spectrum have a lot of anxiety around working in teams,鈥 she said. 鈥淭hey tend to have difficulty figuring out when it鈥檚 their turn to speak or when it鈥檚 somebody else鈥檚. They may be less adept with those conversational 鈥榤oves鈥 that neurotypical people perform effortlessly.鈥
Armed with this new knowledge, she strives to make a supportive, comfortable space for people to work together and to provide additional support to autistic students. 鈥淭his is something I will continue to work on and always aim to improve,鈥 she said.
Innovate for inclusion
Zolyomi brings her research into the classroom in other ways, too. Her goal is to expose students to the issue of accessibility and encourages them to bring their personal experiences into the conversation.
鈥淚 want them to think about how we can design technology to be more inclusive of people who have differences, whether that is a physical impairment, a mental health disorder or a cognitive disability,鈥 Zolyomi said. 鈥淓veryone鈥檚 needs matter, and technology should reflect that.鈥
One of the classes she teaches is on user-centered design and usability. She teaches it every quarter, picking a different theme each time. In fall 2021, she had students design technologies for people with disabilities.
鈥淥ne group looked at how people who have visual impairments cook and use appliances,鈥 she said. 鈥淢ost technology assumes the user can see, so students designed an interface so people with visual impairments can use the microwave. I was very impressed.
鈥淚 have really enjoyed answering the questions I developed while working at Microsoft and encouraging my students to take the research further,鈥 Zolyomi said. 鈥淚 am so inspired by my students and know that their work will make a difference in accessible technology one day.鈥
