United States

Online harassment in the form of hate speech has been on the rise in recent years. Addressing the issue requires a combination of content moderation by people, aided by automatic detection methods. As content moderation is itself harmful to the people doing it, we desire to reduce the burden by improving the automatic detection of hate speech.  Hate speech presents a challenge as it is directed at different target groups using a completely different vocabulary.  Further the authors of the hate speech are incentivized to disguise their behavior to avoid being removed from a platform.  This makes it difficult to develop a comprehensive data set for training and evaluating hate speech detection models because the examples that represent one hate speech domain do not typically represent others, even within the same language or culture.  We propose an unsupervised domain adaptation approach to augment labeled data for hate speech detection. We evaluate the approach with three different models (character CNNs, BiLSTMs and BERT) on three different collections.  We show our approach improves Area under the Precision/Recall curve by as much as 42% and recall by as much as 278%, with no loss (and in some cases a significant gain) in precision.

ICWSM 2022

Domain Adaptive Hate Speech Detection

unsupervised domain adaptation

data augmentation

hate speech detection

stages 

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for natural language processing and computational linguistics. Often grouped within the field of artificial intelligence, but actually pre-dating the development of artificial intelligence, advances in computational linguistics and natural language processing are now some of the major drivers behind the use of artificial intelligence for commercial and social applications – for example, on-line search, machine translation and with voice-assisted conversational devices.

First established in 1965, the biennial COLING conference is held in diverse parts of the globe and attracts participants from both top-ranked research centers and emerging countries. Today, the most important developments in our field are taking place not only in universities and academic research institutes, but also in industrial research departments and in technological startups. COLING conferences provide opportunities for all these communities to showcase their exciting developments.

COLING 2020

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for natural language processing and computational linguistics. Often grouped within the field of artificial intelligence, but actually pre-dating the development of artificial intelligence, advances in computational linguistics and natural language processing are now some of the major drivers behind the use of artificial intelligence for commercial and social applications – for example, on-line search, machine translation and with voice-assisted conversational devices.

technical paper

**ICWSM-2022 will be held from June 6th – 9th in a hybrid format, both in-person in Atlanta, Georgia and online.**

**The Workshop and Tutorial Sessions are accessible to those that registered separately for these sessions. If you registered to attend but are not able to access the these sessions from the [Schedule tab](https://underline.io/events/291/schedule?day=2022-06-06T04%3A00%3A00.000Z), please email icwsm@underline.io
**

The International AAAI Conference on Web and Social Media (ICWSM) is a forum for researchers from multiple disciplines to come together to share knowledge, discuss ideas, exchange information, and learn about cutting-edge research in diverse fields with the common theme of online social media. This overall theme includes research in new perspectives in social theories, as well as computational algorithms for analyzing social media. ICWSM is a singularly fitting venue for research that blends social science and computational approaches to answer important and challenging questions about human social behavior through social media while advancing computational tools for vast and unstructured data.


ICWSM, now in its sixteenth year, has become one of the premier venues for computational social science, and previous years of ICWSM have featured papers, posters, and demos that draw upon network science, machine learning, computational linguistics, sociology, communication, and political science. The uniqueness of the venue and the quality of submissions have contributed to a rapidly growing conference, and a competitive acceptance rate of approximately 20% for full-length research papers published in the proceedings by the Association for the Advancement of Artificial Intelligence (AAAI).


**ICWSM Code of Conduct**

All persons, organizations and entities that attend AAAI conferences and events are subject to the standards of conduct set forth on the [AAAI Code of Conduct for Events and Conferences](https://aaai.org/Conferences/code-of-conduct.php). AAAI expects all community members to formally endorse this code of conduct, and to actively prevent and discourage any undesired behaviors. Everyone should feel empowered to politely engage when they or others are disrespected, and to raise awareness and understanding of this code of conduct. AAAI event participants asked to stop their unacceptable behavior are expected to comply immediately. Sponsors are also subject to this code of conduct in their participation in AAAI events.


Additionally, participants are encouraged to be courteous when sharing screen captures and photographs of conference events. Seek permission when possible and respect requests to take down images if those featured ask. Concerns around code of conduct or inclusion may be sent to icwsm22@aaai.org. If you have any concerns or items to report, please reach out to the General Chairs: Diyi Yang and Yelena Mejova.<br><br>


A ticket is required to attend the event, please use the below URL to register for the event if you have not already done so:

https://aaaiconf.cventevents.com/event/be8c26b0-a76f-4753-babb-de2bd9d2a619/summary

Virtual-Only:
$200 AAAI Member
$125 AAAI Student Member
$225 Nonmember
$150 Nonmember Student

Virtual Silver: Includes discounted conference registration, plus a one-year online new or renewed membership in AAAI.
$299 Silver Regular
$174 Silver Student

Virtual - Workshop and Tutorials:
$45 Regular
$25 Student


Registration Is Required

The International AAAI Conference on Web and Social Media (ICWSM) is a forum for researchers from multiple disciplines to come together to share knowledge, discuss ideas, exchange information, and learn about cutting-edge research in diverse fields with the common theme of online social media. This overall theme includes research in new perspectives in social theories, as well as computational algorithms for analyzing social media. ICWSM is a singularly fitting venue for research that blends social science and computational approaches to answer important and challenging questions about human social behavior through social media while advancing computational tools for vast and unstructured data.

Concerns over the spread of abusive content in social media have led online platforms to explore large scale community-level forms of moderation.
As an alternative to full bans, Reddit has implemented quarantines of subreddits, limiting access to controversial communities without explicit removal.
Previous evaluations of the effectiveness of quarantines have focused on their impact on toxicity in affected communities.
In this work, however, we focus on examining the impacts of quarantines of political subreddits on issues of political engagement in the broader Reddit community.
We present a case study of two ideologically distinct political subreddits, r/The\_Donald and r/ChapoTrapHouse, and examine the impact of quarantines on activity, visibility, and political discussion.
We find that while quarantines had a homogenizing effect on participation in political subreddits, they had limited impact on the visibility of community-internal issues and political language, due to the entrenchment of subreddit norms.

A Tale of Two Subreddits: Measuring the Impacts of Quarantines on Political Engagement on Reddit

Because  traditional social media platforms continue to ban actors spreading hate speech or other forms of abusive languages (a process known as deplatforming), these actors migrate to alternative platforms that do not moderate user content to the same degree. One popular platform relevant for the German community is Telegram for which limited research efforts have been made so far.

This study aimed to develop a broad framework comprising (i) an abusive language classification model for German Telegram messages and (ii) a classification model for the hatefulness of Telegram channels. For the first part, we use existing abusive language datasets containing posts from other platforms to develop our classification models. For the channel classification model, we develop a method that combines channel-specific content information collected from a topic model with a social graph to predict the hatefulness of channels. Furthermore, we complement these two approaches for hate speech detection with insightful results on the evolution of German speaking communities focused on hateful content on the Telegram platform. We also propose methods for conducting scalable network analyses for social media platforms to the hate speech research community. As an additional output of this study, we provide an annotated abusive language dataset containing 1,149 annotated Telegram messages.

Introducing an Abusive Language Classification Framework for Telegram to Investigate the German Hater Community

Modelling differential stress expressions in urban and rural regions in China can provide a better understanding of the effects of urbanization on psychological well-being in a country that has rapidly grown economically in the last two decades. Using Weibo posts from over 65,000 users across 329 counties, we build hierarchical mixed-effects models to understand linguistic differences in the experiences and expressions of stress in urban-rural China. We analyze phrases, topical themes, and psycho-linguistic word choices in Weibo posts mentioning stress to better understand appraisal differences surrounding psychological stress in urban and rural communities in China; we then compare them with large-scale polls from Gallup. After controlling for socioeconomic and gender differences, we find that rural communities tend to express stress in emotional and personal themes such as relationships, health, and opportunity while users in urban areas express stress using relative, temporal, and external themes such as work, politics, and economics. We find corroborative trends in physical, financial, and social wellness with urbanization in Gallup polls.

Understanding Urban-Rural Differences in Stress in China Using Hierarchical Modeling

A breadth of literature has examined how gig workers use online forums. The past literature focuses primarily on how gig workers for mainstream corporate platforms leverage forums. Yet, marginalization, stigma, censorship, and criminalization all shape how people, including gig workers, use digital technology. In this work, we seek to take a first step toward understanding how marginalized, stigmatized, digitally censored, and in some cases criminalized gig workers leverage the affordances of online public forums to build community and increase their welfare. To do so, we conduct a qualitative analysis of 4,000 posts and 25,851 comments shared over four months in a large online public forum used by sex workers for peer support. Sex workers sit at the intersection of multiple marginalized communities, and thus offer a lens into the broader use of forums by marginalized labor communities. Our findings offer insight into how these workers use moderation to preserve their safety and community. Further, we highlight similarities and differences between how this community utilizes the forum platform and prior scholarship on the use of online forums by gig workers.

Community Under Surveillance: Impacts of Marginalization on an Online Labor Forum

Evacuations have a significant impact on saving human lives during hurricanes. However, as a complex dynamic process, it is typically difficult to know  individual evacuation decisions in real-time. Since a large amount of information is continuously posted through social media platforms, we can use them to understand individual evacuation behavior. In this paper, we collect tweets during Hurricane Irma in 2017 and train a text classifier in an active learning way to distinguish tweets expressing positive evacuation decisions from both negative and irrelevant ones. Additionally, we perform a demographic analysis and content clustering to investigate the potential causes and correlates of evacuation decisions. The results can be used to help inform planning strategies of emergency response agencies.

Identifying Hurricane Evacuation Intent on Twitter

Information on social media spreads through an underlying diffusion network that connects people of common interests and opinions. This diffusion network often comprises multiple layers, each capturing the spreading dynamics of a certain type of information characterized by, for example, topic, language, or attitude. Researchers have previously proposed methods to infer these underlying multilayer diffusion networks from observed spreading patterns but little is known about how well these methods perform across the range of realistic spreading data. In this paper, we conduct an extensive series of synthetic data experiments to systematically analyze the performance of the multilayer diffusion network inference framework, under varied network structure (e.g. density, number of layers) and information diffusion settings (e.g. cascade size, layer mixing) that are designed to mimic real-world spreading on social media. Our results show extreme performance variation of the inference framework: notably, it achieves much higher accuracy when inferring a denser diffusion network, while it fails to decompose the diffusion network correctly when most cascades in the data reach a limited audience. In demonstrating the conditions under which the inference accuracy is extremely low, our paper highlights the need to carefully evaluate the applicability of the inference before running it on real data. Practically, our results serve as a reference for this evaluation, and our publicly available implementation, which outperforms previous implementations in accuracy, supports further testing under personalized settings.

Limits of Multilayer Diffusion Network Inference in Social Media Research

The Internet Engineering Task Force (IETF) is responsible for producing the standards that underpin the web (e.g., HTTP, WebSockets, and WebRTC). While the IETF follows an open, consensus-driven process, protocol standardisation is inherently social and political, and latent influential structures might exist in the community. Exploring and understanding these is essential to ensuring the IETF's resilience and openness. We use network analysis to explore the social graphs of IETF participants and the influence that key contributors have.
We show that a small core dominates: the top 10% of participants contribute 43.75% of emails and come from a relatively small set of organisations. On the other hand, we also find that influence has become relatively more decentralised with time.
IETF participants also propose and work on protocol drafts that are either adopted by a working group for further refinement or get rejected at the early stage.
Using the social graph features combined with email text features, we perform regression analysis to understand the effect of user influence on the success of proposed protocol drafts being adopted. Our findings shed useful insights into behavior of participants across time, correlation between influence and success in draft adoption, and the significance of affiliated organisations in development of protocol drafts.

The Web We Weave: Untangling the Social Graph of the IETF

Due to the rise in toxic speech on social media and other
online platforms, there is a growing need for systems that
could automatically flag or filter such content. Various supervised
machine learning approaches have been proposed,
trained from manually-annotated toxic speech corpora. However,
annotators sometimes struggle to judge or to agree on
which text is toxic and which group is being targeted in a
given text. This could be due to bias, subjectivity, or unfamiliarity
with used terminology, (e.g. domain language, slang).
In this paper, we propose the use of a knowledge graph to help
in better understanding such toxic speech annotation issues.
Our empirical results show that 3% in a sample of 19k texts
mention terms associated with frequently attacked gender and
sexual orientation groups that were not correctly identified by
the annotators.

Supporting Online Toxicity Detection with Knowledge Graphs

Emojis come with prepacked semantics making them great candidates to create new forms of more accessible communications. Yet, little is known about how much of this emojis semantic is agreed upon by humans, outside of textual contexts. Thus, we collected a crowdsourced dataset of one-word emoji descriptions for 1,289 emojis presented to participants with no surrounding text. The emojis and their interpretations were then examined for ambiguity. We find that with 30 annotations per emoji, 16 emojis (1.2%) are completely unambiguous, whereas 55 emojis (4.3%) are so ambiguous that their descriptions are indistinguishable from randomly chosen descriptions. Most of studied emojis are spread out between the two extremes. Furthermore, investigating the ambiguity of different types of emojis, we find that an important factor is the extent to which an emoji has an embedded symbolical meaning drawn from an established code-book of symbols. We conclude by discussing design implications.

On the Context-Free Amiguity of Emoji: A Data-Driven Study of 1,289 Emojis

We argue that we need to evaluate model interpretability methods {\em in the wild}, in situations where professionals make critical decisions, and models can potentially assist them. We present an {\bf in-the-wild evaluation} of token attribution based on Deep Taylor Decomposition \cite{chefer2021transformer}, {\bf with professional journalists} performing reliability assessments. We find that using this method in conjunction with RoBERTa-Large, fine-tuned on the Gossip Corpus, led to {\bf faster and better human decision-making}, as well as a more critical attitude toward news sources among the journalists. We present a comparison of human and model rationales, as well as a qualitative analysis of the journalists' experiences with machine-in-the-loop decision making.

Domain Adaptive Hate Speech Detection

Downloads

Next from ICWSM 2022

A Tale of Two Subreddits: Measuring the Impacts of Quarantines on Political Engagement on Reddit

Similar lecture

HateGAN Model Data Augmentation for Hate Speech Detection

Stay up to date with the latest Underline news!

PRODUCT

COMPANY

RESOURCES

Domain Adaptive Hate Speech Detection

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from ICWSM 2022

A Tale of Two Subreddits: Measuring the Impacts of Quarantines on Political Engagement on Reddit

Similar lecture

HateGAN Model Data Augmentation for Hate Speech Detection ​

Stay up to date with the latest Underline news!

PRODUCT

COMPANY

RESOURCES

Downloads

HateGAN Model Data Augmentation for Hate Speech Detection