This is a limited proof of concept to search for research data, not a production system.

Search the MIT Libraries

Title: Detecting East Asian Prejudice on Social Media

Type Dataset Bertie Vidgen, Austin Botelho, David Broniatowski, Ella Guest, Matthew Hall, Helen Margetts, Rebekah Tromble, Zeerak Waseem, Scott Hale (2020): Detecting East Asian Prejudice on Social Media. Zenodo. Dataset. https://zenodo.org/record/3816667

Authors: Bertie Vidgen (The Alan Turing Institute & the Oxford Internet Institute) ; Austin Botelho (The Oxford Internet Institute) ; David Broniatowski (The George Washington University) ; Ella Guest (The Alan Turing Institute & The University of Manchester) ; Matthew Hall (The University of Surrey & The Alan Turing Institute) ; Helen Margetts (The Alan Turing Institute & The Oxford Internet Institute) ; Rebekah Tromble (The George Washington University & The Alan Turing Institute) ; Zeerak Waseem (University of Sheffield) ; Scott Hale (The Alan Turing Institute & The Oxford Internet Institute) ;

Links

Summary

This repository contains:

A deep learning model which distinguishes between Hostililty against East Asia, Criticism of East Asia, Discussion of East Asian prejudice and Neutral content. The F1 score is 0.83. A detailed annotation codebook used for marking up the tweets. A labelled dataset with 20,000 entries. A dataset with all 40,000 annotations, which can be used to investigate annotation processes for abusive content moderation. A list of thematic hashtag replacements. Three sets of annotations for the 1,000 most used hashtags in the original database of COVID-19 related tweets. Hashtags were annotated for COVID-19 relevance, East Asian relevance and stance.

The outbreak of COVID-19 has transformed societies across the world as governments tackle the health, economic and social costs of the pandemic. It has also raised concerns about the spread of hateful language and prejudice online, especially hostility directed against East Asia. This data repository is for  a classifier that detects and categorizes social media posts from Twitter into four classes: Hostility against East Asia, Criticism of East Asia, Meta-discussions of East Asian prejudice and a neutral class. The classifier achieves an F1 score of 0.83 across all four classes. We provide our final model (coded in Python), as well as a new 20,000 tweet training dataset used to make the classifier, two analyses of hashtags associated with East Asian prejudice and the annotation codebook. The classifier can be implemented by other researchers, assisting with both online content moderation processes and further research into the dynamics, prevalence and impact of East Asian prejudice online during this global pandemic.

This work is a collaboration between The Alan Turing Institute and the Oxford Internet Institute. It was funded by the Criminal JusticeTheme of the Alan Turing Institute under Wave 1 of The UKRI Strategic Priorities Fund, EPSRC Grant EP/T001569/1

More information

  • DOI: 10.5281/zenodo.3816667
  • Language: en

Subjects

  • Hate speech, Sinophobia, Prejudice, Social media, Corona, Covid-19, Twitter, East Asia, Online abuse

Dates

  • Publication date: 2020
  • Issued: May 08, 2020

Rights

Much of the data past this point we don't have good examples of yet. Please share in #rdi slack if you have good examples for anything that appears below. Thanks!

Format

electronic resource

Relateditems

DescriptionItem typeRelationshipUri
IsVersionOfhttps://doi.org/10.5281/zenodo.3816666
IsPartOfhttps://zenodo.org/communities/covid-19
IsPartOfhttps://zenodo.org/communities/zenodo