We present an Italian YouTube dataset manually annotated for hate speech types and targets. The comments to be annotated were sampled from the Italian YouTube comments on videos about the Covid-19 pandemic in the period from January 2020 to May 2020. Two sets were annotated: a training set with 59,870 comments (IMSyPP_IT_YouTube_comments_train.csv) and an evaluation set with 10,536 comments (IMSyPP_IT_YouTube_comments_evaluation.csv). The dataset was annotated by 8 annotators with each comment being annotated by two annotators. It was used to train a classification model for hate speech types detection that is publicly available at the following URL: https://huggingface.co/IMSyPP/hate_speech_it.
The dataset consists of the following fields:
ID_Commento - YouTube ID of the comment
ID_Video - YouTube ID of the video under which the comment was posted
Testo - text of the comment
Tipo - type of hate speech
Target - the target of hate speech
Additionally, we have included the Italian YouTube data (SR_YT_comments.csv) which was collected in the same period as the training data and was annotated using the aforementioned model. The automatically labeled data was used to analyze the relationship between hate speech and misinformation on Italian YouTube. The results of this analysis are presented in the associated paper.
The analyzed data are represented with the following fields:
ID_Commento - YouTube ID of the comment
Label - automatically assigned label by the model
is_questionable - the type of channel where the comment was collected from; the channels could either be categorized as spreading reliable or questionable information.