Annotation Guide

Basic Examples

Neutral (Harmless Memes)

Neutral

Although memes are not necessarily "cheerful" there is no incivility and intolerance.

Violent Threats

• Incivil: 1 - Although language is not incivil, using an image of "Hilter" is antinormative.
• Intolerance: 8 - Implying eradication of a race.

Black Humor (Harmless)

• Incivil: 1 - Antinormative image or description.
• Intolerance: 0 - Black humour without targeting anyone in particular.

Black Humor (Targeted)

• Incivil: 1 - Disrespectful joke of holocaust.
• Intolerance: 6,8 - Religious intolerance by mocking.

Dogmatic Speach

• Incivil: 0 - Not necessarily incivil tone.
• Intolerance: 3 - Racist remark.

Racism

• Incivil: 2 - Calling Nuba wrestlers "roaches".
• Intolerance: 7 - Racist remark.

Stereotyping (Arabs as "goat fuckers" or "terrorists")

• Incivil: 1 - Zoofilia is antinormative and considered vulgar.
• Intolerance: 7,3 - Racist and offensive stereotyping.

Religious Intolerance (Antisemitism)

• Incivil: 1 - Profane calling Jesus a "jew jerky".
• Intolerant: 8 - Religious intolerance and violent threats (kill jews).

Misogyny (Women as "dishwasher" or "sandwich maker")

• Incivil: 1 - Vulgar objectification of women
• Intolerance 5 - Misogyny

Hate Against Immigrants/Refugees

• Incivil: 2 - Dehumanisation of immigrants
• Intolerant: 1 - Dehumanisation of immigrants

Ableism

• Incivil: 1 - Vulgar joke
• Intolerant: 9 - Mockery

Political Intolerance

• Incivil: 2 - Derogatory language
• Intolerance: 2,6,7 - Calling muslim politician (Ilhan Omar) terrorist and trojan horse

Edge Cases

Racism for Majority Groups

• Incivil: 2 - Depicting white kid with weapons.
• Intolerant: 0 - Stereotyping (in this case) does not amount to intolerance.

Exceptions

Intolerance regarding terrorist groups

• Incivil: 1 - Vulgar zoophilic joke
• Intolerant: 0 - Following the definition of the original hateful meme dataset, hatefulness (in our case intolerance) does not apply to terrorist groups (e.g. ISIS).