• You are presented with a news headline and a Reddit comment to that piece of news. Please read the comment carefully.
• The text contains a reference to a certain social group, such as immigrants, refugees, political groups, ethnic or religious groups, etc.
• Then you are asked whether the comment shows any discriminatory language, such as (A) alienating or portraying a social group as negative, (B) a threat, danger or peril to society, (C) trying to ridicule it and attack that group as lesser or worthless, or (D) expressing support towards that group, by defending it or praising it.
For instance, imagine the following annotation example:

Here's what's gonna happen. One of these days, these guys aren't just going to ice a few European civilians. They're going to blow up the Notre Dame, or destroy a priceless work of European art at the Louvre, and then the shit will really hit the fan. I want to be careful how I word this but ask yourself a question. If the Nazis had won WWII, do you think Islam would be threatening European civilians in the hearts of London, Paris, and Berlin today?

What kind of language does this comment contain towards Muslims?

Discriminatory or Alienating

Critical but not Discriminatory

Supportive or Favorable

Neutral

The previous comment implies that all who follow Islam threaten European civilization, even suggesting that Nazis would have prevented that. Therefore, the answer is Discriminatory or Alienating
• Afterwards, you will be asked whether the expressed language towards that group is positive, negative or neutral.
  • Positive: If the emotion is positive, find the positive emotion the text contains. You will be given short descriptions of those emotions to help you. If you think a comment contains two emotions, you may select a second one.
  • Negative: If the emotion is negative, find the negative emotion the text contains. You will be given short descriptions of those emotions to help you. If you think a comment contains two emotions, you may select a second one.
  • Neutral: If there is no emotion expressed towards the group, then select this option. Please only use this option if no emotions are expressed in the Reddit comment. Please bear in mind that misuse of this option will be penalized.
• Emotions are not always clear cut. Therefore, do not overthink and use our instructions to guide you. Please only select emotions towards the group the question refers to. You may select up to two emotions, but always within the same sign, therefore no mix of positive and negative emotions. Based on the previous example:

Which primary emotion does the text show towards Muslims?

Positive

Negative

Please select at least one type of type of Negative emotion the text primarily contains towards Muslims. You may select up to two emotions if the text contains them.

Anger

Someone is causing harm or a negative/undeserved outcome, while this could have been avoided.

Someone is acting in an unjustified manner towards people.

Someone is blocking the goals of people.

Anxiety/Fear

Something negative might/could happen (sooner or later), which threatens the well-being of people.

Contempt

Someone is inferior (for example, immoral, lazy or greedy).

Someone is incompetent (for example, weak or stupid).

Moral Disgust

Someone behaves in an offensive way (for example, corrupt, dishonest, ruthless, or unscrupulous behavior).

Guilt/Shame

Someone sees him-/herself as responsible for causing a harmful/immoral/shameful/embarrassing outcome to people.

Sadness

Something bad or sad has happened.

Someone has experienced a loss (for example, death or loss of possessions).

Neutral

The exemplary comment describes Muslims and Islam as a threat that will "blow out the Notre Dame or destroy...", therefore it sees it as dangerous and posing a threat.
• It is important to distinguish the target of the questions in the text. A comment may contain references to more than one target group or individual, but you should answer focusing on the group mentioned in the question. For instance:

  This is the headline of an online-newspaper article:

  Alex Jones: Charlottesville protesters are really “just Jewish actors”

  
  

  Below you see a posted Reddit comment to the article above. Please read it carefully and answer the questions below based on this comment.

  When I was in high school and we learned about kristallnacht, I remember thinking how strange it was that people blamed the destruction of Jewish neighborhoods and businesses on the Jews themselves. I thought it made no sense to literally blame Jewish people for anti Semitic violence, and that the general public accepted this ludicrous assertion. As I live and breathe a Nazi apologist is blaming a Nazi rally on the Jews. Its still absurd, its still hateful, and people still believe this garbage

  The previous comment clearly shows support to the Jewish community after some comments by a mediatic persona. The comment shows Anger towards the news headline, but you should answer the questions based on the attitude towards Jews:

  What kind of language does this comment contain towards Jews?

  Supportive or Favorable

  Which primary emotion does the text show towards Jews?

  Positive

  Please select at least one type of Positive emotion the text primarily contains towards Jews. You may select up to two emotions if the text contains them.

  Sympathy

  Someone shows support or devotion.

We highly recommend you to go through the Main Instructions section, in order to understand the annotation task. Find below some additional advice about the questions you will be answering.

Discrimination or Support?

• Each Reddit comment refers to a certain social group, which is always specified in the question.
• We want you to focus on how the comment refers to that group and its primary emotion towards it.
• If you believe that the comment expresses any discrimination towards that group, for example, by derogatory language, negative stereotypes, generalization, we ask you to mark it as discriminatory or alienating.
• Please bear in mind, that in some cases, a comment may show a negative attitude towards a social group without sounding necessarily discriminatory. It may be critical of that group, be cynical, or use humor, without trying to discriminate or alienate.

Descriptions of Emotions

• These descriptions are meant as a useful tool in assessing emotions the Reddit comment expresses towards a certain group.
• However, they are not absolute descriptions. Therefore, please use them as a guideline to decide.