rbtsbg/germeval-2018-data

This repository contains all manually labeled data from the GermEval-2018 shared task.

GermEval-2018 data repository

This repository contains all different types of data from the GermEval-2018 shared task.

manually labelled training and test data

The manually labelled GermEval-2018 data consists of two files:

1. germeval2018.training.txt

This file represents the training data from the shared task. It contains the annotation for both tasks of the shared task.

2. germeval2018.test.txt

This file represents the test data from the shared task. It contains the annotation for both tasks of the shared task.

guidelines

Detailed guidelines regarding the annotation scheme of the data can be found in the following file:

guidelines-iggsa-shared.pdf

usage

lIf you publish any work using the GermEval-2018 data, please cite the following publication:

Michael Wiegand, Melanie Siegel, and Josef Ruppenhofer: "Overview of the GermEval 2018 Shared Task on the Identification of Offensive Language", in Proceedings of the GermEval, 2018, Vienna, Austria.

evaluation tool

The file

evaluationScriptGermeval2018.pl

represents the evaluation tool. It can be used to evaluated the predictions for both tasks of the shared task.

In order to obtain further information on the usage of that tool please type:

perl evaluationScriptGermeval2018.pl --help

results

The complete evaluation of all runs submitted by participants can be found in the file:

results.pdf

submissions

The submissions of all participants for both tasks can be found in the package:

submissions.tgz

survey

All participants had to complete an online survey as part of their submission. The results of the survey are available in the file:

survey.pdf

further information

More information about the shared task can be found on the website of the task: https://projects.fzai.h-da.de/iggsa/

contact information

Please direct any questions that you have about this data to the organizers of the shared task:

Josef Ruppenhofer email: [email protected]

Melanie Siegel email: [email protected]

Michael Wiegand email: [email protected]