2 datasets found
  1. PAN17 Multi-Author Analysis: Style-Change-Detection

    • zenodo.org
    Updated Apr 9, 2020
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Michael Tschuggnall; Efstathios Stamatatos; Ben Verhoeven; Walter Daelemans; Günther Specht; Benno Stein; Benno Stein; Martin Potthast; Martin Potthast; Michael Tschuggnall; Efstathios Stamatatos; Ben Verhoeven; Walter Daelemans; Günther Specht (2020). PAN17 Multi-Author Analysis: Style-Change-Detection [Dataset]. http://doi.org/10.5281/zenodo.3737655
    Explore at:
    Dataset updated
    Apr 9, 2020
    Dataset provided by
    Zenodohttp://zenodo.org/
    Authors
    Michael Tschuggnall; Efstathios Stamatatos; Ben Verhoeven; Walter Daelemans; Günther Specht; Benno Stein; Benno Stein; Martin Potthast; Martin Potthast; Michael Tschuggnall; Efstathios Stamatatos; Ben Verhoeven; Walter Daelemans; Günther Specht
    Description

    All documents are provided in English and may contain zero up to arbitrarily many switches (style breaches). Thereby switches of authorships may only occur at the end of sentences, i.e., not within.

    More information: Link

  2. PAN19 Authorship Analysis: Style Change Detection

    • zenodo.org
    Updated Aug 10, 2021
    Share
    FacebookFacebook
    TwitterTwitter
    Email
    Click to copy link
    Link copied
    Close
    Cite
    Eva Zangerle; Michael Tschuggnall; Günther Specht; Martin Potthast; Martin Potthast; Benno Stein; Benno Stein; Eva Zangerle; Michael Tschuggnall; Günther Specht (2021). PAN19 Authorship Analysis: Style Change Detection [Dataset]. http://doi.org/10.5281/zenodo.3530362
    Explore at:
    Dataset updated
    Aug 10, 2021
    Dataset provided by
    Zenodohttp://zenodo.org/
    Authors
    Eva Zangerle; Michael Tschuggnall; Günther Specht; Martin Potthast; Martin Potthast; Benno Stein; Benno Stein; Eva Zangerle; Michael Tschuggnall; Günther Specht
    Description

    Many approaches have been proposed recently to identify the author of a given document. Thereby, one fact is often silently assumed: i.e., that the given document is indeed written by only author. For a realistic author identification system it is therefore crucial to at first determine whether a document is single- or multiauthored.

    To this end, previous PAN editions aimed to analyze multi-authored documents. As it has been shown that it is a hard problem to reliably identify individual authors and their contribution within a single document (Author Diarization, 2016; Style Breach Detection, 2017), last year's task substantially relaxed the problem by asking only for binary decision (single- or multi-authored). Considering the promising results achieved by the submitted approaches (see the overview paper for details), we continue last year's task and additionally ask participants to predict the number of involved authors.

    Given a document, participants thus should apply intrinsic style analyses to hierarchically answer the following questions:

    1. Is the document written by one or more authors, i.e., do style changes exist or not?
    2. If it is multi-authored, how many authors have collaborated?

    All documents are provided in English and may contain zero up to arbitrarily many style changes, resulting from arbitrarily many authors.

    The training set: contains 50% of the whole dataset and includes solutions. Use this set to feed/train your models.

    Like last year, the whole data set is based on user posts from various sites of the StackExchange network, covering different topics and containing approximately 300 to 2000 tokens per document.

    For each problem instance X, two files are provided:

    • problem-X.txt contains the actual text
    • problem-X.truth contains the ground truth, i.e., the correct solution in JSON format:
    { "authors": number_of_authors, "structure": [author_segment_1, ..., author_segment_3], "switches": [ character_pos_switch_segment_1, ..., character_pos_switch_segment_n, ] }

    An example for a multi-author document could look as follows:

    { "authors": 4, "structure": ["A1", "A2", "A4", "A2", "A4", "A2", "A3", "A2", "A4"], "switches": [805, 1552, 2827, 3584, 4340, 5489, 7564, 8714] }

    whereas a single-author document would have exactly the following form:

    { "authors": 1, "structure": ["A1"], "switches": [] }

    Note that authors within the structure correspond only to the respective document, i.e., they are not the same over the whole dataset. For example, author A1 in document 1 is most likely not the same author as A1 in document 2 (it could be, but as there are hundreds of authors the chances are very small that this is the case). Further, please consider that the structure and the switches are provided only as additional resources for the development of your algorithms, i.e., they are not expected to be predicted.

    To tackle the problem, you can develop novel approaches, extend existing algorithms from last year's task or adapt approaches from related problems such as intrinsic plagiarism detection or text segmentation. You are also free to additionally evaluate your approaches on last year's training/validation/test dataset (for the number of authors use the corresponding meta data).

  3. Not seeing a result you expected?
    Learn how you can add new datasets to our index.

Share
FacebookFacebook
TwitterTwitter
Email
Click to copy link
Link copied
Close
Cite
Michael Tschuggnall; Efstathios Stamatatos; Ben Verhoeven; Walter Daelemans; Günther Specht; Benno Stein; Benno Stein; Martin Potthast; Martin Potthast; Michael Tschuggnall; Efstathios Stamatatos; Ben Verhoeven; Walter Daelemans; Günther Specht (2020). PAN17 Multi-Author Analysis: Style-Change-Detection [Dataset]. http://doi.org/10.5281/zenodo.3737655
Organization logo

PAN17 Multi-Author Analysis: Style-Change-Detection

Explore at:
Dataset updated
Apr 9, 2020
Dataset provided by
Zenodohttp://zenodo.org/
Authors
Michael Tschuggnall; Efstathios Stamatatos; Ben Verhoeven; Walter Daelemans; Günther Specht; Benno Stein; Benno Stein; Martin Potthast; Martin Potthast; Michael Tschuggnall; Efstathios Stamatatos; Ben Verhoeven; Walter Daelemans; Günther Specht
Description

All documents are provided in English and may contain zero up to arbitrarily many switches (style breaches). Thereby switches of authorships may only occur at the end of sentences, i.e., not within.

More information: Link

Search
Clear search
Close search
Google apps
Main menu