3 results found
  1. Webis-Sentences-17

    Published Feb 27, 2017
  2. Webis-Simple-Sentences-17 Corpus

    Published Feb 27, 2017
  3. Webis-Mnemonics-17

    Published 2017
  4. Not seeing a result you expected?
    Learn how you can add new datasets to our index.

Click to copy link
Link copied


  • Dataset published Feb 27, 2017
Dataset provided by
Bauhaus University, Weimar
The Web Technology & Information Systems Network
Kiesel, Johannes; Stein, Benno; Lucks, Stefan

The Webis-Sentences-17 corpus is a collection of 3,369,618,811 sentences extracted from the ClueWeb12 web crawl. It is designed to allow for statistical analyses of human-written sentences. More details on the sentence extraction can be found in the associated publication. The Webis-Simple-Sentences-17 corpus contains 471,085,690 English sentences from the Webis-Sentences-17 corpus. The sentences were sampled to achieve a level of sentence complexity similar to the one of sentences that humans make up as a memory aid for remembering passwords. Sentence complexity was determined by syllables per word. Both corpora are split in training and test set as they are used in the associated publication. The test set is extracted from part 00 of the ClueWeb12, while the training set is extracted from the other parts.

Clear search
Close search
Google apps
Main menu