Webis Open Directory Project Corpus 2010 (Webis-ODP-10)
- zenodo.org
application/gzipUpdated Jan 24, 2020+ more versions
Share
Facebook
Twitter
EmailClick to copy linkLink copiedCiteDennis Hoppe; Benno Stein; Benno Stein; Dennis Hoppe (2020). Webis Open Directory Project Corpus 2010 (Webis-ODP-10) [Dataset]. http://doi.org/10.5281/zenodo.3254453application/gzipAvailable download formatsUnique identifierhttps://doi.org/10.5281/zenodo.3254453Dataset updatedJan 24, 2020AuthorsDennis Hoppe; Benno Stein; Benno Stein; Dennis HoppeLicenseAttribution 4.0 (CC BY 4.0)https://creativecommons.org/licenses/by/4.0/
License information was derived automaticallyDescriptionThe Webis Open Directory Project Corpus 2010 (Webis-ODP-10) is a corpus for the evaluation of cluster labeling algorithms. The corpus contains about 5,000 web pages which are grouped into 4 main categories and 12 subcategories based on the human made Open Directory Project (ODP) classification. The web pages were collected in May 2010.
In order to create the corpus, 4 different categories of the Open Directory Project were chosen: movies, databases, health and recreation. Each of these categories is again consists of up to six subcategories. In the case of movies, these subcategories correspond to six different titles of two directors. The categories were chosen to allow for different settings of experiments. Example for tasks are to distinguish the two directors or to separate web pages about recreation from those about health.
For each category, the linked web pages were downloaded if they still existed. Furthermore, web pages which are linked from these web pages were downloaded as well and considered to be in the same category. However, only web pages of a length of 1,000 or more characters (excluding HTML tags and scripts) were kept.
Not seeing a result you expected?
Learn how you can add new datasets to our index.
FacebookTwitterEmailAttribution 4.0 (CC BY 4.0)https://creativecommons.org/licenses/by/4.0/
License information was derived automatically
The Webis Open Directory Project Corpus 2010 (Webis-ODP-10) is a corpus for the evaluation of cluster labeling algorithms. The corpus contains about 5,000 web pages which are grouped into 4 main categories and 12 subcategories based on the human made Open Directory Project (ODP) classification. The web pages were collected in May 2010.
In order to create the corpus, 4 different categories of the Open Directory Project were chosen: movies, databases, health and recreation. Each of these categories is again consists of up to six subcategories. In the case of movies, these subcategories correspond to six different titles of two directors. The categories were chosen to allow for different settings of experiments. Example for tasks are to distinguish the two directors or to separate web pages about recreation from those about health.
For each category, the linked web pages were downloaded if they still existed. Furthermore, web pages which are linked from these web pages were downloaded as well and considered to be in the same category. However, only web pages of a length of 1,000 or more characters (excluding HTML tags and scripts) were kept.