Machine Learning for Web Page Classification: A Survey

Abstract

The Internet contains a vast amount of data that is growing exponentially. To exploit this data, a Web information retrieval system and a categorization of internet content based on the classification of web pages are essential. Web page classification has many applications, among them the construction of web directories and the building of focused crawlers. In this paper, we present the characteristics of web page classification, we produce a literature review by summarizing and evaluating all sources related to web page classification crawled automatically from ScienceDirect and Springer websites, we review the different machine learning algorithms used to categorize web pages. Finally, we track the underlying assumptions behind the studied methods.