Discovering New Trends in Web Robot Traffic through Functional Classification

Authors

Derek Doran, Wright State University - Main CampusFollow
Swapna S. Gokhale

Document Type

Conference Proceeding

Publication Date

7-2008

Find this in a Library

Catalog Record

Abstract

This paper proposes a novel functional classification scheme to understand and analyze web robot traffic. The scheme is rooted in the recognition that the crawling behavior of a robot on a site is primarily governed by its intended purpose or functionality. We apply the classification rules to analyze web server access logs from the University of Connecticut School of Engineering domain. The analysis results indicate how the classification scheme can provide insights into the robot traffic based on their functionality.

Comments

Presented at the Seventh IEEE International Symposium on Network Computing and Applications, Cambridge, MA, July 10-12, 2008.

Repository Citation

Doran, D., & Gokhale, S. S. (2008). Discovering New Trends in Web Robot Traffic through Functional Classification. Proceedings of the Seventh IEEE International Symposium on Network Computing and Applications, 275-278.
https://corescholar.libraries.wright.edu/cse/257

DOI

10.1109/NCA.2008.47