Abstract: There is a growing need for a set of benchmarking tests for measuring search engines, because research on search engine evaluation is inconsistent in methods and approaches. Using these tests researchers can make comparisons between different search engines and carry out longitudinal studies on a particular search engine with a degree of consistency. Several problems emerge during the evaluations of search engines which are needed to be solved to measure search engine performance objectively. This paper presents a brief review of the different statistical methods and approaches utilized in search engine evaluations. It describes six significant research projects with their fulfilled activities and statistical findings. It also serves as a guideline for choosing an appropriate statistical method for use in search engine evaluations.
Keywords: Performance evaluation, measurement of search engines.
Classification (MSC2000): 62P30; 68M20
Full text of the article: