Popularity and findability through log analysis of search terms and queries: the case of a multilingual public service website

Abstract

SHIL on the Web is the website of the Israeli Citizens' Advice Bureau. It provides information about rights, social benefits, government and public services and civil obligations. Activity on the site approaches 10,000 pages visited per day. It has interfaces in four languages: Hebrew, Arabic, Russian and English. Logfile analysis of the SHIL website revealed to our surprise that about 60.7% of the requests reaching SHIL from external sites (excluding requests from robots) are from general search engines (e.g. Google and MSN), and users reach a specific page on the site linked from the search results page. This finding seems to indicate that the site is not known well enough to the public. On the other hand the site is very active, thus it seems to serve Israeli citizens well, even without being a well known brand. In this paper we analyzed the external requests coming from search engines. The analysis is based on the 266,295 queries from search engines that reached SHIL during March—October 2005. Studying queries submitted to search engines is a novel technique for analyzing the access patterns to the site and provides a better understanding of the user needs and intentions than analyzing the distribution of the visited pages only. We are not aware of any previous study that analyzed the relation between the query submitted to the search engine and the webpage the user clicked on the search results page. Since search engines provide snippets, when the user clicks on a specific page he already has some information on what is to be found on the page and the user makes a conscious decision to click on the specific result. Thus, this type of analysis provides additional information about the users' actual information needs.

Keywords

logfile analysis information on public and governmental services and entitlements queries search engines

Get full access to this article

View all access options for this article.

References

R. Marcella and G. Baxter , The information needs and information seeking behaviour of a national sample of the population in the United Kingdom, with special reference to needs related to citizenship, Journal of Documentation 55(2) (1999) 159—83.

K.E. Fisher , M. Saxton , C. Naumer and C. Pusateri , WIN 2—1—1: Performance Evaluation and Cost-Benefit Analysis of 2—1—1 I&R systems (2005). Available at: http://ibec.ischool.washington.edu/win211.pdf (accessed 7 August 2006).

L. Rainie and J. Horrigan , A decade of adoption: how the internet has woven itself into American life. PEW Internet and American Life Project (2005) Available at: www.pewinternet.org/pdfs/Internet_Status_2005.pdf (accessed 7 August 2006).

Nielsen/Netratings, Top search terms reveal that users rely on search engines to navigate their way to common Web sites, according to Nielsen/Netratings. Nielsen/Netratings Press Release. (2006). Available at: www.nielsen-netratings.com/pr/pr_060118.pdf (accessed 7 August 2006).

B.J. Jansen , A. Spink and J. Pedersen , A temporal comparison of AltaVista web searching, Journal of the American Society for Information Science and Technology 56(6) (2005) 559—70.

A. Broder , A taxonomy of Web search, ACM SIGIR Forum ( 2002). Available at: www.sigir.org/forum/F2002/broder.pdf (accessed 7 August 2006).

P. Morville , Ambient Findability (O'Reilly Media, 2005).

T.P. Novak and D.L. Hoffman , New metrics for new media, W3C Journal 2 (1997). Available at: www.w3journal.com/5/s3.novak.html (accessed 7 August 2006).

R. Fielding , J. Gettys , J. Mogul , H. Frystyk , L. Mastiner and T. Berners-Lee , RFC 2616 — Hypertext Transfer Protocol — HTTP/1.1. ( 1999). Available at: www.faqs.org/rfcs/rfc2616.html (accessed 7 August 2006).

10.

Wikipedia, Referer (2006). Available at: http://en.wikipedia.org/wiki/Referer (accessed 7 August 2006).

11.

C. Silverstein , M. Henzinger , H. Marais and M. Moricz , Analysis of a very large Web search engine query log, ACM SIGIR Forum 33(1) (1999) 6—12. Available at: www.acm.org/sigir/forum/F99/Silverstein.pdf (accessed 7 August 2006).

12.

N.C.M. Ross and D. Wolfram , End user searching on the Internet: an analysis of term pair topics submitted to the Excite search engine, Journal of the American Society for Information Science 51(10) (2000) 949—58.

13.

A. Spink , D. Wolfram , B.J. Jansen and T. Saracevic , Searching the Web: the public and their queries, Journal of the American Society for Information Science and Technology 52(3) (2001) 226—34.

14.

D. Wolfram , A. Spink , B.J. Jansen and T. Saracevic , Vox populi: the public searching of the Web, Journal of the American Society for Information Science and Technology 52(12) (2001) 1073—4.

15.

A. Spink , S. Ozmutlu , H.C. Ozmutlu and B.J. Jansen , U.S. versus European Web searching trends, SIGIR Forum Fall (2002) 32—8. Available at: www.acm.org/sigir/forum/F2002/spink.pdf (accessed 7 August 2006).

16.

B.J. Jansen and A. Spink , An analysis of Web searching by European AlltheWeb.com users, Information Processing and Management . 41(2) ( 2005) 361—81.

17.

A. Spink , B.J. Jansen , D. Wolfram and T. Saracevic , From e-sex to e-commerce: Web search changes, IEEE Computer 35(3) (2002), 107—9.

18.

S. Ozmutlu , A. Spink and H.C. Ozmutlu , A day in the life of Web searching: an exploratory study, Information Processing and Management 40(2) (2004) 319—45.

19.

S.M. Beitzel , E.C. Jensen , A. Chowdhury , D. Grossman and O. Frieder , Hourly analysis of a very large topically categorized Web query log. In: K. Jarvelin et al. (eds), Proceedings of the 27th Annual International ACM Conference on Research and Development in Informational Retrieval, SIGIR '04, Sheffield, 25—29 July (ACM, 2004) 321—28.

20.

S. Park , J.H. Lee , and H.J. Bae , End user searching: a Web log analysis of NAVER, a Korean Web search engine . Library and Information Science Research 27(2) (2005) 223—31.

21.

Y. Xie and D. O'Hallaron ,. Locality in search engine queries and its implications for caching. In: P. Kermani et al. (eds), Proceedings of the 21st Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM'02) 23—27 June 2002, New York (IEEE, 2002) 307—17.

22.

A. Spink and B.J. Jansen, Web Search : Public Searching of the Web ( Kluwer Academic, Dordrecht, 2004 ).

23.

B.J. Jansen and A. Spink , How are we searching the World Wide Web? A comparison between nine search engine transaction logs, Information Processing and Management 42(1) ( 2006), 248—63.

24.

W. Croft , R. Cook and D. Wilder , Providing government information on the Internet: experiences with THOMAS . Paper presented at the Digital Libraries Conference , Austin, Texas (1995). Available at: http://thomas.loc.gov/home/dlpaper.html (accessed 7 August 2006).

25.

S. Jones , S.J. Cunningham and R. McNab , Usage analysis of a digital library. In: I. Witten et al. (eds), Proceedings of the Third ACM Conference on Digital Libraries, 23—26 June 1998, Pittsburgh (ACM, 1998) 293—4.

26.

F. Cacheda and A. Vina , Experiences retrieving information in the World Wide Web. In: Proceedings of the 6th IEEE Symposium on Computers and Communications, 3—5 July 2001, Hammamet, Tunisia (ISCC'01) (IEEE Compuer Society, Los Alamitos, 2001 ) 72—9.

27.

P. Wang , M.W. Berry and Y. Yang , Mining longitudinal Web queries: trends and patterns, Journal of the American Society for Information Science and Technology 54(8) (2003) 743—58.

28.

M. Chau , X. Fang and O.R.L. Sheng , Analysis of the query logs of a Web site search engine, Journal of the American Society for Information Science and Technology 56(13) (2005), 1363—76.

29.

M. Thelwall , Web log file analysis: backlinks and queries , Aslib Proceedings 53(6) (2001) 217—23.

30.

P.M. Davis , Information-seeking behavior of chemists: a transaction log analysis of referral URLs, Journal of the American Society for Information Science and Technology 55(4) (2004) 326—32.

31.

M.J. Bates , The design of browsing and berrypicking techniques for the online search interface, Online Review 13 (1989) 407—24.

32.

G.M. Marchionini , Information Seeking in Electronic Environments (Cambridge University Press, Cambridge , 1995).

33.

C.W. Choo , B. Detlor and D. Turnball , Information seeking on the Web — an integrated model of browsing and searching. In: Proceedings of the 1999 ASIS Annual Meeting (1999). Available at: http://choo.fis.utoronto.ca/fis/respub/asis99/ (accessed 2 December 2006).

34.

D. Ellis , A behavioural model for information retrieval system design, Journal of Information Science 15(4—5) (1989) 237—47.

35.

F. Aguilar , Scanning the Business Environment (Macmillan, New York, 1967).

36.

C. Hölscher and G. Strube , Web search behavior of Internet experts and newbies. In: Proceedings of WWW9 (1999). Available at: www.9.org/w9cdrom/81/81.html (accessed 2 December 2006)

37.

K.C. Laudon and C.G. Traver, E-commerce : Business, Technology and Society ( Prentice Hall, Upper Saddle River, NJ, 2006)

38.

J.P. Bailey and Y. Bakos , An exploratory study of the emergence of electronic intermediaries, International Journal of Electronic Commerce 1(3) (1997) 7—20.

39.

R.S. Burt , Second-hand brokerage: evidence on the importance of local structure for managers, bankers, and analysts, Academy of Management Journal (forthcoming).

40.

M.B. Sarkar , B. Butler and C. Steinfeld , Intermediaries and cybermediaries: A continuing role for mediating players in the electronic marketplace, Journal of Computer Mediated Communication 1 (1995). Available at: http://jcmc.indiana.edu/vol1/issue3/sarkar.html (accessed 7 August 2006)

41.

C. Vishik and A.B. Whinston , Knowledge sharing, quality and intermediation. In: D. Georgakopoulos et al. (eds), Proceedings of the International Joint Conference on Work Activities Coordination and Collaboraton (WASS '99) 22—25 February 1999, San Francisco, (ACM, 1999) 157—66.

42.

G.M. Giaglis , S. Klein and M. O'Keefe , Disintermediation, reintermediation, or cyberintermediation? The future of intermediaries in electronic marketplaces . In: S. Klein et al. (eds), Proceedings of the 12th International Bled Electronic Commerce Conference, 7—9 June 1999, Bled, Slovenia (1999) 389—407. Available at: http://citeseer.ist.psu.edu/252518.html (accessed 6 February 2007).

43.

B. Graham , A New Way of Tracking Blank Referrals (2005). Available at: www.webmasterworld.com/forum39/3213.htm (accessed 7 August 2006).

44.

AOL Apologizes for Release of User Search Data. ( 2006). Available at: http://news.com.com/AOL+apologizes+for+release+of+user+search+data/2100—1030_3—6102793.html (accessed 9 August 2006).

45.

Government of Israel , All Ministers in the Ministry of Labor and Social Welfare (2006 ). Available at: www.knesset.gov.il/govt/eng/GovtByMinistry_eng.asp?ministry=15 (accessed 7 August 2006).

46.

Government of Israel , All Ministers in the Ministry of Trade and Industry (2006). Available at: www.knesset.gov.il/govt/eng/GovtByMinistry_eng.asp?ministry=6 (accessed 7 August 2006).