Abstract
There is an inherent rift between the characteristics of Web of documents and the Web of data – the latter is enriched with semantic properties that are not present in the former. This creates a formidable challenge for entity search in the era of Linked Data, requiring a new method that leverages on such features. Query expansion, used in keyword-based search, improves search quality by enhancing a query with terms. Existing query-expansion methods, statistical- and lexical-based approaches, are inadequate for linked data in two ways: (a) term-to-term co-occurrence, used in the statistical-based approach, cannot find satisfactory expansions in internal corpus (SPO triples) or external corpus (Web of documents); and (b) lexical incomparability between ontologies (or thesauri) as reference knowledge and linked data renders tenuous the possibility of creating lexically sound expanded queries. The study introduces a framework to expand keyword queries with expansion entities for keyword-based entity search in linked data. The framework offers two structures, star-shaped and multi-shaped RDF graphs (documents), to model the entities in linked data for indexing and search, and an algorithm called PFC for expansion entities by which to expand a given query. PFC obtains expansion entities by measuring a global importance (PageRank and entity–document Frequency) and a local importance (Centrality) of the candidates extracted from the returned RDF documents of the entity search. Our experiments illustrate that PFC improves search results by approximately 7%. This study also includes suggestions on how to glean important link types for extracting candidate expansion entities, as well as identifying properties of these entities by which to expand the query.
1. Introduction
With the development of the Semantic Web, Linked Data has become popular for connecting distributed datasets across the Web. During the past few years, the size of Linked Data has increased gradually, reaching 28.5 billion triples in 2010 [1]. An entity described by multiple triples is identifiable using a de-referenceable URL. For example, the entity ‘Michael Jackson’ is identified by the URL ‘Dbpedia:Michael_Jackson’, which is an RDF document with the triples about the entity ‘Dbpedia:Michael_Jackson’. All of the entities with a unique URL related to the entity ‘Dbpedia:Michael_Jackson’ are contained in the RDF document. Linked Data supplies users with comprehensive knowledge, but also raises a need to search entities in Linked Data. Entity search aims to find entities based on a query. Keyword-based entity searches address indexing scalability and query formalization, which are the main limitations of SPARQL endpoints [2], and are considered a better solution for entity search [3, 4]. Several entity search engines, such as Swoogle [5], Sindice [6] and Falcon [7], have adapted Information Retrieval (IR) techniques to provide solutions for keyword-based entity search. Keyword queries are typically very short [8], which makes an entity search engine hardly capture query contexts. Furthermore, users often resort to folksonomies described by various terminologies used in Linked Data, effectively creating a problem called ‘vocabulary problem’ [9]. Therefore, query expansion is studied to improve keyword-based entity search in Linked Data with expanded queries [10].
Query expansion [11] adds new terms to a query in an attempt to provide better contextualization and to help search engines to retrieve relevant documents [9]. Automatic query expansion techniques leverage various data sources to find new features related to queries. The techniques can in general be classified into two categories: lexical- and statistical-based approaches [12]. The inability to acquire suitable entities from RDF documents to expand the query is due to several reasons. In the lexical approaches, the use of thesauri or ontologies may be insufficient to cover the topics in a linked dataset. Furthermore, thesauri and ontologies differ in their structures of concepts from those in the linked data. The statistical approaches compute co-occurrences of a query in different documents or windows to help find related concepts [9]. For Linked Data, co-occurrences should not be regarded as a valuable measurement for finding suitable expansion entities. Most entities appear only once in the processed RDF documents in the entity search engines [13, 14], so this flat structure of the documents limits co-occurrence computations in Linked Data and decreases the importance of highly co-occurring entities. Concepts found by the statistical approaches with external corpora, such as Web pages, can be used to expand queries for improving entity search [10]. However, concepts explored with Web pages sometimes have too much noise, which limits their contributions for improving entity search in Linked Data.
To improve entity search in Linked Data, we aimed to discover expansion entities from an internal corpus (a linked dataset). Three tasks are involved in the study to achieve our goal: (a) how to find expansion entities by which to expand a query; (b) which links in RDF documents play an important role in extracting effective expansion entities; and (c) how to model expanded queries with expansion entities. To achieve the first task, we have extended the work in Zong et al. [15], which explores related entities or links in order to help new linked data suppliers to find new alignments. We propose a framework to help existing keyword-based entity search engines, such as Sindice [16], to improve search by expanding queries with expansion entities (the expansion entities denote entities used to expand a query). The framework provides two graph structures, star-shaped and multi-shaped indices, to model the entities in linked data for indexing, and an expansion entity discovering and ranking algorithm called PFC. The PFC discovers candidate expansion entities based on the returned RDF documents from an entity search, and sorts the candidates with a global importance measure, adapted from PageRank and entity–document frequency in the global graph, and a local importance measure, adapted from graph centrality in the local graph. Several parameters are adjusted to determine an acceptable level of query shifting [17]. With the experiments based on a linked dataset, Billion Triple Challenge 2009, we demonstrate that the PFC performs better than the lexical-based method with a knowledge base (WordNet), the statistical-based methods with the internal (the searched linked dataset) and the external corpus (Web of documents). From our experience while solving the second and the third tasks, we gained two insights based on the experiments:
Some link types (defined by DBpedia, Foaf, Sioc) are more important than others in extracting candidate expansion entities.
A URL or name of an entity is more suitable for expanding a query than other properties.
The rest of the paper is organized as follows: Section 2 shows the related works; Section 3 presents our query expansion framework; Section 4 details the entity ranking functions on the PFC; Section 5 describes the experiments in which our approach has achieved satisfactory results in both efficiency and effectiveness, when compared with other classic query expansion approaches; in Sections 6 and 7, we discuss the link types for candidate expansion entity extraction and identification of properties for modelling expanded queries; Section 8 discusses limitations of our study; and some conclusions and future work are presented in Section 9.
2. Related works
Since as early as the 1960s [18], automatic query expansion has been used to improve search results. Early research developed a range of seminal techniques, which have subsequently been improved and extended upon in various ways, such as vector feedback, term-term clustering and comparative analysis of term distributions [9]. On the other hand, a number of early experiments using small-scale collections produced inconclusive results that gained in recall but were often offset by a corresponding loss in precision, with respect to the retrieval effectiveness of such techniques [9]. The approaches can generally be classified into two categories: statistical and lexical approaches [9, 12].
In the lexical approaches, some studies use ontologies or thesauri to leverage global language properties to expand query terms. WordNet, known as a domain-independent ontology, is one of the most frequently used ontologies in language-specific approaches [19]. Synonyms, hypernyms and hyponyms are extracted to expand queries [20]. However, WordNet, used in query expansion, poses challenges, such as lack of proper nouns and/or collocations, or of an exact match between a query and concepts. To overcome the weaknesses, glossaries are used to expand queries instead of synonyms, hypernyms and hyponyms [21]. In addition, different types of information in WordNet are combined to give a better expansion [22–24]. Other resources such as Wikipedia [25–27] and Open Directory Project [28–30] are used as thesauri for query expansion. These external corpora used as knowledge bases or thesauri can improve effectiveness in text retrieval, such as Web of documents. However, little improvement can be achieved from using an external knowledge base or thesaurus if its domain differs from the domain of the data searched. In our experiment, WordNet was such an example in which the external data did not contribute to search improvement.
A domain-specific ontology is used to expand queries with concepts in the same domain as that of the data, which narrows down the search space [19]. For example, Fu et al. [31] build an expansion based on a domain and a geographical ontology for queries. In the biomedical domain, Jain et al. [32] integrate domain ontologies and automatic semantic relationship learning approaches to create semantic query expansions for EMR retrieval systems. Similarly, Álvarez et al. [33] use a medical ontology, MeSH, to expand queries with medical terms for improving performance of a Multi-modal Information Retrieval System. However, finding an appropriate ontology for data under search is a challenge.
In the statistical approaches, studies exist that explore query-related terms by computing co-occurrences using a term–document matrix dynamically generated by relevance feedbacks [9]. Relevance feedback approaches are also adapted to link entities in a knowledge base [34]. However, different from unstructured data, most co-occurring entities only appear once in an RDF document that describes an entity. Using co-occurrences hardly finds expansion entities with this flat structure. The query-specific approach based on co-occurrences extracts unsuitable entities and damages the search in our experiment in Section 5.3. External corpora can also be used to find expansion concepts instead of using an internal corpus based on statistical approaches. Diaz and Metzler [35] extract concepts from an external corpus based on a language model to improve ad-hoc retrieval on text data. Similar to Diaz and Metzler [35], external corpora, such as the Web of documents, are used to extract expansion concepts based on the Vector Space Model (VSM) and a language model to improve entity search in linked data [10]. However, an external corpus often contains too much noise and is not contributive to expanding queries. In our experiment, the PFC can find better expansion entities than those found by the methods used in Halpin and Lavrenko [10] based on the Web of documents. Other approaches, such as Semantic Associations [36], Semantic Relatedness [37] and constraints and logics [38], are used to expand queries for Linked Data: semantic associations between entities are used to calculate a related entity using a ranking strategy based on various aspects such as subsumption weight, path length weight, context weight and trust weight [36]. Semantic relatedness of an entity is calculated by maximizing paths from the entity with a spreading activation algorithm, and the most related entities are used for expanding queries [37]. Queries are expanded based on constraints and logics to form unfolding queries, which are mapped into relationships in the source to form folded queries [38]. Different from those approaches using either a global corpus or local feedback, the PFC takes global and local importance measures into consideration and can flexibly adjust effects of the global corpus and local feedbacks by changing parameters.
3. Framework
We propose a framework in which expansion entities are discovered to expand a given keyword query. The framework comprises four main parts: data pre-processing, PageRank computation, entity indexing and search, and expansion entity discovery and ranking. Figure 1 shows an architectural view of the framework. In data pre-processing (stage 1 in Figure 1), the whole linked dataset is partitioned into RDF documents, each of which models an entity in the data. Three strategies are used to model each entity: star-shaped, multi-shaped and context-shaped. The partitioned RDF documents will be indexed and searched with a given query by Siren (stage 3). The returned RDF documents from Siren will be used as an input to the PFC that discovers expansion entities (stage 4) in the three steps. First, candidate expansion entities are extracted from the returned documents. Second, candidates are sorted by a global importance, which is based on the PageRank scores computed in stage 2 and entity–document frequency pre-computed when indexing, and a local importance based on centrality. Finally, the top N candidates will be returned as the expansion entities. This section describes in detail each stage in the framework.

Framework of our query expansion method for keyword-based entity search.
3.1. Data pre-processing
In this paper, we will use an example to explain the processes of our method with the data in Figure 2(a). In a linked dataset, an RDF document that contains several triples (subject, predicate and object) is published with N-triple format (http://www.w3.org/2001/sw/RDFCore/ntriples/). An RDF document can also be published with N-quads format (http://sw.deri.org/2008/07/n-quads/) that contains quads (subject, predicate, object and context). In a triple or a quad, the values of the subject and the predicate are entities identified by de-referenceable URLs. The object value can be either an entity or a text (please note that, the term ‘entity’ used in this paper refers to the URL of the entity). For example, there are 10 triples in Figure 2(a). In the first triple, the subject is the entity ‘Dbpedia:Michael_jackson’, and the predicate and object are the entities ‘Dbpeida-owl:artist of’ and ‘Dbpedia:King_of_Pop(album)’. The value of an object can also be a text, such as the object of the third triple in Figure 2(a). An RDF document can be represented as an RDF graph [39]. For example, in Figure 2(a), 10 triples in an RDF document present an RDF graph that contains seven nodes and 10 directed links. The nodes are entities in the document, and the links are the relationships between them. In Figure 2, the first triple can generate a directed link named ‘Dbpedia-owl:artist of’ from the node named ‘Dbpedia:Michael_jackson’ to the node named ‘Dbpedia:king_of_Pop(album)’ (please note that, the concepts of RDF document and RDF graph are considered as the same, and are used interchangeably in this paper). An entity in linked data is described by a set of predicates and objects. Therefore, in keyword-based entity search engines, an entity is modelled with an RDF document that contains the triples or quads about the entity [13, 14]. If an RDF document contains the query, the document will be returned as the search result. In the data pre-processing stage, keyword-based entity search engines partition the whole linked data into RDF documents, each of which contains the triples about an entity. There are three ways to model the entities into the RDF graphs (documents): star-shaped, multi-shaped and context-shaped graphs.

An example of an RDF data and the RDF graph of this data.
For example, the dataset in Figure 2(a) can generate three RDF graphs for ‘Dbpedia:michael_jackson’, ‘Dbpedia:king_of_Pop(album)’ and ‘Dbpedia:Barry_White’, as in Figure 3. The RDF graph for ‘Dbpedia:michael_jackson’ is obtained by extracting all the triples with the subject: ‘Dbpedia:michael_jackson’.

Star-shaped graphs obtained from Figure 2(a).
For example, the dataset in Figure 2(a) can generate eight multi-shaped RDF graphs for all of the entities in Figure 4. The multi-shaped RDF graph for ‘Dbpedia:michael_jackson’ contains six triples for the entity ‘Dbpedia:michael_jackson’. In contrast to the star-shaped graph in Figure 3, the four triples refer to the same subject ‘Dbpedia:michael_jackson’, and the two triples refer to the entity ‘Dbpedia:michael_jackson’ as the object.

Multi-shaped graphs obtained from Figure 2(a).
For example, a context-shaped graph generated from Figure 2(a) contains all of the triples in the same provenance (context) ‘Dbpedia’ defined by the authors, and the graph will look like the RDF graph in Figure 2(b). A data supplier may define contexts for partitioning the whole dataset into different groups for diverse purposes. For example in BTC 2009, the entities ‘Dblp:Feitelson03’ and ‘Dblp: FenstermacherG02’ have the same context ‘swetodblp:swetodblp_march_2007_part_22.rdf’, since their provenance is ‘swetodblp:swetodblp_march_2007_part_22.rdf’. The entity ‘Dblp:EvjeF06’ and the entity ‘ Dblp:FengK05’ have the same context ‘ DBlp:jscic’, which is the journal where the two entities (articles) are published. Therefore, an entity can be in different context graphs. For example, the entity ‘Dblp:ColeZ04a’ can be contained in two context graphs: ‘Dblp: jscic’ and ‘DBlp: ColeZ04a’. We will discuss the context of the RDF documents in Section 5.3 in detail.
3.2. Keyword-based entity indexing and search
The inverted index has been widely used in information retrieval (IR), and there has been much interest from the semantic community in using the inverted index for searching RDF documents [14]. Generally, IR uses either the VSM or probabilistic models to index and search Web pages [14]. In the conventional VSM, RDF documents are represented as vectors of terms. A term weight indicating the importance of the term in the vector is computed by the Term Frequency–Inverse Document Frequency (TF-IDF). Some approaches have adapted the TF-IDF for calculating term weights in RDF documents: Siren uses the Term Frequency–Inverse Source Frequency (TF-ISF) and indexes RDF data based on a node-indexing scheme [16].
We adapted the node-indexing of Siren to index the RDF documents generated (stage 3 in Figure 1). The subject of an RDF document generated in Section 3.1 is not its identifier. For example, the subject ‘Dbpedia:michael_jackson’ is not the identifier of the RDF document 2 in Figure 4. Therefore, we have changed the TF-ISF for a star-shaped graph into the Term Frequency–Inverse RDF document Frequency (TF-IRF) to accommodate the multi-shaped and context-shaped graphs. The TF-IRF weighting scheme assigns to a term
where
is the inverse RDF document frequency, and
A query is converted into a vector that is used to compute the similarities between the vectors of RDF documents based on TF-IRF. Given a Boolean query
where
where
where
where
3.3. PFC for discovering and ranking of expansion entities
Entities are connected by links in Linked Data. To find expansion entities for a query, we developed an algorithm (PFC) that discovers expansion entities based on the returned RDF documents with a query in Siren and two importance measures (stage 4 in Figure 1). First, the top K RDF documents will be obtained by Siren with the given keyword query (line 1 in Algorithm 1). Second, all the entities in each RDF document will be extracted (lines 2 and 3). There is a special entity called the anchor entity that contains any term of the query in its URL (line 4). In the ongoing example, three RDF documents containing the query ‘Michael Jackson’ will be found in Figure 3, and the entity ‘DBpedia:michael_jackson’ is considered as the anchor entity. Given an anchor entity, we assume that an entity is potentially important if there is a link that connects it with the anchor entity. Hence, our efforts are directed towards discovering candidate expansion entities that have links to anchor entities. Third, for each returned document, the entities connected to an anchor entity are collected as candidate expansion entities (lines 5 and 6). The candidates are sorted by the two importance measures (line 7). Finally, the top N candidates are returned as expansion entities.
The process for discovering important entities
There are two importance measures attached to an entity: global and local [8]. The global importance measure for an entity denotes the amount of authority that the entity obtains from authority teleporting in PageRank, and the number of documents containing the entity in the global graph (i.e. the whole corpus). The local importance measure is the centrality inside a local graph formed by the returned top K RDF documents (graphs).
4. Expansion entity ranking algorithm in the PFC
Entity-ranking approaches consider the importance of entities in the global graph, and several variations of PageRank have been implemented for different ranking purposes. The scalability problems in these variations [40] will easily render their approaches infeasible when they process big datasets such as linked data. We adapted the original global PageRank for computing entity importance, since it cost the least amount of computation, compared with other variations [41–45]. In addition, the document frequency of an entity is considered to be another global importance measure in the PFC. In contrast to global impornce measures, local importance measures are considered closer to queries [8]. The centrality value of an entity in a local graph is another importance measure in the PFC. In this study, we compute the importance of an entity using the global (global PageRank score and entity–document frequency) and local (centrality) importance measures, as shown in the equation as follows:
where
4.1. Global importance
Given an RDF dataset, the subjects, predicates and objects are used to compute the global importance of the entities in the data. Two measures are used to evaluate the global importance of an entity, PageRank score and entity–document frequency.
To compute the PageRank score, a directed graph is constructed. First, the entities in subjects or objects will be used to form a set of nodes
where
The whole dataset is partitioned into RDF documents and indexed in an index
where
4.2. Local importance
Given a set of graph-structured RDF documents
A standardized centrality is defined as follows:
where
where
Figure 5 shows an example of discovering the expansion entities for a query ‘Michael Jackson’ with the star-shaped graphs in Figure 3. Three RDF graphs (documents) are found by the query. The entity ‘Dbpedia:michael_jackson’ that contains the query in its URL is considered as an anchor entity (shaped with the box). All other entities connected with the anchor entity ‘Dbpedia:michael_jackson’ are considered as the candidate expansion entities (shaped with the ellipses in solid line). All of the entities in the three RDF graphs form a local graph to compute the local importance of the candidate expansion entities. The ranking list of the candidates is sorted by the sum of the global importance values and the local importance value. The top N candidate entities are finally returned as the expansion entities for the query.

An example of entity ranking.
5. Experiment and evaluation
5.1. Preparation
In evaluating our semantic query expansion approach, we used the Billion Triple Challenge 2009 (BTC 2009) (http://challenge.semanticweb.org/) as the dataset. For PageRank computation and RDF document indexing, a Hadoop (http://hadoop.apache.org/) cluster was used, which has one master and two slaves, based on a 12-core computing unit with a 300 Gb hard disk and 3 Gb RAM in a cloud environment. For local searches, an Intel I-5 CPU with 4 Gb RAM and a 1 Tb hard disk on a Windows XP system was used. The BTC 2009 was partitioned into star-shaped, multi-shaped, and context-shaped graphs for indexing. The context-shaped index, using the provenances or subjects supplied by BTC 2009, puts all the triples from the same origin or subject into one document. It should be noted that the context graphs are not universally applicable as the star- and multi-shaped indices, since not all linked datasets are published with the N-quads format. Table 1 shows our dataset and indices.
Statistics of datasets and index sizes
5.2. Gold standard and query expansion approaches in comparison
The query expansion approaches in these experiments were evaluated based on the Yahoo! Semantic Challenge Test Data Sets (http://semsearch.yahoo.com/datasets.php). We chose Query Set #1 for entity search. Query Set #1 contains 50 queries (http://semsearch.yahoo.com/final-entities-2011.txt) and the assessment file are downloaded from the Yahoo! Web scope (http://webscope.sandbox.yahoo.com/). We compared the PFC with four other approaches: the lexical-based approach (LS) that uses WordNet as a thesaurus, the query-specific statistical approach (QS) that uses co-occurrences based on an internal data [12], and the statistical approaches based on Web of documents: Okapi-inquery and the LM-tf [10]. The approaches are implemented as follows.
Language-specific (LS): Given a query, relevant concepts or terms are discovered by WordNet to expand into the query [21]. The Java API for WordNet Searching (JAWS) (http://lyle.smu.edu/tspell/jaws/index.html) is used. Hyponyms and hypernyms are extracted and sorted by the WordNet Similarity (http://code.google.com/p/ws4j/). An original query is expanded with the top N concepts (hyponyms and hypernyms).
Query-specific (QS): We adapted entity-entity co-occurrences [12], called query-specific (QS), for discovering expansion entities. We used Latent Semantic Indexing (LSI) [48] for building the entity–document matrix based on Pseudo-Relevance feedbacks [12]. Using the Java Matrix Package (JAMA) (http://math.nist.gov/javanumerics/jama/), entity–entity co-occurrences based on Singular Value Decomposition (SVD) [49] are calculated. The top N entities for each query based on the co-occurrence matrix are extracted as the expansion entities. In our experiment, we used the top 100 (QS_100) and 1000 (QS_1000) documents separately to get entity co-occurrence matrices.
Okapi-inquery and the LM-tf: The concepts used to expand a query are generated from Web of documents [10]. We implemented two methods that performed best in Halpin and Lavrenko [10]. We obtained the top K Web pages from a Web search engine, Bing (http://www.bing.com/toolbox/bingsearchapi), for each query. The top K Web pages can be represented by the VSM and a language model. With the VSM, most-related terms, in the top X Pseudo-relevant documents obtained by the Okapi method [50], are gained by sorting similarity values with a given query with the inquery function [51]. We call this method Okapi-inquery, and set the parameters as
Our baseline results are gleaned from Siren using the original queries. The recall in IR increases as the number of query term increases. This makes the measure unsuitable for evaluating a query expansion method; hence, we evaluated the effectiveness by two kinds of precision (prevision at N and R-precision). We also evaluated running times and effectiveness using a different number of expansion entities.
5.3. Results
We ran the 50 queries with the six methods. The PFC read the Siren index and PageRank index from caches instead of reading from hard disks as shown in Figure 1. In order to fairly compare all the methods, we put the indices of the returned RDF documents from Siren and ontologies into caches. For the QS, we read the same Siren indices from the caches as the PFC does. For the LS, we installed a local database for WordNet, and cached all the concepts (hyponyms and hypernyms) used as candidate expansion concepts. Please note that we did not put the HTML documents used in Okapi-inquery and the LM-tf into caches, since the documents were obtained based on the search results of Bing dynamically. Figure 6 shows the details on the average running times of the 50 queries. The execution times of the LS (with the average of 76.14 ms) are much shorter than those of the PFC (248.46 ms), QS_100 (720.91 ms), QS_1000 (49163.2 ms), Okapi-inquery (24840.58 ms) ahe LM-tf (248455 ms). The PFC is quicker than the QS_100, and they are both much faster than the QS_1000. Okapi-inquery runs as fast as the LM-tf, and both are roughly twice as fast as QS_1000. The LS only requires a visit of the local WordNet database, which takes a very short time. The PFC considers three ranking scores for each candidate expansion entity: PageRank score, entity–document frequency and centrality. PageRank scores and entity–document frequencies are obtained from the PageRank index and the main RDF documents index, which are both pre-computed offline. The most on-the-fly time spent by the PFC is constructing a local graph based on returned RDF documents. A centrality computation in the local graph, generated with the search results of Siren for each query, needs comparably more time than reading of PageRank scores and entity–document frequencies from the indices, but requires less time than computations of the SVD used in the QS (100 and 1000) methods. The QS obtains expansions based on Pseudo-Relevance feedbacks, and the more documents are used, the more time is spent on the computation of the SVD. The PFC has an advantage that the online computations of the PFC are much lighter than those of the QS. Okapi-inquery and the LM-tf generate expansion concepts based on the VSM and the language model, which also need small computations on-the-fly. However, different from the other four methods, these two methods obtain expansions based on the results from a Web search engine, and need to send HTTP requests to obtain HTML documents on-the-fly. Therefore, as we mentioned, the efficiencies of Okapi-inquery and the LM-tf can be hardly improved using cashes since it is not practical to pre-cache the indices of the contents of the HTML documents returned from a Web search engine.

Running times of the six approaches for 50 queries.
We evaluated our approach using Terrier (http://terrier.org/). We followed the Terrier precision evaluation (http://terrier.org/docs/v3.5/evaluation.html), which checks the precision at N- and R-precision. We ran the 50 queries on the five query expansion approaches and the baseline approach with the three types of indices. For each query on an expansion method, we used the top one to five expansions to expand the original query. We compare the best search results of the expansion methods in Table 2.
The precisions at N- and R-precisions of all the algorithms for the three indices
As Table 2 shows, the PFC (
Table 3 shows one example of the expansions for the #9 query ‘ashley wagner’ in which the PFC is compared with the others. The original query ‘ashley wagner’ obtains one relevant entity ‘Dbpedia:Ashley_Wagner’ from the multi-shaped graph. With the expansion entity ‘Sioc:types#WikiArticle’, the PFC obtains one more relevant entity ‘wikipedia:Ashley_Wagner’. The LS provides the concepts related in WordNet, but not the terms related in the query in the BTC 2009. For example, ‘ashley wagner’ used in the #9 query is an American figure skater, and the concepts, such as ‘music’ used to expand the query in the LS, are not related to ‘ashley wagner’. Expanding the original query with non-related concepts will lead to non-relevant entities. In this example, expanded query ‘ashley wagner music’ returns no relevant entity. Since entities of the BTC 2009 are mostly extracted from the Web, using the Web as an external corpus performs better than WordNet in our experiments. For example, the #4 query ‘New England Coffee’ obtains zero relevant entity in entity search. With the query expanded with the concepts (‘page’ and ‘menu’) extracted from the Web, Okapi-inquery and the LM-tf obtain one relevant entity, ‘Dbpedia:The_21’s_Coffee_bar’. Using the Web of documents is heavily relied on for the results of Web search engines. The results of a Web search frequently change, which means that, for each query, concepts obtained by Okapi-inquery and the LM-tf for expanding queries vary greatly with Web search results. Therefore, the performances of these two methods are not as stable as the other methods. For example, the top 1 expansion concept of Okapi-inquery for the #1 query ‘08 Toyota tundra’ changes from ‘toyota’ to ‘cars’ in 4 weeks, from 18 August 2014 to 23 September 2014, in our experiment. The QS cannot find good expansions for the queries. Unlike the Web of documents, Linked Data contains a candidate entity occurring only once in a returned RDF graph, which decreases the importance of highly co-occurring entities inside the document and does not reflect the correlation between the candidate and the query. For example, ‘Wikipedia: User:Ashley_Pomeroy’ and ‘Dbpedia:Robert_Wagner’ obtained by the QS are two names that are not related to ‘ashley wagner’. The QS_100 achieves comparatively better results than the QS_1000, which demonstrates that the more entities are used to compute co-occurrences, the worse the expansion entities that are obtained.
The expansions of different approaches for the #9 query ‘ashley wagner’ in multi-shaped graph
We also observe that the multi-shaped index is the best structure for entity search (baseline) and query expansion (PFC), compared with the others. Both baseline and the PFC achieve better precision with the multi-shaped index, as shown in Figure 7. This can be explained by the content of the structures: the multi-shaped graph contains both inbound and outbound entities, which causes a higher inverse RDF document frequency and a lower term frequency than the other two structures. For example, with the query ‘Michael Jackson’ to search the RDF documents in Figure 5, the

Average precisions of the PFC for the three different indexing structures.
We also evaluated the query outcomes by the number of expansion entities. As shown in Table 4, the improvement in search decreases as the number of expansion entities used increases. The best results are obtained when queries are expanded only with the top one candidate expansion entity. We consider that this phenomenon is caused by a search drift: the larger the number of entities used to expand a query, the higher the possibility is that the search will drift to other topics. This differs from what commonly would be expected, that the more query words the user enters, the more likely it is that the search system will be able to determine the user’s intention. The automatic query expansion tends to improve precision by restricting the number of expansions for the effect of a search drift.
Precisions of the different number of expansions in different index structures
5.4. Parameters of importance measures
We tested various combinations of PageRank scores, centrality and entity–document frequency parameters in the PFC using the multi-shaped index. Precisions of expanded queries are indicated by the node sizes in Figure 8, with bigger nodes denoting higher precisions. We learned that the centrality and PageRank play relatively important roles in achieving improvements in semantic query expansion.

Distribution of average precisions in the different parameter combinations.
PageRank plays the most important role in increasing precision. We find that, for the high precisions shown in Figure 9 (a dimensionally reduced version of Figure 8),

The precision distribution based on PageRank and centrality after filtering unsatisfactory experimental results.
6. Important links for extracting the entities to expand the query
In Linked Data, link types (predicates or properties) provide varying effects on ranking algorithms. Analysis of effects imposed by link types will help users form valuable intuitions about them, and in turn, help personalize entity discovery by tracing a few important link types. We analysed the significance of each link type on global importance values and local importance value. We counted the frequency of each link type when it generated an expansion entity that belongs to one of the top N best expansion entities for each query by using one single importance value – PageRank, centrality or entity–document frequency.
Table 5 shows the top 10 most important link types for expanding the 50 queries, where N = 20. As Table 5 shows, expansion entities from ‘Dbpedia:wikiPageUsesTemplate’ with entity–document frequency as the importance measure achieve the best results in 41 queries. Expansion entities from ‘Foaf:page’ with centrality and PageRank as importance measures achieve the best results in 40 (centrality) and 39 (PageRank) queries. In general, the most important predicates are almost the same and are from DBpedia.
Top 10 most important link types for expansion using precision
7. Identifying the best properties for modelling the expanded query
An entity is indistinct, thus needs to be identified by its URL or represented by values of properties such as ‘Rdf:type’ and ‘Rdf:label’. Given expansion entities, an issue arises of how to model an expanded query with the expansion entities [52]. Searches with a query expanded with different values of predicates can perform differently. For example, category-based expanded queries outperform term-based expanded queries for probability-based entity search in the INEX Entity Ranking track 2007 and 2008 [52]. Entities in Linked Data have a more complex structure than entities in INEX Entity Ranking track (http://www.inex.otago.ac.nz/tracks/entity-ranking/guidelines.asp). In this section, we discuss which property achieves better precision for expansion. We have modelled six types of expanded query with the most frequently used properties of the top 1 candidate expansion entities found by the PFC, which are query+URL, query+‘RDF:type’, query+‘name’, query+‘Owl:SameAs’, query+‘RDF:label’ and query+‘subject’. We compared the six different types of expanded queries with the parameter values
Figure 10 shows the search improvement attributed to the six different properties. The URLs provide the highest precision for the 50 queries, and are proved to be the best property to expand the query in our study. Entity names and ‘Rdf:Label’ also show satisfactorily positive improvement, with a slight drawback of adding more terms than necessary, compared with the URL. Our results show that ‘Rdf:type’ and ‘subject’ are not suitable for expanding the query.

The improvements attributed to the six different properties in query expansion.
8. Discussion
There are several limitations in this study that need to be further studied:
Function of anchor entities – as the results of Section 5.3 show, the more candidate expansion entities are used, the better are the results that can be achieved by the PFC. However, more candidate entities require more importance measures. In the PFC, anchor entities are used to restrict the scope of candidate expansion entities. A good anchor entity should be capable of covering the best candidate expansion entities in a small scope of importance measuring. We defined an anchor entity as an entity containing any term of a query in its URL. It is possible that an anchor entity defined in the PFC explores bad candidate expansion entities for a query. For example, in the query #9 ‘ashley wagner’, the anchor entity ‘Dbpedia:Ashley_Tisdale’, an American actress, relates to entities that are not good for expanding ‘ashley wagner’, who is an American figure skater. A more advanced judgement of anchor entities can be achieved by checking properties that have semantic meanings of an entity, such as ‘Rdf:label’ and ‘RDF:type’. However, this raises three questions to be answered: (a) how to utilize properties to judge anchor entities with quantitative measures; (b) how to obtain all properties of entities in the returned RDF documents in a scalable time; and (c) whether the efficiency is improved with a new judgement method of anchor entities. Our future work aims improve the efficiency of the PFC with better anchor entities by answering these questions.
Role of the entity–document frequency – for the BTC 2009, the PFC shows high precision using the importance parameters with high weights for PageRank and centrality. However, the frequency computed with distributed computations is not normalized, which could potentially imbalance the three measures. Therefore, the importance of using entity–document frequency can be underestimated by the PFC, since the entity–document frequency is considered an important factor for discovering entities [53–55]. A normalized entity–document frequency could improve the search as we considered. Moreover, IDF [55], and residual IDF (RIDF) [54] can help increase the weight proportions in global importance to achieve better precision, which this study leaves as another potential improvement for the future.
Combinations of parameters for the importance measures – query shifting [17] is a difficult issue in the field of query expansion and semantic query expansion is no exception. We use different combinations of PageRank value, centrality, and entity–document frequency within our algorithm to determine the best parameters, and we are currently considering how to use a heuristic algorithm to help automatically obtain the best combination. In our future work, we will explore paths such as personalized query expansion by tracing more important link types, discussed in Section 6. We will also focus on improving search results with the help of user profiles and historical search records.
9. Conclusions
In this study, we introduced a framework that presents efficient and effective ways to discover expansion entities in Linked Data by formalizing an expanded query for keyword-based entity search. Instead of computing co-occurrences or using ontology, we trace links in local graphs to find candidate expansion entities and rank them by global and local importance measures.
The PFC explores candidate expansion entities from local graphs, which are more related to the query, instead of global corpus or ontologies. In addition, the global and local importance measures are better for ranking entities than insufficiently computing co-occurrences with the flat data structure used by keyword-based entity search engines. Our experiment demonstrates that the PFC performs better on precision than existing query expansion methods. Two important issues inherent in Linked Data are also addressed: (a) roles of link types in discovering expansions are presented; and (b) application of URL or entity name as expansions is also discussed.
Footnotes
Funding
This work was supported by the Industrial Strategic Technology Development Program (10044494, WiseKB: Big data based self-evolving knowledge base and reasoning platform) funded by the Ministry of Science, ICT & Future Planning (MSIP, Korea), and in part by Professor Overseas Research Support Enterprise of LG Yonam Cultural Foundation.
