Abstract
In the last few decades, political parties in several Western countries have opened up the process of leadership selection to all party members. So far, research has mainly focused on the drivers of this development, taking into account both internal factors (reducing power of middle-level party elites) and external factors (increasing the party’s attractiveness). Only few studies have tested the effects of these external arguments. In this study, we investigate whether parties that select their leader inclusively (1) exhibit higher levels of trustworthiness, and are more appealing to (2) voters and (3) potential members. Based on the procedural fairness argument, we expect a positive effect of inclusive procedures. We conduct a vignette experiment with fictional parties and find that inclusive selection procedures do not strengthen citizens’ perceptions of trustworthiness. Moreover, citizens are not more willing to vote or join parties with inclusive selection procedures.
Introduction
In many established democracies, party leaders are among the most important actors in political decision-making. Evidently, their selection is a crucial decision with large implications. In the last few decades, numerous political parties have opened up the selection procedure of their leaders to all party members. While in countries such as Spain, Denmark, Norway, Austria and Romania, none or only a handful of parties use inclusive selectorates, in the UK, Israel, Belgium, Canada and Portugal, it has become common practice among almost all parties (Pilet and Cross, 2014). Although this democratization in leadership selection cannot be found in all countries, it nevertheless constitutes a trend (Cross and Katz, 2013; Pilet and Cross, 2014; Quinn, 2010; Sandri et al., 2015).
But why did these parties introduce such direct member votes? Apart from internal reasons (strengthening the position of the party leader in the party), external reasons were cited as motivation to introduce such direct member votes (Gauja, 2017; Lisi, 2010; Scarrow, 1999; Wauters, 2014). These external reasons mainly consist in the assumption that leadership elections would raise the party’s appeal to voters and (potential) members. However, surprisingly, apart from research on the effect of inclusive leadership selection procedures on the electoral performance of particular parties (Pedersen and Schumacher, 2015) and on voters’ levels of trust in parties in general (Shomer et al., 2016), the external arguments leading to the introduction of leadership elections have not been evaluated empirically. By setting up an experimental design, we are able to disentangle the effect of the principle of internal democracy from indirect, associated effects such as more media attention and more appealing leadership profiles. In this way, we can determine whether inclusive selection procedures in itself are beneficial for political parties. Rather than focussing on only one success indicator, we adopt a broad approach by including three indicators in this study. We investigate whether parties that allow party members to select their party leader (1) exhibit higher levels of trustworthiness, and are (2) more attractive to future voters and (3) potential party members. Based on the procedural fairness theory (Grimes, 2006) and on the support for more inclusive selection procedures among citizens (Close et al., 2017), we expect that inclusive leadership selection procedures raise a party’s appeal and trustworthiness. Indeed, apart from decision outcomes (and the satisfaction about them), also the nature of decision-making procedures could impact perceptions of parties’ trustworthiness and attractiveness (Carman, 2010). Rather than focussing on trust in parties in general (Shomer et al., 2016), we investigate whether individual parties benefit from organizing inclusive leadership contests. The central research question of this article is therefore threefold: Do inclusive leadership selection methods (1) lead to higher levels of trust in parties that use them? And do they make these parties more attractive to (2) voters and (3) potential members? To answer these questions, we designed a vignette experiment with fictional parties that allows us to control for several intervening variables. We conducted this survey experiment among Flemish citizens in January and February 2019.
Our study shows that citizens who were exposed to fictional parties with an inclusive selection procedure are not more likely to trust or vote for these parties than citizens who were presented with an exclusive selection procedure. Also with respect to joining a political party, no difference was found between citizens who were exposed to a party with an inclusive selectorate and citizens who evaluated the party profile with the exclusive selectorate. This finding holds both for parties with a rightist ideological profile and for parties with leftist characteristics (which were both separately tested). We hence find that opening up the selection procedure does not seem to pay off directly for parties: neither in terms of perceived trustworthiness or higher vote share nor in terms of raising party membership.
This article is structured as follows. First, we review the literature on the concept and causes of party leadership elections. Next, we highlight the few studies that investigated whether democratizing leadership elections has produced any external effects. Based on the procedural fairness theory, we then argue that it is likely that more inclusive selectorates result in higher levels of trust in political parties and in an increased propensity to vote for or to join these parties. After setting out the methodology, we present the results of our vignette experiment, and we end with a discussion of the implications of our findings.
Reasons to Introduce Inclusive Procedures for Party Leadership Selection
Party leaders can be selected in various ways. We focus here on one of the four dimensions initially developed by Rahat and Hazan (2001) to study candidate selection methods, that is, the selectorate. 1 The selectorate can be defined as the body that selects the party leader. Selectorates differ in the degree of inclusiveness, which can be measured by looking at the relative size of the group of actors responsible for the selection of the party leader. In order to grasp this variety, Kenig (2009) developed a continuum on which leadership selection methods are classified according to their degree of inclusiveness. On the exclusive extreme of the continuum, a small elite group decides who will become the party leader, while on the inclusive extreme all members (or even all voters) are allowed to make this decision (see Figure 1).

Inclusiveness of Leadership Selection Rules (Kenig, 2009).
In the past few years, many parties have moved towards more inclusive methods of leadership selection (Cross and Blais, 2012; Pilet and Cross, 2014; Sandri et al., 2015). In particular, direct member votes to select the party leader are nowadays held in several countries including Belgium, Canada, Israel, the UK and Portugal. They correspond to what Poguntke et al. (2016) call ‘plebiscitary’ forms of intra-party democracy, in which (unlike assembly-based forms of intra-party democracy) the stages of debate and decision-making are separated and in which party members decide via a secret ballot.
In this article, we focus on whether parties benefit from using a more inclusive selectorate for leadership selection. More specifically, we compare parties that allow all members (fourth rectangle in Figure 1) to select the party leader with parties that restrict this choice to a small group, in this case, the party executive (first rectangle). We did not choose for the two extremes on the continuum (respectively, one person, and all voters) as they do not occur very often, and in Flanders (the Dutch speaking part of Belgium) not at all, which would render the experiment hypothetical compromising the ecological validity of our study.
Leadership selection procedures and changes therein have attracted considerable scholarly attention in recent years (Chiru et al., 2015; Cross and Blais, 2012; Cross and Katz, 2013; Cross and Pilet, 2015; Pilet and Cross, 2014; Rahat et al., 2016; Sandri et al., 2015). A first strand of research has focussed on the processes leading to the introduction of changes in the selectorate. Some scholars provide qualitative evidence about the introduction of party primaries in one particular party or country (e.g. Denham, 2009; Lisi, 2010; Quinn, 2010). Others conducted cross-country analyses, such as Cross and Blais (2012) who detect decision-makers and stimuli for the adoption of direct member votes in a large number of parties in Westminster systems (the UK, Ireland, Australia, New Zealand and Canada), or try to infer a general pattern from the analysis of parties in one country (Gauja, 2017; Wauters, 2014). All these studies show that changes in leadership selection methods do not just happen, but are, as any other party change, produced by a combination of exogenous factors (i.e. stimuli that provide a reason for change) and endogenous factors (i.e. a coalition of support within the party that makes change possible) (Harmel and Janda, 1994; Panebianco, 1988). In this study, we focus on the stimuli that provide a reason for change. These (exogenous) stimuli could either be external or internal.
External factors confront parties with their weaknesses and induce party elites to change the leadership selection procedure. These stimuli include among others membership decline, electoral defeat and losing government participation (Chiru et al., 2015; Cross and Blais, 2012; Pilet and Cross, 2014). Parties react to these events by introducing organizational changes in order to regain attractiveness among citizens. Democratizing leadership selection procedures is then part of a broader strategic plan aimed at improving the performance and the image of a party (Chiru et al., 2015; Scarrow, 1999; Wauters, 2014). In this context, the introduction of an inclusive leadership selectorate is supposed to bring the party into the limelight and is often accompanied by a broader media campaign. Scarrow (1999) for instance refers to CDU and SPD, two mainstream parties in Germany that spurred on by a combination of declining party membership and electoral defeats, attempted to turn the tide in the 1990s by giving their members the opportunity to select the party leader. Simultaneously, factors such as electoral defeat and ending up in the opposition also bring about in general a shift in the internal balance of power (i.e. the endogenous factors referred to above), making change in a party possible.
Whether more inclusive leadership contests indeed lead to an increased attractiveness of the party is, however, an open question that will be tackled by this study. In Scarrow’s example, neither the SPD nor CDU has received much electoral credit for introducing these reforms: their combined vote share continued to fall in the 1990s.
Internal factors point to other sorts of motivation for the introduction of leadership elections. More in particular, these factors refer to a situation in which the party elite itself takes the initiative to introduce inclusive leadership selection methods in order to strengthen their own power. By deducing power from the middle-level elites (which have much power in assembly-based forms of intra-party democracy) and transferring it to the more docile rank-and-file members, party elites get a better grip on who will be elected (Katz and Mair, 1995; Wauters, 2014). In this case, the leadership selection reform aims to reduce the power of middle-level elites in the party and to strengthen the position of the party leader. We will not further investigate these internal factors in this article, as we focus first and foremost on citizens’ reactions, and not on those of party members or party elites.
Consequences of Inclusive Leadership Contests
Another main area of research on leadership selection processes is dedicated to the analysis of their effects. Broadly speaking, five types of effects (Rahat and Hazan, 2001) can be distinguished (which have all been studied recently): participation including the type of participants and turnout rates (Seddone and Venturino, 2013; Wauters, 2015), competitiveness (Kenig, 2009), responsiveness (Lehrer, 2012), representation, in particular the presence of women party leaders (O’Brien, 2015; Wauters and Pilet, 2015), and performance. In this article, we focus on the last type of effects, that is, the effect of leadership selection on performance.
Similar to the reasons to introduce party leadership elections, two kind of indicators of performance can be distinguished: internal and external performance indicators. As for the internal indicator, the basic idea is that more inclusive selection procedures strengthen the legitimacy of the party leader in his/her party. This presumed increase in legitimacy has been evaluated by studying the length of time party leaders retain their position (Andrews and Jackman, 2008; Ennser-Jedenastik and Schumacher, 2015). This internal aspect, however, will not be further investigated in this study.
By focusing on the external aspect (i.e. the party’s attractiveness to the outside world), we scrutinize the relationship between leadership selection methods and external performance. As argued above, opening up the selectorate for party leadership is believed to be a panacea for parties in crisis, but the question arises whether leadership elections are really able to bring about the desired effects: Do voters consider parties that organize an inclusive leadership contest as more trustworthy? Does the inclusive selection of party leaders pay off in terms of votes for the party and are these parties able to attract more (and new) members? While these effects are often anticipated by the party elite and academics alike (Cross and Blais, 2012; Scarrow, 1999; Wauters, 2014; for a more sceptical perspective, however: see Katz, 2013), they have rarely been investigated systematically. Two studies have made an attempt to evaluate these questions empirically, but, as we will show, some aspects remain understudied. Interestingly, the two studies present different arguments why inclusive selection procedures should boost political parties’ appeal.
The first argument is presented in a study by Pedersen and Schumacher (2015) who investigate the effects of leadership selection on electoral performance. Building on the literature about leadership effects in parliamentary elections (Aarts et al., 2013; Garzia, 2012), they test whether the mode of selection of the party leader has an impact on the electoral performance of a party. They make a distinction between short-term effects (immediately after the leadership change, measured by a party’s score in opinion polls) and long-term effects (the first elections after the leadership change). While their main focus is on leadership renewal and how new party leaders come into power, 2 two of their arguments to expect a positive effect are also relevant for our case.
First, media attention tends to be larger if the selectorate is more inclusive because the selection process is more visible for the public. This higher visibility is obtained because it generally takes longer to select a party leader, and because competition tends to be higher which is interesting for media using a conflict frame (Pedersen and Schumacher, 2015). A higher media attention can then potentially result, in turn, in more electoral support, although there are also some risks involved (such as negative campaigning by contenders leading to negative media attention and a decrease in support).
Second, the authors theorize that more inclusive selection procedures result in a better electoral performance because more inclusive selectorates will select ‘better’ leaders. Since rank and file members do not differ enormously from voters in terms of opinions and socio-demographic characteristics, it is more likely that the leaders they select will be more in line with voters’ demands (Pedersen and Schumacher, 2015). A similar reasoning was made by Ramiro (2016) about candidate selection in the Spanish centre-left party PSOE. He found in his empirical analysis a positive link between inclusive procedures and electoral performance.
The results of Pedersen and Schumacher’s empirical analyses, however, show that parties only benefit from more inclusive selectorates in the short term with higher scores in opinion polls, but not in real elections later on. Once media attention has gone, also the effect of the new leader and how (s)he was selected fades away quickly.
Although interesting, this study does not test directly the effect of leadership selection methods itself. It is not about the process of leadership elections, but about its outcomes (more media attention, more performant leaders) and how these influence electoral performance. Moreover, by focussing on new party leaders, incumbent party leaders seeking re-election are excluded, even when they are selected by inclusive methods. In addition, also the kind of party leader (and the performance of other parties and their leaders) might influence the outcome of the analysis. By using an experimental design, we try to overcome that these intermediary factors confound the results.
Another argument why inclusive selectorates should yield positive external effects is presented in the study of Shomer et al. (2016). While these authors focus on candidate selection methods, their findings can easily be translated to leadership selection processes as well. The external effect they analyse is citizens’ level of trust in political parties (another element parties are struggling with). They find that more inclusive 3 selectorates result in higher levels of trust in political parties among citizens. The main argument put forward to support these results is procedural fairness. This concept denotes that citizens who could have a voice in a decision-making process, will be satisfied with the process and the political system (even if they do not obtain their preferred outcome). Procedural fairness is argued to trump a potential negative effect that might result from intra-party conflict associated with more inclusive selection mechanisms. While this represents an interesting study, it has to be noted that the authors focus on trust in parties in general, and that they do not analyse whether one particular party that is using inclusive leadership methods benefits (more) from higher trust levels (as trust in parties in general is measured). Moreover, the causal mechanism might be reverse: citizens with higher levels of trust in political parties are more likely to join parties that have inclusive candidate selection methods.
Drawing on these studies and inspired by the procedural fairness argument (Grimes, 2006; Marien and Kern, 2018), we theorize that inclusive leadership contests are perceived as more fair (than exclusive ones), and therefore should lead to higher levels of trustworthiness and attractiveness. We base our argument on the assumption originating from the procedural fairness theory (Fehr and Schmidt, 1999; Tyler, 2011) that citizens value fair selection procedures. The procedural fairness theory presumes that citizens do not only care about the outcome of decisions but also about how these decisions were made. The core idea is that citizens perceive decision-making procedures as more fair when they were involved in the process. It is argued that this positive perception can even mitigate negative outcome effects (i.e. the effect of having obtained an unfavourable decision) (e.g. Grimes, 2006; Tyler, 2011). We argue that, as opposed to elite arrangements behind closed doors, leadership elections among party members appear rather open and transparent and hence as comparatively fair, which will increase trustworthiness and attractiveness.
In order to apply the procedural fairness argument to the context of leadership contests, we need to assume that citizens perceive more inclusive selection procedures as fair, although participation in leadership contests is still restricted to party members (in most parties and in our experimental design here). We have two reasons for the plausibility of this assumption. First, citizens tend to perceive political elites as detached from the rest of the population (Krouwel and Abts, 2007) and they should consequently prefer ‘ordinary’ party members to take crucial decisions over more exclusive actors. Second, this reasoning is supported by empirical research that demonstrates that large parts 4 of the electorate prefer more inclusive selection procedures that involve either party members or even all voters (Close et al., 2017). Based on this reasoning, we argue that citizens should perceive political parties with inclusive leadership as more attractive than parties in which the party elite decides upon leadership. We furthermore theorize that this stronger appeal should not only be reflected in higher levels of perceived trustworthiness of these parties but also translate into a higher propensity to (1) vote for such a party and to (2) become a member of such a party. Our hypotheses hence read as follows:
H1: Citizens perceive political parties with inclusive leadership selection procedures as more trustworthy than parties in which party elites decide upon leadership.
H2: Citizens are more willing to vote for political parties with inclusive leadership selection procedures than for parties in which party elites decide upon leadership.
H3: Citizens are more willing to become a member of political parties with inclusive leadership selection procedures than of parties in which party elites decide upon leadership.
While we argue that there is a positive effect of inclusive leadership selection procedures on the parties’ perceived trustworthiness, the willingness to vote for the party as well as the willingness to join the party, we expect that trustworthiness is more strongly affected than the willingness to vote for or join the party. This argument is based on the reasoning that attitudes change more readily than behaviour (Gershuny, 2001) and the claim that political participation is determined by positive attitudes (predispositions) towards politics, such as political interest, efficacy and trust (Ajzen and Fishbein, 1977). We furthermore expect the effect to be smallest for becoming a party member because, as compared to simply voting for a party, party membership requires a formal, long-term engagement – something that post-materialist citizens increasingly refrain to do, as they prefer more individualized forms of engagement in politics (Inglehart, 1997).
The argument that fair procedures should enhance a political party’s trustworthiness and attractiveness is expected to hold for all citizens. However, it is possible that the type of selection procedure matters only for specific types of citizens, namely those that are ideologically close to the party. Citizens whose policy preferences are not or only marginally reflected by a specific political party, might not consider the party as trustworthy or attractive, independent on how they select their leader. This reasoning is backed by the finding that ideological considerations play a major role when evaluating political parties (Van der Brug et al., 2000; Van der Eijk et al., 2005). In fact, as Van der Brug (2004: 225) shows ‘ [. . .] ideological proximity is the most important determinant of voting behaviour’. A similar line of reasoning might hold for citizens who are characterized by low levels of political interest. To those citizens, parties might be untrustworthy and unattractive independent of the inclusiveness of the leadership selection process. In our study, we will account for this possibility.
To test the three hypotheses, we designed a vignette experiment and tested it among Flemish citizens. In the following section, we elaborate on the design of our experiment.
Methodology
The experiment 5 was conducted online among Flemish citizens whom we drew from iVOX’s Internet-based access panel. With more than 150,000 potential respondents, iVOX’ panel represents the largest online panel in Flanders (one of the major regions in Belgium). In order to obtain respondents that are as representative of the Flemish population as possible, we set quota on gender and age (interlocked) and on the level of education. The questionnaire started with a description of a fictitious party followed by questions about the trustworthiness of this party, respondents’ willingness to vote for this party and their wiliness to join the party. Between 15 January and 22 February 2019, 2338 citizens completed this questionnaire.
Almost all Belgian parties (except for the radical right VB and the radical left PVDA-PTB) have evolved from an assembly-based system in which party delegates selected the party leader to a plebiscitary system in which all members are allowed to vote (Pilet and Wauters, 2014). Initially after WW II, party leaders were selected by party congresses that were composed of delegates of the regional (or even local) sections of the party. Rank and file members at the regional or local level selected delegates to represent them on a national party conference, which decided on the party leader. This procedure was gradually democratized especially in the course of the 1990s (Pilet and Wauters, 2014) and now, in almost all parties, party members select the party leader in direct elections. It comes then as no surprise that in cross-national perspective, Belgian parties score high on the plebiscitary intra-party democracy index developed by Poguntke et al. (2016). Belgium provides thus a specific context as, in reality, almost all parties use a direct member vote to select their party leader. This means that using an inclusive selectorate does not allow parties anymore to really distinguish themselves from others. But we argue that the opposite is also true: using a rather exclusive way of selecting the party leader should attract the attention in such a context, and could have a negative impact. In that sense, we are confident that our research design is able to capture the effect of using an inclusive or exclusive method of leadership selection.
We opted for a between-subject experimental design. The two different selectorates deciding on leadership selection (party executive board vs all party members) forms the between-factor. However, we provided two party profiles for each condition: one party profile with rather leftist ideological positions and one rather rightist party profile. This combination led to four different conditions (rightist and closed selectorate, rightist and open selectorate, leftist and closed selectorate, leftist and open selectorate) that were randomly assigned to participants. 6 As Table A.1 in Appendix 1 shows, participants clearly positioned the two party profiles differently, positioning the party with the rightist profile on the right side of the ideological spectrum, and the party with the leftist characteristics on the left side, which was exactly our goal.
The use of two ideologically different parties functions as a robustness check, as we expect our hypotheses to hold for both ideological profiles. By using hypothetical parties, we eliminate to some extent the possibility that personal preferences or attitudes about the contemporary public debate influence participants’ opinion. It also offers the opportunity to restrict party information and to control for moderating variables (see also Campbell and Cowley, 2014; Devroe and Wauters, 2018). Here, in particular, this approach allows to exclude the impact of media effects and of the quality of the elected party leader (Pedersen and Schumacher, 2015) on the consequences of the selection method. Conducting the survey online and anonymously offers an accessible and affordable way of data collection while reducing social desirability bias which could arise when respondents are faced with an interviewer.
Each party was introduced via a short fact sheet (see Table A.3 in Appendix 1), which contained the number of party members (the same for all parties), the mode of selection of the party leader (either by the party executive board or by all party members) and stances of the party on four policy issues (either a consistent leftist profile including taking care of life-work balance, stimulating ecological agriculture, introducing tax reductions for low incomes and stimulating prevention in criminal policy, or a consistent rightist profile including stimulating entrepreneurship, activating and controlling the unemployed, investigating the feasibility of new environmental rules before introducing them and more powers for police forces). The second element (i.e. the mode of leadership selection) represents the treatment and central focus of this study. We opted for two actors that clearly differ from each other in terms of inclusiveness of the selectorate (Rahat and Hazan, 2001): while the party executive board is a rather exclusive selectorate, party members are at the more inclusive side of this continuum. At the same time, we did not pick the most inclusive form of selectorate, selection by all voters, because this option would not be realistic in the Belgian context.
After presenting each party profile, respondents were asked to position themselves on three 11-point scales referring, respectively, to the level of trust they had in that party (from 0 = very low to 10 = complete trust), the probability to vote for this party (from 0 = highly unlikely to 10 = highly likely) and the probability to become member of that party (again from 0 = highly unlikely to 10 = highly likely). These three variables represent the dependent variables of our analysis. Furthermore, we asked them to place the presented parties on an ideological left–right scale, ranging from 0 = left to 10 = right.
Next, by asking who selected the party leader, we included a manipulation check, which allows us to test whether respondents have read the party profile with enough attention. We also included some covariates (respondents’ level of political interest, trust in the federal government and self-placement on an ideological left–right scale) and socio-demographics (sex, age, level of education, hometown).
Results
In a first step, we look at the distribution of our dependent variables. As Table 1 shows, the average trust score for the four fictitious parties is 6.275, which is a bit higher than the average level of Belgian citizens. 7 Regarding the fictitious parties’ appeal, it shows that respondents are more reluctant concerning their probability to join any of the four parties (average of 2.315) as compared to voting for these parties (average of 5.652). But again, this is little surprising given that becoming a party member is a lot more demanding (in terms of time and effort) than voting for a party.
Distribution of Dependent Variables Among Participants.
In a second step, we tackle our hypotheses by distinguishing between those who received the vignette with the inclusive selection procedure (i.e. party leader selected by all party members) and those who received the vignette with the exclusive selection procedure (i.e. party leader selected the party executive board). We distinguish between leftist and rightist parties.
First, we focus on respondents’ evaluation of the fictitious rightist parties. We rely on independent samples t-tests to compare respondents’ evaluation of parties with inclusive and exclusive leadership selection. Concerning the levels of trust in rightist parties there was no significant difference between the respondents who received the inclusive condition (M = 6.3, standard deviation (SD) = 1.9) and respondents who evaluated the exclusive condition (M = 6.2, SD = 2.0). Also regarding their willingness to vote for a rightist party, respondents who received the inclusive condition (M = 5.6, SD = 2.5) did not differ significantly from respondents who received the exclusive condition (M = 5.5, SD = 2.5). Finally, we compared their self-declared willingness to become a member of the rightist party that they evaluated. Again, in contrast to our hypothesis, no significant difference was found between respondents who received the vignette with the more inclusive process (M = 2.3, SD = 2.5) and respondents who received the party description with the exclusive selection process (M = 2.2, SD = 2.5). This analysis of selection procedures in parties with a rightist profile hence does not support any of our three hypotheses.
The analysis of inclusive versus exclusive leadership selection procedures among leftist parties yields similar results. When evaluating the trustworthiness of leftist parties, the participants of our experiment were, in contrast to our hypothesis, not significantly more positive about parties with inclusive procedures (M = 6.3, SD = 1.5) as compared to parties in which the executive board selects the party leader (M = 6.3, SD = 1.6). Also, just as with rightist parties, the selection process does not appear to affect the electoral fortune of the leftist parties, as we find no significant difference between the scores for the party with the inclusive procedure (M = 5.7, SD = 2.1) and the party with the exclusive selection procedures (M = 5.8, SD = 2.1). Finally, also when studying leftist parties, no evidence is found to support H3, because also among leftists parties no difference was found concerning the self-indicated willingness to join the party. Participants’ willingness to join the party did not differ between those who were exposed to the inclusive condition (M = 2.3, SD = 2.4) from those who received the exclusive version of the vignette (M = 2.4, SD = 2.5). Consequently, based on this analysis, we cannot support any of our three hypotheses. These results hold for both types of party profiles.
The analysis reported in Table 2 represents the intent-to-treat analysis (ITT), as it was conducted on the basis of all participants to whom we had successfully delivered the treatment (i.e. who were confronted with one of the four party profiles). However, based on our manipulation check question, we know that about 35% of the respondents did not take the treatment (or at least were not able to recall who selected the party leader in the party they just read about). We therefore repeated our analysis, excluding those respondents who failed to answer this question correctly (Table 3). 8
Comparison of Trustworthiness, Willingness to Vote for and Become a Member of a Party.
Differences are tested with independent sample t-tests. N in parentheses.
p < 0.001, **p < 0.01, *p < 0.05.
Comparison of Trustworthiness, Willingness to Vote for and Become a Member of a Party, Only Among Respondents Who Took the Treatment.
We only consider participants who answered the manipulation check correctly. These were 1530 of the 2338 respondents. Differences are tested with independent sample t-tests. N in parentheses.
p < 0.001, **p < 0.01, *p < 0.05.
As Table 3 shows, also when excluding respondents who did not take the treatment, none of our hypotheses can be supported. Apparently, opening up the leadership selection procedure does not pay off – neither in terms of trustworthiness evaluations nor in terms of appeal to voters and potential members.
Whereas this result seems to hold for respondents in general (independent of whether they passed the manipulation check or not), it is still possible that the type of leadership selection does matter to certain types of citizens. In order to test for this possibility, we ran some additional analyses and tested whether the type of leadership selection matters to respondents (1) who are ideologically close to the presented party and (2) who have a high level of political interest. The analysis investigating the effect of leadership selection conditioned by ideological distance is presented in Table 4 for the rightist party profile and in Table 5 for the leftist party profile. 9 The analysis for potentially conditioning effect of political interest can be found in the appendix (Table A.6).
The Effect of Intra-Party Democracy on Trustworthiness and Appeal of the Rightist Party.
Unstandardized coefficients with standard errors in parentheses.
p < 0.05, **p < 0.01, ***p < 0.001.
The Effect of Intra-Party Democracy on Trustworthiness and Appeal of the Leftist Party.
Unstandardized coefficients with standard errors in parentheses.
p < 0.05, **p < 0.01, ***p < 0.001.
Both Tables 4 and 5 show that although the ideological distance to the party affects the perception of trustworthiness and the willingness to vote for and join the presented party negatively in all models, the interaction between ideological distance and leadership selection is not significant in any model. We can hence conclude that the existence of an open leadership selection does not affect respondents’ perception of trustworthiness and appeal – not even when citizens are ideologically close to the party, nor when they are highly interested in politics as Table A.6 in Appendix 1 shows.
Conclusion and Discussion
In the past few decades, a considerable number of political parties have opened up their leadership selection process by giving rank and file members a say through a direct member vote. Internal factors (strengthening leaders’ power within the party) and external factors (making the party more attractive) have been detected as drivers for this organizational change.
Rather remarkably, only a few systematic tests have been conducted about whether the intended effects are also realized. We have undertaken this endeavour by setting up an experimental design among citizens. We focus on direct external effects, and more in particular on whether inclusive selection procedures makes a party more trustworthy and more attractive to voters and potential members. There are several reasons to assume such an effect: apart from indirect effects such as more media attention, there is the fact that party elites introducing more inclusive selectorates believe that these effects will come about, and the theoretical argument of ‘procedural fairness’. Inclusive procedures to take decisions (such as a direct member vote) are believed to increase the sense of fairness among people, and will therefore presumably (regardless of the outcome) increase the level of trust people have in this procedure and organization and will increase its attractiveness.
The results of our empirical analysis, however, clearly show that there is no effect of selecting the party leader by all party members. Neither trustworthiness nor attractiveness towards voters and potential members are higher in a party with an inclusive selectorate (compared to a party with an exclusive selectorate). This lack of an effect remains even if we only compare voters that agree with a party’s views. This means that electing a party leader in a direct member vote has only an indirect short-term effect: as Pedersen and Schumacher (2015) have demonstrated, parties electing their leader in a direct member vote experience a temporary rise in their opinion poll scores. This temporary effect could be explained by the indirect effect of media attention around this direct member vote and the new face of the party leader that is launched, rather than by the inclusive selection procedure itself. Our survey experiment allowed to disentangle direct and indirect effects, and we clearly demonstrate that there is no direct effect of inclusive procedures on any of the three success indicators we included (trustworthiness, attractiveness towards voters and potential members).
Although our (non-)findings are very robust, we have to bring in four nuances to the debate.
First, the procedural fairness argument pertains first and foremost to those who are involved themselves in the procedure, in this case, party members, while we conducted research among citizens. We have, however, argued that also for people not directly involved in the selection procedure, the selection method can be relevant. Previous research indeed demonstrated that a large part of the voters prefer inclusive selection procedures in political parties and that they are likely to have more trust in rank and file members who are more similar to them than party elites. Although we did not find any effect among voters, we cannot completely rule out that there is an effect among party members, who are directly involved in the leadership selection. In that case, inclusive selection procedures might not lead to the influx of new members, but to keeping existing members on board. More specific research on party members should check whether this is indeed the case.
Second, the focus of this study is on Belgium, which is an extraordinary case in cross-country perspective as (almost) all parties there use a direct member vote to select their party leader. One could argue that due to the pervasiveness of this procedure, citizens are used to it and parties cannot make a difference anymore when organizing inclusive leadership contests. This is of course true, but one could also reverse the argument by stating that in such a context, a party that is using an exclusive selectorate attracts the attention and risks to be punished by voters. This, however, is something we could not observe in our study.
Third, the underlying assumption in our reasoning to expect a positive effect of inclusive leadership selection methods is that voters perceive this procedure as more ‘fair’ than more exclusive methods. We do not test this assumption in this study, however. Moreover, the specific Belgian context casts some doubts about the plausibility of this assumption. Apart from the argument that (almost) all parties use inclusive methods (see above) rendering the fairness of this kind of methods less noticeable, there is also the fact that in almost half of all Belgian inclusive leadership contests, only one candidate takes part (Pilet and Wauters, 2014). Party members can only approve or disapprove this single candidate, which reduces the impact members can have and also potentially diminishes the sense of fairness associated with this method. These two factors could be an explanation for the lack of effects that we find in this study.
Fourth, we have shown that our sample seems to have more trust in politics than the average Belgian citizen. While this arguably limits the ecological validity of our experiment, it should not affect the internal validity of the relationship between intra-party democracy and citizens’ perceptions of trustworthiness and attractiveness of the party.
Despite these nuances, we can state that there are no direct effects of inclusive leadership selection procedures on trustworthiness and attractiveness of the party. The question is then why parties continue to use them. At least at the time of the introduction of these direct member votes, party elites were (in their discourse) convinced that this would positively affect the image of the party. Either these party elite members ware naïve or badly informed, or their discourse differed from their real intentions, namely increasing their own influence in the party to the detriment of middle-level elites (Schumacher and Giger, 2018; Wauters, 2014). In the latter case, internal and indirect factors are more important than external ones for the introduction and continuation of inclusive selectorates. Another explanation might be that party leaders aim for effects originating from changes in selection methods (which was not tested here as we analysed two specific, but fictitious parties at only one point in time). It might be that positive effects occur only once (when changes are introduced). Afterwards, these procedures (such as inclusive leadership selection methods) remain in function, as once they are launched, it is difficult to remove them again.
Footnotes
Appendix 1
The Effect of Intra-Party Democracy on Trustworthiness and Appeal.
| Rightist party profile | Leftist party profile | |||||
|---|---|---|---|---|---|---|
| Trust | Vote | Join | Trust | Vote | Join | |
| I | II | III | IV | V | VI | |
| Open elections | 0.076 | 0.107 | 0.210 | 0.083 | 0.317 | 0.199 |
| (0.300) | (0.376) | (0.415) | (0.263) | (0.352) | (0.428) | |
| Level of education | −0.099** | −0.079 | −0.205*** | 0.002 | −0.015 | −0.119** |
| (0.032) | (0.041) | (0.045) | (0.027) | (0.037) | (0.045) | |
| Political interest | 0.051 | 0.038 | 0.212*** | 0.072* | 0.083 | 0.226*** |
| (0.035) | (0.044) | (0.048) | (0.032) | (0.043) | (0.052) | |
| Ideological distance | −0.476*** | −0.695*** | −0.397*** | −0.214*** | −0.411*** | −0.276*** |
| (0.030) | (0.038) | (0.042) | (0.028) | (0.037) | (0.045) | |
| Political interest* | 0.002 | −0.008 | −0.006 | −0.028 | −0.052 | −0.044 |
| Open election | (0.046) | (0.058) | (0.064) | (0.041) | (0.055) | (0.067) |
| Intercept | 7.779*** | 7.396*** | 3.501*** | 6.375*** | 6.234*** | 2.700*** |
| (0.361) | (0.453) | (0.499) | (0.305) | (0.408) | (0.495) | |
| N | 740 | 740 | 740 | 780 | 780 | 780 |
| adj. R2 | 0.258 | 0.314 | 0.156 | 0.070 | 0.134 | 0.081 |
Unstandardized coefficients with standard errors in parentheses.
p < 0.05, **p < 0.01, ***p < 0.001.
Acknowledgements
Earlier versions of this article were presented at the ECPR General Conference in Hamburg (22–25 August 2018) and at an internal research seminar of our research group at Ghent University. The authors thank all participants for their input, and especially also Robin Devroe, Sigrid Van Trappen and Hannah Werner for feedback on our experimental design.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship and/or publication of this article.
