Abstract
Although demand management has shown to be a vital tool in managing congestion, many metropolitan planning organizations (MPOs) and departments of transportation (DOTs) still pursue network modification and capacity increase as a congestion relief and a mitigation measure. The network design problem (NDP) still has, therefore, an essential and significant role in shaping and sizing urban transportation networks. The literature has traditionally treated the NDP as a bi-level mathematical programming problem or a mathematical program with equilibrium constraints (MPEC). In the bi-level optimization setting, the problem is approached as a leader-follower problem in which the lower level is a user equilibrium (UE) assignment problem as the follower, and the upper level is the network sizing problem as the leader problem. NDP has long been known as a challenging problem, and many solution algorithms have been proposed to solve it. This study proposed an efficient solution algorithm for the continuous network design problem (CNDP). The solution algorithm has been shown empirically to solve the CNDP in a shorter time using partial linearized subgradient methods. The proposed method was applied to a small network that was traditionally used to evaluate the performance of solution algorithms versus Braess’s paradox. It was then applied to the Sioux Falls network as a well-known benchmark network to compare the results with previous studies. The proposed method has been shown to run much faster than all the previous studies reviewed in this paper with minimal degradation of accuracy (0.52% lower than the best solution).
Besides travel demand management (TDM) methods, supply-oriented network development is vital to mitigate traffic congestion, particularly in developing countries. Metropolitan planning organizations (MPOs) and departments of transportation (DOTs) spend large amounts of resources on transportation network improvement projects annually. Moreover, transportation challenges have become a primary concern of residents and authorities in large cities. That is why efficient decision making is essential for transportation network sizing, design, and development projects. This problem would become crucial for even developed countries, and in some studies, such as Zhao & Zhang ( 1 ), the transportation NDP has been transformed into a transportation system reconstruction problem.
Theoretically, transportation network design can be assumed to be among the most challenging and complicated transportation problems. It is a well-known complex mathematical problem. Although network design has been widely investigated in the literature, it is still not used, at least not widely, in practice. In addition to the problem’s theoretical complexity, the solutions’ run time is another critical issue. As a result, it is challenging to implement a network design problem (NDP) in large-scale realistic size networks. Therefore, it is essential to develop reasonable methods to solve the transportation NDP.
Macroeconomic decisions, traffic management, transportation infrastructure development, and decision making in large corporations are mostly multi-level decision-making problems ( 2 ). The NDP can be formulated as a bi-level mathematical/decision-making problem, in which network managers or planners are at the upper level as the leader of the decision, while users/drivers are at the lower level and make their decisions as followers in response to the decisions of the leader. This is often referred to as the leader-follower model structure. At the upper level, the decision maker tries to optimize criteria formulated as the objective function or sometimes functions (e.g., system optimization and environmental pollution optimization) using the decision variables they have in hand (roadway/link capacities). The NDP could be defined as the problem of determining network parameters (e.g., capacity enhancement) to optimize a given transportation network under budget constraints by considering the reaction of the users to those decisions. The NDP could be continuous (CNDP), where the decision on the amount of capacity on the links are continuous variables, or discrete (DNDP), where the decision maker decides to either perform or not perform a capacity enhancement in the network (value of 1 means to build and 0 will be not to build). The mix NDP is a mixture of both cases.
The network structure is usually not changed in the CNDP, and the link capacities are assumed to be the decision variables. On the other hand, in a discrete problem, one or more roads are to be constructed or modified, and the variables are typically binary ( 3 ). NDP seeks to make optimal use of network investment to optimize the objective function subject to budgetary constraints. Numerous studies emphasized that network design is a nonlinear, non-convex bi-level mathematical problem (NP-hard) ( 4 – 6 ). Therefore, network design faces many challenges and complexities, and solving the NDP cannot guarantee finding the optimal global solution. On the other hand, solving NDP is often time-consuming, and most solution algorithms are unable to solve NDP in a reasonable amount of time. The run time increases exponentially with the network size. As such, finding a solution algorithm that solves the NDP accurately enough and in a reasonable time is essential.
This research seeks to develop a methodology to solve the CNDP more efficiently by reducing the model run time while maintaining satisfactory accuracy. The remainder of the paper is organized as follows: the next section reviews the literature; we then formulate the problem and describe the suggested solution algorithm, before discussing the results and concluding.
Literature Review
The NDP has a long history in the literature. LeBlanc and Boyce’s ( 7 ) investigation is one of the first studies that tried to solve the continuous network design using the Hooke–Jeeves and Powell methods. Marcotte ( 8 ) demonstrated that the Hooke–Jeeves and Powell method used by LeBlanc and Boyce ( 7 ) would not necessarily converge to the Pareto optimal solution. Other researchers have also proposed different solution algorithms. For instance, Suwansirikul et al. ( 9 ) introduced the equilibrium decomposed optimization approach. Peterson ( 10 ) adopted a heuristic approach and employed the cut-flow constraint rather than the conservation of flow constraint in the assignment sub-problem. Ban et al. ( 11 ) modeled the NDP with equilibrium constraints in the form of a nonlinear complementary problem. Meng et al. ( 12 ) used an appropriate approximation for the equilibrium traffic assignment problem. Billheimer and Gray ( 13 ) used a heuristic method based on network link addition and removal. Haghani and Daskin ( 14 ) proposed network aggregation to reduce the size of the network and thereby reduce the model’s run time. Moreover, dual problems of network design were employed to solve CNDPs by Balakrishnan et al. ( 15 ) and LeBlanc and Abdulaal ( 16 ). Liang et al. ( 17 ) developed a primal-dual method and exploited the Lagrangian dual to solve the transit network design problem. The dual problem was used to solve the CNDP. Tong et al. ( 18 ) decompose the NDP using Lagrangian relaxation.
Since the variables are continuous in CNDP, the gradient data of the traffic assignment problem, which is the traffic assignment problem sensitivity analysis, could be used. These methods exploit the sensitivity analysis of the user equilibrium assignment problem to solve the main problem (upper level) in their subgradient calculation. Davis ( 19 ) solved the network design using stochastic user equilibrium assignment and used sensitivity analysis to find the subgradient. Gao et al. ( 20 ) also used sensitivity analysis to solve a CNDP. As another example, Yang ( 21 ) performed a sensitivity analysis to solve an NDP with variable demand. In fact, several mathematical programming approaches could be employed to solve network design problems using sensitivity analysis. This leads to a variety of solution techniques.
Furthermore, assignment linearization methods have also been used in network design. Linearization has typically been used in continuous network design ( 22 ). Previous studies used a linear reaction for network design ( 23 ). Some other studies, like Wang et al. ( 24 ), use the reformulation–linearization technique to solve NDP. Moreover, the LeBlanc–Boyce model exploits a linearization approach as another approximation of optimal assignment rather than user equilibrium. This, however, imposes an error as a result of the use of the Cournot–Nash game rather than the Stackelberg game.
Decomposition-based techniques have been employed for both continuous and discrete network design. Lin et al. ( 25 ) used Dantzig–Wolfe decomposition to solve an NDP under dynamic traffic assignment. Dynamic traffic assignment not only increases the problem’s complexity but also seems unnecessary as the network design is a long-term problem, and the short-term dynamism of the network may not be of interest. Several studies adopted the Benders decomposition algorithm ( 26 , 27 ).
More recently, metaheuristic algorithms have also been used to solve the NDP. Zhou et al. ( 28 ) used a non-dominated sorting genetic algorithm to elucidate a CNDP. Bin et al. ( 29 ) proposed a leaf photosynthate-based method. However, these methods were more likely to be trapped in local minima without significant improvement in run time.
The review of the literature shows that different researchers haves used a variety of techniques to solve the NDP, some of which are: alternative constraints, equilibrium constraints, problem approximation, transformation into a one-level problem, network downsizing, dual problems, subgradient, sensitivity analysis, linearization, decomposition, and metaheuristic methods. As an alternative approach, Zilioniene et al. ( 30 ) focused on accelerating the lower-level assignment problem to accelerate the NDP.
Although many solution algorithms have been devised to solve the NDP, the run time is still a major issue. This paper proposes a partial linearized subgradient method to solve the CNDP. As shown here, previous efforts on linearization focused on linearizing the cost function and turning the lower-level problem into a linear or piecewise linear problem. Subgradient methods such as the one proposed by Chiou ( 31 ) use the sensitivity analysis of the UE problem. In this method, as will be discussed in the next section, at each iteration, we find the gradient of the UE problem by solving only one iteration of the UE problem at a time and using the linearized gradient information of that single step for that iteration. In other words, as in each iteration of the lower-level UE traffic assignment problem, a partially linear version of the problem is solved (similar to the well-known Frank–Wolfe algorithm); we use the gradient of that partially linearized assignment problem as the subgradient for the upper-level problem at each iteration. As a result, the NDP and the UE assignment are solved simultaneously. This is the difference between our proposed method and the previous methods.
Proposed Algorithm
As mentioned previously, CNDP can be represented as a leader-follower game where the transportation planners are the leaders, and the users/passengers that could (mostly) freely choose their path based on the leader’s decision are followers ( 32 , 33 ). It is assumed that transportation planners can influence the route choice behavior of the users but cannot force them to choose a certain path. The users make decisions based on their utilities. Thus, network design models seek to optimize the planners’ decisions by considering the interaction of such network decisions on the network users. In Table 1, all used parameters are introduced.
Parameters Used in the Proposed Method
Let
The formulation shown in Equations 1 and 2 is a mathematical problem with equilibrium constraints (MPEC). A symmetric MPEC can be rewritten as a bi-level mathematical programming problem as follows:
The formulation in Equations 3 to 7 has been used in much previous research. It simultaneously optimizes the network’s construction cost and total travel time. As mentioned previously, in this paper, we proposed a partial linearized subgradient method to solve the CNDP. The nonlinear bi-level NDP is converted into a linear bi-level problem using the subgradient of the lower-level problem at each iteration of the solution. In the linearized form, both the upper and lower-level problems have the same objective function. Thus, the problem can be solved efficiently using the subgradient as a single objective problem.
In other words,
Therefore, the minimization problem at the lower level can be written as:
where x is the link flow in the network. By eliminating the constant terms from the problem above we get:
As
As can be seen, Equation 11 is similar to the upper-level objective function at each iteration. Let
It can be concluded that:
The right side of Equation 13 is the gradient of the lower-level problem concerning capacity. This derivative can be easily calculated by analyzing the sensitivity of the now linear lower-level problem (at that iteration) to the capacity. Thus, the assumption of a constant travel time for each link gives:
It should be noted that
However, more accurate traffic assignment sensitivity analysis methods can be employed if deemed necessary (e.g., Tobin and Friesz [ 34 ] and Patriksson [ 35 ]), which will increase the run. The numerical investigation performed below will empirically show that the assumption made here is reasonable and that the additional complexity is unnecessary. The proposed algorithm to solve the CNDP is described below:
Step 0: Initialization: Select the convergence parameter ε and set the iteration counter to 0 (
Step 1: All-or-nothing assignment: Increment the iteration counter by 1 (
Step 2: Calculation of the approximate derivative of the upper-level objective function: Estimate the auxiliary capacity by solving the following problem (it is easily solved using the gradient of the travel time function):
Step 3: Line search for the traffic assignment problem: Solve the line search for the equilibrium traffic assignment problem as in the Frank–Wolfe algorithm:
Set
Step 4: Line search for the NDP: Solve the following line search problem for the upper-level problem:
Set
Step 5: Convergence control: Check whether the convergence criterion has been met. If yes, discontinue the process; if no, go to Step 1.
As shown in Figure 1, the simultaneous solution of the NDP and assignment is a characteristic of the proposed algorithm. Most previous research uses the so-called iterative assignment and design procedure, which solves the network assignment at each iteration. Instead of solving the assignment algorithm fully at each iteration of the upper level (as done in previous research), we solve one iteration of the assignment and one of the upper level at a time. This decreases the computational overhead of the CNDP. The proposed methodology uses two line search problems: one for the assignment problem and one for the NDP (based on the result of the assignment). This procedure will reduce the likelihood of falling into Braess’s paradox ( 36 ) trap by maintaining the correct structure of the leader-follower game in the NDP (the leader and follower each optimize their own objective function eventually). More specifically, the NDP is a Stackelberg game ( 37 ). Such games have a leader-follower structure, and one should solve the NDP based on the assumption that the decision maker is the leader while the users are followers and each is optimizing their own objectives without cooperation. If the NDP is structured as a Cournot–Nash game, the cooperation between the leader and follower will increase the probability of falling into the trap of Braess’s paradox. This is more likely to happen if both the leader and follower use the same objective function.

Flowchart of the continuous network design algorithm.
Results
In this section, we apply the proposed algorithm to two well-known case studies to evaluate its appropriateness and efficiency compared with previous studies. The first network is a small one in which Braess’s paradox is possible. In the second case study, the model will be applied to the Sioux Falls network for comparison.
Small Sized Network
In this small network, previously used in the research, we investigate the likelihood of Braess’s paradox, as shown in Figure 2. The objective function is as in Equation 24.
The data are adapted from the Suwansirikul et al. (
9
) implementation. Table 2 describes the network and the parameters of the volume delay function. The functional form of the volume delay function is as

Small size network.
First Network Parameters
A total of four scenarios were implemented: (I) Scenario 1, with 100 units of demand from node 1 to node 4, with a maximum capacity budget of four units; (II) Scenario 2, with 150 units of demand from node 1 to node 4, with a maximum capacity budget of eight units; (III) Scenario 3 with 200 units of demand from node 1 to node 4, with a maximum capacity budget of 16 units; and (IV) Scenario 4 with 300 units of demand from node 1 to node 4, with a maximum budget of 45 units. The proposed algorithm was applied to all four scenarios, and the results were compared with other similar studies. The results for the first scenario and the results obtained from previous studies are given in Table 3.
Comparison of the Proposed Algorithm and Some Previous Studies on Scenario 1
Note: MINOS = Mixed-Integer Nonlinear Optimization System.
As seen in Table 3, the results obtained by our proposed algorithm are similar to the ones obtained by the full enumeration of the solutions (global optimum solution). Therefore, the proposed algorithm is efficient in this small case study and will likely avoid Braess’s paradox trap. Table 4 reports the solutions obtained under all scenarios.
Comparison of the Proposed Algorithm and Some Previous Studies on all Scenarios
Note: MINOS = Mixed-Integer Nonlinear Optimization System.
According to Table 4, the proposed algorithm is comparable to previous studies. It should be noted that the MINOS method is the most accurate yet the most time-consuming technique to solve the CNDP. As can be seen, the results of the proposed method are in good agreement with the MINOS method. The results of the proposed method were obtained in a maximum of 10 iterations; the computational overhead of 10 iterations is equal to performing 10 shortest paths searches, not 10 full assignments. As mentioned, the assignment and CNDP are solved simultaneously, and each iteration of our proposed algorithm does not fully solve the equilibrium assignment problem until convergence. As such, the computational overhead of 10 iterations of our algorithm is roughly equal to one iteration of other algorithms that require the traffic assignment to be fully solved.
Medium Size Network
The well-known Sioux Falls network is used as the second numerical case study. The Sioux Falls network has been used in many CNDP studies, such as ( 38 – 43 ). It has 24 OD pairs and 76 links. Different variants of the Sioux Falls network are available. The present study adopted the variant reported by Suwansirikul et al. ( 9 ). The Sioux Falls network and candidate links are shown in Figure 3. Also, a map of Sioux Falls is shown in Figure 4. Table 5 shows the candidate projects and the capacity increase cost per unit.

Sioux Falls network and candidate links.

Sioux Falls map.
Candidate Projects and the Capacity Increase Cost per Unit
The Sioux Falls case study also has the same objective function as the first one, except for
Previous studies show that the maximum capacity budget is approximately 25 units.
As seen in Table 6, the proposed algorithm has been shown to be significantly faster than all previous methods while still getting a pretty accurate result (only 0.5% different from the best solution while being more than 1,000 times faster). Our proposed algorithm converged after 44 shortest path calculations, which is roughly equal to three fully converged iterations in other algorithms (we expect the assignment to assemble in 10–20 iterations). Figure 5 shows the convergence of the proposed method. The closest model for speed to our algorithm was Conjugate Gradient (CG) ( 41 ). While still being faster, our proposed algorithm converged to a better solution than CG.
Comparison of the Proposed Method and Some Previous Methods in the Sioux Falls Network
Note: MINOS = Mixed-Integer Nonlinear Optimization System; CG = Conjugate Gradient; IOA = Iterative optimization and assignment; GA = Genetic Algorithm; CS = Cuckoo Search; EDEMIS = Enhanced Differential Evolution algorithm based on Multiple Improvement Strategies.

Convergence of the proposed algorithm for Sioux Falls network.
Discussion
Network improvement is an important tool in mitigating congestion in transportation networks. Although numerous studies have discussed the NDP in the past several years, NDP still poses a challenging problem. This study proposes a partial linearized subgradient method to solve the CNDP. The proposed algorithm is numerically shown to reduce the model’s computational overhead while converging to a satisfying solution.
The proposed algorithm was applied to two case studies: a small network where there is a possibility of the Braess’s paradox arising, and the Sioux Falls network. As the results were shown to be promising on the small network, the algorithm was also applied to the Sioux Falls network to compare with previous studies. Our proposed algorithm solved the CNDP and converged to a reasonable solution after only 30 shortest path calculations (with an accuracy of only 0.5% less than the best solution). Assuming that 10 to 20 shortest path calculations are required to solve the traffic assignment problem on the Sioux Falls network, the proposed algorithm was able to converge to a reasonable solution with a computational overhead of roughly three fully converged traffic assignment problems. Figure 6 compares the results obtained on the Sioux Falls network. The horizontal axis shows the algorithms. The vertical axis on the right side shows the required number of assignments for the algorithm to converge, and the vertical axis on the left shows the objective function’s value. It can be seen that the proposed algorithm had the highest speed, with only 0.52% lower accuracy than that proposed by Friesz et al. ( 45 ) and 0.05% lower accuracy than Suwansirikul et al. ( 9 ). The model introduced by Friesz had the highest accuracy. However, it required many assignment iterations (i.e., 3,900 assignments). Although the proposed algorithm is an approximate method, it uses partial linearization of the lower-level problem and ignores the potential degenerate solutions; the numerical results indicated that the solutions had satisfactory performance. In addition, a review of previous studies indicates that previous methods, particularly metaheuristic algorithms, were mostly approximate and stochastic. Since the NDP is non-convex, the global optimal solution cannot be ensured. However, the proposed algorithm deterministically converges to an efficient solution in a short time.

Comparison of second network results.
Footnotes
Author Contributions
The authors confirm contribution to the paper as follows: study conception and design: Navid Kalantari, Hamid Mirzahossein, Travis Waller; data collection: Navid Kalantari, Hamid Mirzahossein, Pooyan Najafi; analysis and interpretation of results: Navid Kalantari, Pooyan Najafi, Travis Waller; draft manuscript preparation: Navid Kalantari, Hamid Mirzahossein, Pooyan Najafi, Travis Waller, Xiang Zhang. All authors reviewed the results and approved the final version of the manuscript.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Data Accessibility Statement
Some or all data, models, or code that support the findings of this study are available from the corresponding author on reasonable request.
