Abstract
Navigation of multiple robots is a challenging task, particularly for many robots, since individual gains may more often than not adversely affect global gain. This paper investigates the problem of multiple robots moving towards individual goals within a common workspace without colliding amongst themselves. Two solutions for coordination namely Fuzzy Logic Controller (FLC) and Genetic Algorithm based FLC (GA-FLC) have been employed and the efficacy of cooperation strategies have been compared with their non-cooperative counterparts as well as with the fundamental potential field method (PFM). Proposed coordination schemes are verified through simulations. A total of 100 scenarios are considered varying the number of robots (8, 12, 16 and 20). The obtained results show the efficacy of the proposed schemes.
Introduction
Motion coordination among multiple mobile robots is a challenging proposition, particularly when negotiating on a common workplace. Higher the number of robots more tedious is their motion planning. A wide variety of taxonomies exist in robot motion planning parlance that accounts for diverse environmental conditions, the existence of other robotic entities in the workspace, nature of any obstacles in the workspace, local and global criteria for path planning and so on. A brief account can be obtained from [1]. A particular mobile robot navigates through static or dynamic obstacles in steps with determining its next position towards the goal by satisfying a variety of conditions such as path, time, energy-optimality etc. This utilizes the local path planning mechanism. The primary objective is to find collision-free path.
In this paper, a dynamic path planning is addressed with multiple mobile robots sharing a common workspace. These robots are characterized by their respective source and destination points within the workspace and respective velocities. Each robot is capable of accelerating/decelerating to avoid collision with other robots and a fixed time interval for periodic updations in position, velocity, and strategy. In that sense, the problem addressed in this paper falls under dynamic motion planning (DMP) category and a wide variety of fuzzy approaches have been employed, particularly to emphasize on user-defined rules setting for collision-free paths [2–4]. Generally, such approaches alleviate computational burden as well. Besides, a number of sophisticated genetic algorithm based schemes have also been studied that not only ensures collision-free paths but also improves travel time for recommended paths [5, 16]. Genetic algorithms [8, 9] have also been employed for deducing optimal/near-optimal by means of user-defined scenarios. Some such GA-Fuzzy schemes [11] demonstrated inconclusive results. Previously researchers have used traditional methods like a potential field, reinforcement learning etc. But soft computing and evolutionary algorithm [12, 17] based approaches have been more popular among the researchers due to their optimality in nature.
Considering motion planning problem, robots may encounter coordination problems caused by moving robots that may pose as obstacles for some others. While smooth coordination between human beings is still a challenging issue till date, development of fruitful coordination between two non-living things is surely a herculean task. A number of researchers attempted to solve the coordination problem [4, 16]. At the time of navigation process, lots of events may occur. Figure 1 depicts a sequence diagram for a multi-robot motion planning, each robot marked as an agent that all the agents want to achieve the same objective. A particular agent senses and receives signal to get the other agents’ information depending upon the environment. As multiple agents perform a common objective with the same velocity, so they may collide with each other. These activities have also been depicted in Fig. 1. To avoid collisions, different strategies need to be followed by the agents. Different rule sets had been compiled for varying the number of movable obstacles, generally as offline schemes. However, schemes that could be used by online robots, irrespective of the number of robots had been tried by some data-driven learning algorithms [7, 15] by means of FLCs.

Sequence diagram depicting common navigation steps for different robots (agents).
In this paper coordination based navigation of three different motion planning approaches have been developed. In the first developed approach PFM based navigation has been applied. On the second approach, a Mamdani-type FLC with manually designed rules is made. Whereas in Approach 3, a GA evolved FLC is considered. Since competition between agents is not good, so a strategic approach has developed to solve the coordination problem among agents. A hundred numbers of scenarios have been taken to compare the performance between coordination and non-coordination schemes. It has experimented that coordination technique is more acceptable than non-coordination approaches concerning coordinated multi-robot navigation.
This problem is worked out to obtain the next step for a particular robot from its present location in the environment avoiding collisions with other robots [8, 9]. The contemplated ideology and hypothesis are discussed below.
Postulations
Starting and Goal location of all the robots are known in the environment. For a time-step, a particular robot can perform any action within its motion plan. All navigating robots perform their individual action until they reach in their individual target positions by taking some time-steps.
The ensuing principles implemented takes care of the aforesaid viewpoints. Robots are heading towards the goal. To avoid collision with the other robots, they might not move along the goal directions. They might need to take a turn either left or right. This angular deviation is calculated using Eqn No. (8).
Let us consider that the starting position of the nthrobot at time “t” is

Future and present position of the nth robot.
Initially, the robot (Robot 1) starts its journey from the location (

Navigation of three robots to identify the critical robot.
By putting the value of
Potential field method (PFM) is one of the computationally efficient methods for solving motion planning problems. Functions of attractive and repulsive potentials are considered as follows.
Here, all the notations are seldom defined following [8, 10]. The resultant force is then obtained as follows:
In order to avoid collisions, a planning robot should deviate by an angle, which is determined using the Equation 8.
Finally, the objective function, the traveling time (T) has been computed.
Where (
Myriad strategies for navigation of multi-robots have been developed over the last few decades. However, this paper envisions a novel way for incorporating coordination by defining instants for coordination and unique ways for including the same. Collision avoidance amongst each other forms a core part of all such strategies.
To implement this, Euclidean Distance (ED) is calculated amongst a path tracing robot and its nearby counterpart. Assuming a multi-robot system with 4 robots navigating with robot 1 posing as the most critical to robot 2 and vice versa at any instant, under such circumstances, movements of both robots shall be planned individually [4, 8]. Therefore, there may be two incidents. In the first incident, they might avoid the collisions between them by taking the deviation. In another incident, none of them decides who will take the deviation to avoid the collision. This can be addressed with the general notion of cooperation having the following three variations.
Variation 1: No robot will alter its planned path and that robot shall treat the path as per the planner (V1).
Variation 2: For Both the robots will change their planned motion, with decelerations and new path planning decisions (V2).
Variation 3: One will sacrifice its motion but the other will not. Regarding cooperation case, the deviation has been considered as a parameter. The robot with larger amount of deviation angle will be called as cooperative and the other will be non-cooperative (V3).
To solve the coordination problem [8, 16] different strategies have been developed by using the above mentioned three possible concepts. If a particular robot treats another robot as most critical one then nine different strategies may be built based on three different strategies. Proposed strategy matrix has been shown in Table 1.
Strategic matrix between planning Robot and critical Robot
Strategic matrix between planning Robot and critical Robot
The agents may avoid a collision and can reach the destination by optimal time using heuristic coordination where deviation has been taken a key constraint to perform coordination. Following pseudo code is presented to show the coordination process between two particular robots.
Algorithm 1 clearly indicates that the robot that takes more deviation is considered to be more cooperative. However, the challenge to identify the coordinated robot is solved and it is depicted by using a use case diagram as shown in Fig. 4. As discussed, traditional as well as nontraditional approaches have already existed for solving the navigation and coordination problem. Figure 4 depicts the use case diagram presenting to motion planning of multiple robots.

Case diagram depicting motion planning of multiple robots.
A particular agent starts its motion planning by FLC based motion planner. After that, different activities will be performed by agents those are presented in Fig. 4. The same concept is applicable to other agents too. Thereafter, a combined GA-FLC is applied to the system of robots to optimize travel time.
The fuzzy theory has the capability to deal with incomplete uncertain and approximate information [9]. This technique generated additional significance amongst the robotics researchers. In this paper, the inputs, viz. distance and angle and two outputs named deviation and acceleration have been considered. Both the inputs (distance and angle) and outputs (acceleration and deviation) are represented with different linguistic terms as per [11]. The rule base consists of 20 different rules and they are presented in Table 2. The database is considered to be linear in nature.
Manually constructed rule base of FLC
Manually constructed rule base of FLC
Deviation and Acceleration are calculated in a step-wise manner as shown below.
Step 1 (Fuzzification): Measured variables are changed to suitable fuzzy set to express uncertainty measurement.
Step 2 (Rule-base Mapping): Using fuzzified inputs, control rules are evaluated through the rule-base and fuzzified output is obtained.
Step 3 (Defuzzification): The crisp value of the output has been generated converting the fuzzified output.
Different defuzzification methods are there. Center of Sum method is used in the present study.
A GA-based FLC approach has been employed for the better performance of the FLC based technique discussed in Section 3.1. It has experimented that FLC’s performance is mainly dependent on its rule-base. Therefore, the FLC rule base can be, only by using GA and the membership function distribution will remain unchanged. Due to the discrete nature of variables (existence or non-existence of a rule), a binary-coded GA [11] is used at the time of optimization For its long iteration, the computational complexity of GA is more. The offline process is used for FLC optimization.
FLC has been constructed depending on the author’s knowledge base. Occasionally, it is difficult to collect knowledge from the earlier process which is controlled using FLC. To minimize this difficulty, a GA-based approach has been proposed for the manual design of FLC. A binary-coded GA will choose some good fuzzy rules through search from a large rule base which consists of the maximum number of possible rules generated from the Table 2. A 140-bits long GA-string is used to express the knowledge base of the FLC:
Already mentioned above that, Approach 1 has been treated as a data-driven optimization problem [15]. Now the evolution of approaches has been made. Now the problem can be redefined as soft computing based data-driven optimization problem [7, 15]. All the data pertaining to compute the objective function value mentioned on equation no 11; getting optimizes value. A combined coordination and GA-fuzzy-based motion planning scheme is presented in Fig. 5.

Activity diagram showing coordination based motion planning scheme.
The efficacy of the designed approach has been experimented through computer simulations to solve different cases of multiple mobile robots. Two different cases with eight and twelve robots navigating in a grid of 40 × 40 m2 (400 × 400 dm2) is considered. Some of the important parameters of the robots are mentioned below. Dimension: Measured Two-wheeled differential drive robot Maximum Velocity: 4 m/s Acceleration: 0.005 m/s2 to 0.05 m/s2 Time interval (dt): 2 seconds. d
obs
(0) =8m
GA-parametric study with best rule base identification of FLC
Performances of Approaches 1 and 2 can be compared straight-way. However, Approach 3 should be trained before comparing its performances with the other approaches. For this purpose, an optimal knowledge base of the FLC for Approach 3 is noted. However, some of the parameters of GA are also to be set for better performance of it. Those parameters are to be decided before the task of evolution is given to GA. So, GA parametric study has been carried out systematically. The crossover probability is kept fixed at 0.5. The mutation probability, population size and the maximum number of generations are then systematically varied in the ranges of (0.001 to 0.011), (50 to 150) and (0 to 150), respectively, and optimal values are noted against the best fitness value of GA. The optimal GA-parameters are presented in Table 3 for three different cases. Once, the decision on GA parameters is made, it is used to evolve the knowledge base (database and rule base) of the FLC.
Optimal parameters of GA for the three different cases for approach 3
Optimal parameters of GA for the three different cases for approach 3
One hundred different scenarios have been considered and traveling time of each robot is calculated. Average traveling time for all the scenarios is presented in Table 4. R1 to R20 are representing Robots 1 to 20.
Conventional PFM when executed, where the attractive potential is increasing which is made by the goal of the same robot as well as repulsive potential also rising by all the other navigating robots and is not suitable for large number of robots. It is to be replaced by other techniques such as FLC based motion planner.
Cooperation scheme has also been deployed and deviation constraint has been taken as an archetype to implement cooperation scheme. With the incorporation of this, one robot may take more time to reach goal having better cooperation score. To get the optimal result from FLC, the FLC has been tuned by Genetic Algorithm. After successful tuning, the average traveling time has been recorded higher for non-cooperation than cooperation technique. So the overall scenario is like that all approaches have given optimal average traveling time for cooperation issue. It highly demands the cooperation between multiple mobile robots. It may be interesting that in the case of non-optimal FLC, cooperation technique performs well. Standard deviation as presented in Table 4 also shows the efficacy of the simulation results. Previously it has been shown that authors have made the rule base manually for FLC.
Average travel time in seconds of the robots for different approaches and cooperation
Average travel time in seconds of the robots for different approaches and cooperation
It has been observed that cooperation scheme has been fired many a times and we also have counted this. For example, it has been recorded that Robot 1 to Robot 8 has been cooperated in 16, 6, 7,8,11,14,7 and 19 scenarios, respectively out of hundred number of different scenarios (refer to Table 4). High number of cooperation count indicates the requirement of this strategy. Finally, the movement of all the robots for a particular scenario of different approaches has been presented in Fig. 6. All the scenarios are not cooperation oriented but maximum scenarios tend to cooperation. Out of all hundred scenarios, one best scenario has been taken as a best cooperative scenario where robots show their maximum cooperation. Step-by-step movements of robots for that best scenario have been presented.

Navigation of eight, twelve, sixteen and twenty robots using different approaches.
Coordinated navigation of multiple mobile robots is demonstrated using three techniques. Coordination schemes have been implemented with acceleration/ deceleration and deviations of robots upon tracing impending collisions with other robots. From the results of simulations conducted, it can be observed that the performance of FLC based approach deteriorates with increasing number of robots, but without significant changes in average traveling time. Here, we could successfully implement the cooperation scheme in compared to the existing methods in the literature. The fuzzy logic rule base has been tuned by GA and average traveling time has been improved. GA parametric study has been carried out for four robots and the optimal values have been used for eight, twelve, sixteen and twenty number of robots cases. In the case of all developed approaches, hundred scenarios have been considered to show the performance of the developed algorithm, though only one scenario has been presented for all cases. Computational complexity has also been measured for all types of robots here. Development of game theory-based coordination strategy is also there in the authors’ mind.
