Skip to main content

Iterated local search algorithm for solving the orienteering problem with soft time windows

Abstract

In this paper we study the orienteering problem with time windows (OPTW) and the impact of relaxing the time windows on the profit collected by the vehicle. The way of relaxing time windows adopted in the orienteering problem with soft time windows (OPSTW) that we study in this research is a late service relaxation that allows linearly penalized late services to customers. We solve this problem heuristically by considering a hybrid iterated local search. The results of the computational study show that the proposed approach is able to achieve promising solutions on the OPTW test instances available in the literature, one new best solution is found. On the newly generated test instances of the OPSTW, the results show that the profit collected by the OPSTW is better than the profit collected by the OPTW.

Background

In orienteering problem (OP) a set of potential customers is given; the service for these customers is optional during the current planning time horizon since the travel cost of the route is limited. The travel cost is often expressed as the travel time or the travel distance. Thus, a positive value called profit is associated with every customer making its visit more or less attractive. The name of this routing problem originates from a game in which competitors have to visit a set of control points in a given area. If the control point is visited, the competitor gets a profit. The winner of the game is the competitor who collects maximum profits and gets to the end point within a prescribed amount of time. As a routing problem, the OP consists in finding the route visiting a subset of customers that maximizes the total collected profit while satisfying the maximum duration constraint. The OP is also known in the literature as the Selective Traveling Salesman Problem (Thomadsen and Stidsen 2003), the Maximum Collection Problem (Butt and Cavalier 1994) and the Bank Robber Problem (Awerbuch et al. 1998).

Few vehicle routing problems have such applicability as OP. This problem arises in a variety of applications including design of tourist trips to maximize the value of the visited attractions (Vansteenwegen and Oudheusden 2007), recruiting of athletes from high schools for a college team (Butt and Cavalier 1994), delivery of home heating fuel where the urgency of a customer for fuel is treated as a profit (Golden et al. 1984), routing of oil tankers to serve ships at different locations (Golden et al. 1987) and reverse logistics problem of a firm that aims to collect used products from its dealers (Aras et al. 2011).

The OP is a well-studied combinatorial optimization problem that was first presented and heuristically solved by Tsiligirides (1984). Several heuristics and metaheuristics were proposed for the solution of the OP [the reader is referred for example to the papers by Tasgetiren (2001), Ramesh and Brown (1991) and Gendreau et al. (1998)].

In the time windows version of the OP called the orienteering problem with time windows (OPTW), customers have hard time windows and service times. In hard time windows, arriving at customer later than latest time of its time window is strictly forbidden. A waiting is incurred if the vehicle reaches to a customer before its earliest time window. In OPTW, the objective is designing the route that maximizes the total collected profit while satisfying the time limit duration and the hard time windows constraints.

In recent years there has been considerable interest for the OPTW which has led to a significant body of literature. The authors in Righini and Salani (2009) proposed a bidirectional dynamic programming algorithm for solving the OPTW to optimality. They use a technique named decremental state space relaxation in which the dynamic programming algorithm takes advantage of a state space relaxation. The authors in Duque et al. (2015) proposed an exact algorithm based on pulse framework for solving the OPTW to optimality. Most studies have focused on designing heuristic algorithms, several heuristics and metaheuristics were then proposed for the solution of the OPTW [the reader is referred for example to the papers by Vansteenwegen et al. (2009), Lin and Yu (2012), Labadie et al. (2011, 2012), Montemanni and Gambardella (2009), Tunchan (2014), Gunawan et al. (2015) and Lahyani et al. (2016)]. For a recent survey on OP and OPTW the reader is referred to the paper by Gunawan et al. (2016).

Problem related to the problem studied in this research is the vehicle routing problem with soft time windows (VRPSTW). In many real-life problems, some or all customers’ time windows are not so strict that can be violated with appropriate penalties. Such kind of time constraint is called soft time window. In VRPSTW, vehicles are allowed to serve customers before the earliest and/or after the latest time windows bounds. This type of time windows is useful for the dispatcher when:

  • The number of routes needed for hard time windows exceeds the number of available vehicles.

  • A study of cost-service tradeoffs is required.

  • The dispatcher has qualitative information regarding the relative importance of hard time windows across customers.

Besides, relaxing time windows can result in lower total costs without hurting customers’ satisfaction significantly. In the literature, there are different ways of relaxing time windows which lead to different variants of VRPSTW.

  • If a vehicle arrives before the earliest bound of the time window, it waits as in hard time windows case. However, late service is allowed if an appropriate penalty is paid. The authors in Taillard et al. (1997) proposed a tabu search heuristic for this variant.

  • Both early and late services are allowed by paying appropriate penalties. The authors in Koskosidis and Solomon (1992) proposed an optimization-based heuristic for this variant.

  • Both early and late services are allowed as in the second variant. However, the maximum allowable violation of the time windows and the maximum waiting time allowed are limited. This is the variant studied by Chiang and Russell (2004) and Balakrishnan (1993). The authors in Balakrishnan (1993) described three heuristics for solving this variant. While the authors in Chiang and Russell (2004) proposed a tabu search heuristic to deal with this variant.

For more detail about these relaxation schemes and the algorithms proposed in the literature to solving them, the reader is referred to the paper by Vidal et al. (2015).

Contributions

We observed when solving orienteering problems with time windows as in Aghezzaf and Fahim (2015) that the gap between the total travel time of a route and the travel time limit is significant especially on instances with long scheduling horizon. Thus, we have decided to manage this gap by allowing relaxation of time windows in order to improve the profit collected by the vehicle. Furthermore, there are many practical reasons for allowing violation of time windows:

  • Many applications do not require hard time windows.

  • In many cases travel times cannot be accurately known.

  • Customers may be unwilling to set precise time windows in advance and simply prefer the flexibility to alter their delivery requests.

The contribution of this paper is twofold:

  • We introduce and define a new routing denoted the orienteering problem with soft time windows (OPSTW). To the best of our knowledge, this is the first study dealing with orienteering problem with soft time windows. In this routing problem, late service is allowed if an appropriate penalty is paid. In this relaxation scheme, we are placing restrictions on both the penalty payable and the waiting time. We think that OPSTW solutions can result in routes visiting a significant number of potential customers without hurting customers’ satisfaction significantly. Furthermore, soft time windows can provide a workable plan of action for decision makers when hard time windows are not required or when it is not possible to visit all customers during the current planning time horizon which is the case for the OPTW.

  • We develop a hybrid algorithm that combines an iterated local search with a variable neighborhood search for this specific problem. We also apply it to standard instances and compare its performance to that of other algorithms proposed in the literature for the OPTW.

The rest of this paper includes four additional sections. “Mathematical model” section defines the mathematical notation and formulation of OPSTW. “Solution algorithm” section describes the proposed hybrid algorithm. “Computational results” section presents the computational results and compares our algorithm against published results both with regard to solution quality and computational time. The last section is devoted to the conclusions.

Mathematical model

The OPTW studied in this paper can be described as follows : let \(G=(V,E)\) be a complete graph, where \(V=\{0,1,\ldots ,n\}\) is a vertex set and \(E=\{(i,j) \in V^{2}\, i \ne j\}\) is an arc set. Vertex 0 denotes a depot at which the vehicle starts and ends its tour. The set of vertices \(C=\{1,\ldots , n\}\) specify the location of a set of n customers. Each vertex \(i \in V\) has an associated profit \(p_i\) (\(p_0 = 0\)), a service time \(S_i\) (\(S_0 = 0\)) and a time window \([e_i, l_i]\) which is assumed to be hard. Each arc \((i, j) \in E\) has an associated cost \(t_{ij}\) which represents the time required to travel from vertex i to vertex j. The cost \(t_{ij}\) is defined as the Euclidean distance between the points corresponding to i and j. The arrival time to a customer i is denoted \(a_i\); the beginning of service time is denoted \(b_i\). The objective is to design a route R that maximizes the total collected profit subject to the following:

  • The route R cannot start before \(e_0\) and cannot end after \(l_0\).

  • The service to a customer i cannot start before \(e_i\) and if the vehicle arrives too early it can wait for a certain period of time \(w_i = max(e_i - a_i, 0)\) and serves that customer.

  • Every customer is visited at most once.

  • The total travel time of R is limited by a time limit \(T_{max}\).

In order to formulate the model we define the following decision variables :

  • \(x_{ij}\) binary variable equal to 1 if the vehicle travels directly from vertex i to vertex j, and 0 otherwise.

  • \(y_i\) binary variable equal to 1 if vertex i is visited, and 0 otherwise.

  • \(b_i\) beginning of service time at customer i.

M is a large value.

The OPTW can be formulated as the following mixed integer linear programming model:

$$\begin{aligned}&\text {max}\,\,f = \sum _{i \in C} {p_{i} y_{i}} \end{aligned}$$
(1)
$$\begin{aligned}&\text {subject to:} \\&\sum _{j \in C} {x_{0j}} = \sum _{i \in C} {x_{i0}} = 1 \end{aligned}$$
(2)
$$\begin{aligned}\sum _{i \in V} {x_{il}} = \sum _{j \in V} {x_{lj}} \le 1 \quad \forall l \in C\end{aligned}$$
(3)
$$\begin{aligned}b_{i} + S_{i} + t_{ij}- b_{j} \le M(1 - x_{ij}) \quad\forall i,j \in V \end{aligned}$$
(4)
$$\begin{aligned}\sum _{i \in V} \left(S_{i}y_{i} + \sum _{j \in V} {t_{ij} x_{ij}}\right) \le {T_{max}} \end{aligned}$$
(5)
$$\begin{aligned}e_{i} \le b_{i} \le l_{i} \quad\forall i \in V \end{aligned}$$
(6)
$$\begin{aligned}x_{ij}, y_{i} \in \{0,1\} \quad \forall i,j \in V \end{aligned}$$
(7)
$$\begin{aligned}b_{i} \in {{\mathbb {R}}}^{+}\cap [e_0, l_0] \quad\forall i \in V \end{aligned}$$
(8)

The objective function (1) maximizes the total collected profit. Constraint (2) guarantees that the route starts and ends at vertex 0 (depot). Constraints (3) and (4) determine the connectivity and the time line of the route. Constraint (5) ensures the maximum time duration constraint of the route. Constraints (6) restrict the start of the visit to the time windows. Constraints (7) and (8) are variables definition.

In OPSTW, the time window of every customer \(i \in C\) can be enlarged to an outer time window \([e_{i},l_{i} + P_{max}] = [e_i, \hat{l}_{i}]\), where \(P_{max}\) is an upper bound on the maximum allowable time window violation. An appropriate penalty \(P^{penalty}_{i}\) is then paid if the service starts late that is \(a_{i} \in ]l_{i}, \hat{l}_{i}]\). The penalty function can be defined as follows:

$$\begin{aligned} P^{penalty}_{i} ={\left\{ \begin{array}{ll} 0 & \quad {\text{if}}\; e_{i} - W_{max} \le a_{i} \le l_{i} \\ a_{i} - l_{i} & \quad {\text {if}} \; l_{i} < a_{i} \le \hat{l}_{i} \end{array}\right. } \end{aligned}$$
(9)

One can express the OPSTW objective function as a combination between the total collected profit (the classic objective for OPTW) and the total penalty for time windows violations. In our formulation, we do not express it that way since this will change the nature of the faced problem and the aim of this work. In our OPSTW formulation, the total penalty and the total waiting time are expressed as travel costs and added to the total travel time of the route. Then, constraint (5) of the previous model changes as follows:

$$\begin{aligned} \sum _{i \in V} \left(\left(S_{i} + P^{penalty}_{i} + w_{i}\right) y_{i} + \sum _{j \in V} {t_{ij} x_{ij}}\right) \le {T_{max}} \end{aligned}$$
(10)

Since in our formulation we take into account the fact that \(w_i \le W_{max}\) for each routed customer i, the following constraint is added to the model.

$$\begin{aligned} (e_j - (b_i + S_i + t_{ij}))x_{ij}\le (W_{max})x_{ij} \quad \forall i,j \in V \end{aligned}$$
(11)

Regarding the time windows constraints they change as follows:

$$\begin{aligned} e_{i}\le b_{i} \quad \forall i \in V \end{aligned}$$
(12)
$$\begin{aligned} b_{0}\le l_{0}\end{aligned}$$
(13)
$$\begin{aligned} b_{i}\le \hat{l}_{i} \quad \forall i \in C \end{aligned}$$
(14)

In the next subsection, we will describe the approach that we propose to deal with the OPSTW.

Solution algorithm

At its core, the approach proposed to solve the OPSTW is an iterated local search (ILS). ILS is a local search based metaheuristic that was introduced in Lourenço et al. (2003) to solve combinatorial optimization problems. Let S be the starting solution for the ILS process. At each iteration, a diversification phase is firstly applied by perturbing S. An intensification phase is then performed around the perturbation output by applying a local search procedure to produce a solution \(\acute{S}\). If \(\acute{S}\) satisfies an acceptance criterion, it replaces the starting solution and the next perturbation phase is performed from that solution. Otherwise, \(\acute{S}\) is discarded and the search returns to the previous starting solution. In the proposed ILS algorithm, a variable neighborhood search (VNS) is applied to \(\acute{S}\) even if it is better than S or not. The objective is intensifying the search around \(\acute{S}\), which is a local optima with respect to the local search procedure, in order to explore promising regions of the solution space. Algorithm 1 illustrates the steps of the proposed hybrid ILS (HILS) algorithm. The stopping condition used is the maximum number of iterations allowed \(L_{max}\). In the next subsections, we will describe the components of the proposed ILS algorithm which are the initial solution procedure, the perturbation operator, the local search procedure and the variable neighborhood search.

figure a

Initial solution

We propose three insertion heuristics to generate a set of solutions and we pick the best as the starting solution for the ILS process. These heuristics follow the scheme of the insertion heuristic proposed by Solomon (1987) for the vehicle routing problem with time windows (VRPTW), they differ in the expression of the criterion used to compute the best feasible insertion place of each unrouted customer on the current partial route. In the following subsections we will first present the procedure implemented to check the feasibility of an insertion and then we will present the initial solution procedure.

Feasibility check

Let \(R = (i_0, i_1, i_2, \ldots , i_{m-1},i_m), i_0 = i_m = 0\) be the current partial route and let u be an unrouted customer. We define a feasible place of the customer u in R as a position \((i_{p-1}, i_p) \, p \in \{ 1, \ldots , m\}\) in R for which, if u is inserted between the adjacent vertices \(i_{p-1}\) and \(i_p\) then:

The waiting time at customer u given by Eq. (15) satisfies the following:

$$\begin{aligned} w_{u} = max(0, e_{u} - (b_{i_{p-1}} + S_{i_{p-1}} + t_{i_{p-1}u})) \le W_{max} \end{aligned}$$
(15)

The time duration constraint on the route is still satisfied, that is:

$$\begin{aligned}\sum_{r=1}^{p-1}t_{i_{r-1}i_{r}} + \sum _{r=1}^{p-1}\left(w_{i_{r}} + S_{i_{r}} + P^{penalty}_{i_{r}}\right) + t_{i_{p-1} u} + t_{u i_{p}} - t_{i_{p-1}i_{p}} + S_{u} + w_{u} + P^{penalty}_{u} + \sum _{r=p+1}^{m}t_{i_{r-1}i_{r}} + \sum _{r=p}^{m-1} \left(w_{i_{r}} + S_{i_{r}} + P^{penalty}_{i_{r}} \right) \le T_{max} \end{aligned}$$
(16)

All vertices subsequent to the inserted customer u still satisfy at most their outer time windows. This is done using the conditions for time feasibility proposed by Solomon (1987) as follows:

$$\begin{aligned} b_{u} \le \hat{l_{u}}, \quad {\text{and}} \quad b_{i_{r}} + PF_{i_{r}} \le \hat{l_{i_{r}}}, \quad p \le r \le m \end{aligned}$$
(17)

where:

$$\begin{aligned} PF_{i_{p}} = b^{new}_{i_{p}} - b_{i_{p}} \end{aligned}$$
(18)

The metric \(b^{new}_{i_{p}}\) corresponds to the beginning of service at customer \(i_{p}\) (which is the arrival time at the depot if \(p =m\)) given that customer u is inserted between \(i_{p-1}\) and \(i_{p}\). This metric is computed as follows:

$$\begin{aligned} b^{new}_{i_{p}} = max(e_{i_{p}}, b_u + S_u + t_{u i_{p}}) \end{aligned}$$
(19)

It is clear that \(PF_{i_{p}} \ge 0\) since the matrix \((t_{ij})_{(i, j)\in E}\) satisfies the triangle inequality. This metric is computed for the rest of the subsequent vertices as follows:

$$\begin{aligned} PF_{i_{r+1}} = max\{0, PF_{i_{r}} - w_{i_{r+1}}\}, \quad p \le r \le m-1 \end{aligned}$$
(20)

Insertion heuristics

Each insertion heuristic \(H_l\), \(l \in \{1,2,3\}\) starts by determining the best feasible place of each unrouted customer on R. Such position is defined as the position (i(u), j(u)) for which:

$$\begin{aligned} C_{1}(i(u), u, j(u)) = min[C^{H_{l}}_{1}(i_{p-1}, u, i_{p})], \quad p \in \{1, 2, \ldots , m\} \end{aligned}$$
(21)

The first insertion heuristic \(H_{1}\) computes this position using the following criterion:

$$\begin{aligned} C^{H_{1}}_{1}(i_{p-1}, u, i_{p}) = \alpha _{1}(t_{i_{p-1} u} + t_{u i_{p}} - t_{i_{p-1}i_{p}} + \alpha _{3}S_u) + \alpha _{2}(b^{new}_{i_{p}} - b_{i_{p}}) \end{aligned}$$
(22)

The second insertion heuristic \(H_{2}\) computes this position using the following criterion:

$$\begin{aligned} C^{H_{2}}_{1}(i_{p-1}, u, i_{p}) = \alpha _{1}(t_{i_{p-1} u} + t_{u i_{p}} - t_{i_{p-1}i_{p}}+\alpha _{3}S_u) + \alpha _{2}w_{u} \end{aligned}$$
(23)

While the third insertion heuristic \(H_{3}\) computes this position using the following criterion:

$$\begin{aligned} C^{H_{3}}_{1}(i_{p-1}, u, i_{p}) = \alpha _{1}(t_{i_{p-1} u} + t_{u i_{p}} - t_{i_{p-1}i_{p}}+\alpha _{3}S_u) + \alpha _{2}\theta _{u} \end{aligned}$$
(24)

The metric \(\theta _{u}\) corresponds to the time difference between the completion of service at customer \(i_{p-1}\) (which is the departure time from the depot if \(p=1\)) and the beginning of service at customer u. This metric is expressed as follows:

$$\begin{aligned} \theta _u = b_u - (b_{i_{p-1}} + S_{i_{p-1}}) \end{aligned}$$
(25)

The weights \(\alpha _1\), \(\alpha _2\) and \(\alpha _3\) define the relative contribution of each individual metric in the computing of the best feasible insertion place. The parameter \(\alpha _1\) takes into account the saving in travel time by inserting u between \(i_{p-1}\) and \(i_{p}\).

Then, each insertion heuristic selects the best unrouted customer v according to the criterion given by Eq. (26) and inserts it in the current partial route R.

$$\begin{aligned} C_{2}(i(v), v, j(v)) = \min _{u \in \nabla } [C_{2}(i(u), u, j(u))] \end{aligned}$$
(26)

where \(\nabla\) is the set of unrouted customers having at least one feasible place on the current partial route. The criterion \(C_{2}(i(u), u, j(u))\) is expressed as follows:

$$\begin{aligned} C_{2}(i(u), u, j(u)) = \dfrac{C^{H_{l}}_{1}(i(u), u, j(u))}{p^{\alpha _{4}}_{u}} \end{aligned}$$
(27)

The parameter \(\alpha _4\) is the exponent of the profit of customer u. The procedure of customer insertion is repeated, for each insertion heuristic, until no further unrouted customer can be inserted into R. The insertion procedure terminates by providing the set of assigned customers and the sequence in which these customers are routed. This is repeated for a number of values for \(\alpha _{i}, i \in \{1,2,3,4\}\) and the best overall solution is returned at the end. We compare two solutions using the following criteria in decreasing order: collected profit and time duration. Note that \(\alpha _{i}, i \in \{1,2,3,4\}\) are positive weights that satisfy: \(\alpha _{i} \ge 0, i \in \{1,2,3,4\}\) and \(\alpha _1 + \alpha _2 = 1\).

Perturbation

The perturbation operator used in the proposed ILS algorithm performs, around a solution, by selecting the customer with minimal profit and removing it from this solution. Note that after a removal, all vertices (customers + depot) following removed one are shifted towards the beginning of the route in order to ensure its continuity. As one can intuitively expect, this forward move can result in an infeasible solution since the waiting time on some customers may exceed the maximum allowable waiting time \(W_{max}\). This is solved using local search procedure that will be described in the next subsection.

Local search

The local search procedure tries to fulfill the available room in the solution, obtained through perturbation, by inserting other feasible unrouted customers.

On one hand and as one can intuitively expect, evaluating the possible insertion of each unrouted customer using the criterion presented in the initial solution procedure will increase the risk of inserting the set of customers just removed, and getting easily stuck in the initial solution. On the other hand, the solution obtained through perturbation can be infeasible.

Given a starting solution S, the solution obtained through perturbation is denoted \(\hat{S}\). The local-search procedure performs, around \(\hat{S}\), by inserting each unrouted customer in its first feasible place. Using this local search procedure, following effects are observed:

  • an unrouted customer in S can be part of \(\hat{S}\).

  • a routed customer in S cannot be inserted in \(\hat{S}\).

  • the position of a customer in S can be changed to another position in \(\hat{S}\).

  • the customers of \(\hat{S}\) are shifted towards the end of the route in order to avoid unnecessary waiting time. As a consequence, the solution obtained after local search procedure is feasible.

This procedure will help to re-optimize a solution, make it feasible if it is not and insert other feasible unrouted customers in order to improve the value of the incumbent solution.

Variable neighborhood search

Variable neighborhood search (VNS) is a local search based metaheuristic that was introduced in Mladenović and Hansen (1997) for solving combinatorial optimization problems. The basic idea behind this metaheuristic is a systematic change of neighborhoods both in descent phase using a local search procedure, and in shaking phase using a set of neighborhood structures. VNS is a stochastic algorithm in which, first, a finite set of neighborhood structures is defined. We denote by N(S) the set of solutions in the neighborhood of S. Each VNS iteration is composed of three steps: shaking, local search and move. At each iteration, a solution \(\acute{S}\) is randomly generated from the neighborhood of S. A local search is then applied with \(\acute{S}\) as the initial solution, the obtained solution is denoted \(\hat{S}\). If \(\hat{S}\) is better than S, the search moves to \(\hat{S}\) and continues by considering the first neighborhood structure. Otherwise, k is incremented. The steps of the proposed VNS algorithm are given by Algorithm 2. Before defining the neighborhood structures used in the developed VNS, we first define two metrics \(\varphi _{S}, \vartheta _{S} \in {{\mathbb {N}}}\). To do that, let us denote with \(S=(0,c_1, c_2, \ldots , c_m, 0)\, c_h \in C, h \in \{1,\ldots ,m\}\) a feasible solution. These metrics are defined as follows:

figure b
$$\begin{aligned} \varphi _{S}= \left\lfloor \dfrac{m}{2} \right\rfloor \end{aligned}$$
(28)
$$\begin{aligned} \vartheta _{S}= \left\lceil \dfrac{m}{2} \right\rceil \end{aligned}$$
(29)

The first neighborhood of S denoted \(N_1(S)\) is defined as the set of all solutions obtained by removing two customers, one from the set \((c_1, c_2, \ldots , c_{\varphi _{S}})\) and the other from the set \((c_{\vartheta _{S}}, c_{\vartheta _{S}+1}, \ldots , c_m)\).

The second neighborhood \(N_{2}(S)\) is defined as the set of all solutions obtained by removing a set of customers \((c_{k}: k \in [1,j])\) such that \(j \in [1,m]\). The idea behind using floor and ceiling functions to define these neighborhood structures is to reduce the size of the neighborhoods and then the computational time.

Computational results

The proposed algorithm is coded in Java; the experiments are performed on a personal computer Intel(R) with 2.1 GHz and 4 GB of RAM. We test, first, our algorithm on OPTW test instances. Based on these instances, we design test instances for the OPSTW. Each experiment is performed, on each test instance, five times for which the average results are presented. The presented computational times are the average times over five runs.

Test instances

The authors in Righini and Salani (2009) designed test instances for OPTW based on 29 VRPTW test instances of Solomon (1987) namely C100, R100 and RC100, and on 10 Multi-depot Vehicle Routing Problem (MDVRP) test instances of Cordeau Cordeau et al. (1997) PR01-10. The number of customers for Cordeau instances varies between 48 and 288 customers; while all Solomon instances have 100 customers. The author in Vansteenwegen (2008) designed OPTW test instances based on Solomon instances by considering the first 50 customers \((n = 50)\). The authors in Montemanni and Gambardella (2009) designed other OPTW test instances based on 27 VRPTW test instances of Solomon namely, C200, R200 and RC200, and on 10 MDVRP test instances of Cordeau PR11-20. We design OPSTW test instances based on OPTW test instance namely PR01 by considering different values of \(W_{max}\) and \(P_{max}\). We set the maximum allowable waiting time to \(W_{max} \in [5, 7]\), in increments of 0.5 %, of the maximum time duration \(T_{max}\). While we set the maximum allowable time window violation to \(P_{max} \in [1, 5]\), in increments of 0.5 %, of \(T_{max}\). In all OPTW and OPSTW test instances, it is assumed that the maximum time duration \(T_{max}\) is equal to \(T_{max}=l_0 - e_0\).

Parameter tuning

Preliminary experiments on OPTW test instances are conducted to set the values of \(\alpha _{i}, i \in \{1,2,3,4\}\). The following values are tested: \(\alpha _{i} \in [0,1], i \in \{1,2,3\}\) in increments of 0.1 units and \(\alpha _{4} \in \{1,2,3,4\}\). The results indicate that given more importance to the metric related to the saving in travel time in the selection criterion has good influence on solution quality. Thus, the following values are selected:

  • \(\alpha _1 \in \{ 0.9, 0.7, 0.5\}\)

  • \(\alpha _2 \in \{0.1, 0.3, 0.5\}\)

  • \(\alpha _3 \in \{0.1, 0.3, 0.5, 0.7, 0.9\}\)

  • \(\alpha _4 \in \{2, 3, 4\}\).

The proposed HILS algorithm has two parameters: a maximum number of iterations allowed \(L_{max}\) which is ILS stopping condition, and \(I_{max}\) the maximum number of iterations allowed in VNS process. The values of these parameters are determined performing several experiments on a subset of OPSTW test instances that was randomly selected. We test combinations of the following values during the experiments: \(L_{max} \in \{ 20, 50, 100\}; I_{max} \in \{10, 20, 50\}\). The results of these experiments show that by increasing these parameters better results can be obtained at the expense of extra computational time. In this paper we are looking for a fast algorithm. Thus, we set these parameters to \(L_{max} = 20\) and \(I_{max} = 10\).

Computational results on OPTW instances

In this subsection, we compare the results of HILS algorithm with the following state-of-the-art algorithms:

  • I3CH: the iterative three-component algorithm of Hu and Lim (2014).

  • IterLS: the iterated local search algorithm of Vansteenwegen et al. (2009).

  • VNS: the variable neighborhood search algorithm of Tricoire et al. (2010).

  • GVNS: the LP-based granular variable neighborhood search algorithm of Labadie et al. (2012).

  • SSA: the slow version of the simulated annealing algorithm of Lin and Yu (2012).

  • FSA: the fast version of the simulated annealing algorithm of Lin and Yu (2012).

  • ILS: the iterated local search algorithm of Gunawan et al. (2015).

  • GRASP-ELS: the hybrid algorithm of Labadie et al. (2011) that combines greedy randomized adaptive search procedure with evolutionary local search.

  • ABC: the artificial bee colony algorithm of Tunchan (2014).

  • DABC: the discrete artificial bee colony algorithm of Karabulut and Tasgetiren (2013).

  • GA: the genetic algorithm of Karbowska-Chilinska and Zabielski (2014).

  • ACS: the ant colony system algorithm of Montemanni and Gambardella (2009).

  • EACS: the enhanced ant colony system algorithm of Montemanni et al. (2011).

  • VAN: the iterated local search algorithm of Vansteenwegen (2008).

The computational results are given in Table 1. Column Instance-n gives the instance over which the algorithms are tested and the associated number of customers. Column BKS presents the latest best known solution as described in (http://centres.smu.edu.sg/larc/orienteering-problem-library). Column I3CH presents the profit obtained by I3CH algorithm (Profit), the percentual gap with the best known profit [Gap (%)] and the computational time required by I3CH algorithm on each run [CPU (s)]. Column ABC presents the average profit, over five runs, obtained by ABC algorithm, the percentual gap with the best known profit and the average computational time of five runs. Column VNS presents the average profit as described in Tricoire et al. (2013), over ten runs, obtained by VNS algorithm, the percentual gap with the best known profit and the average computational time of ten runs. Column ILS presents the profit obtained, over ten runs, by ILS algorithm, the percentual gap with the best known profit and the average computational time of ten runs. Column ACS presents the profit obtained, over five runs, by ACS algorithm, the percentual gap with the best known profit and the average computational time of five runs. Column GVNS presents the profit obtained, over five runs, by GVNS algorithm, the percentual gap with the best known profit and the average computational time of five runs. Column GRASP-ELS presents the profit obtained, over five runs, by GRASP-ELS algorithm, the percentual gap with the best known profit and the average computational time of five runs. Column SSA presents the profit obtained by SSA algorithm, the percentual gap with the best known profit and the computational time of one run. Column IterLS presents the profit obtained by IterLS algorithm, the percentual gap with the best known profit and the computational time of one run. Column FSA presents the profit obtained by FSA algorithm, the percentual gap with the best known profit and the computational time of one run. Column DABC presents the profit obtained, over five runs, by DABC algorithm, the percentual gap with the best known profit and the average computational time of five runs. Column HILS presents the profit obtained, over five runs, by our HILS algorithm, the percentual gap with the best known profit and the average computational time of five runs. Column GA presents the profit obtained, over sixteen runs, by GA algorithm, the percentual gap with the best known profit and the average computational time of sixteen runs.

Column Opt presents the optimal profit as described in Tricoire et al. (2010) and the associated computational time. Column VAN presents the profit obtained by VAN algorithm and the associated computational time. Column VNS presents the worst, best and average profit, over ten runs, of VNS algorithm and the average computational time. Column HILS presents the worst, best and average profit, over five runs, of HILS algorithm and the average computational time.

To ensure fair comparisons, the results of each algorithm are compared with the best known solutions with the computational times adjusted to the speed of the computers used to achieve these results. We summarize the experimental environment of each algorithm and compare their CPU speed in Table 2. As all algorithms are single threaded, we compare their CPU speed using the Super pi benchmark (http://www.superpi.net/). In Table 2, the Super pi column reports the number of seconds it takes each processor to compute the first one million digits of \(\pi\). The processor used for IterLS algorithm is approximately two times faster than that used for GRASP-ELS and GVNS algorithms; the processor used for VAN algorithm is slower than that used for GRASP-ELS and GVNS algorithms. While the processor used for ACS and EACS algorithms is comparable to that used for GRASP-ELS and GVNS algorithms. This statement is based on the comparison of various computer systems solving standard linear equation problems presented in Dongarra (2014). The performance is evaluated on a benchmark problem of a dense system of linear equations given by a matrix of order 100 and 1000. The values for the processor used for GRASP-ELS and GVNS algorithms are 1571 and 3650 Mflop/s respectively; the values for the processor used for ACS and EACS algorithms are 1470 and 3654 Mflop/s respectively. The values for the processor used for IterLS algorithm are 2426 and 7519 Mflop/s respectively while the values for the processor used for VAN algorithm are 1317 and 2444 Mflop/s respectively. The values for the processor used for VNS which is an Intel Pentium 4 with 2.4 GHz are not available. However, the values for an Intel Pentium 4 with 2.5 GHz are available, this processor has achieved 1190 and 2355 Mflop/s respectively. Thus, we assume that the processor used for VNS algorithm is slower than that used for VAN algorithm. The values for the processor used for GA algorithm are not available. As only limited information was available on the processor used by GA, we cannot estimate its speed by considering only the clock-rate. A review of all processors i7 with 2.93 GHz shows that the Super pi ranges from 13.8 to 11.7 s. We assume that the processor used for DABC is comparable to that used for I3CH algorithm. We estimate the single-thread performance of each processor by supposing the performance of the machine of Gunawan et al. (2015) to be 1.

Table 3 summarizes the results obtained by the algorithms. It compares the average performance of HILS with that of the stat-of-the-art algorithms. Column Gap (%) reports the average percentual gap with the best known profit. Column CPU (s) reports the average computational time in seconds. The computational times of the algorithms are adjusted according to computers’ speed as presented in Table 2. The authors in Montemanni et al. (2011) did not report detailed results for their EACS algorithm, they have just reported average gaps with the former best known solutions. However, the authors in Gunawan et al. (2015) have recently reported the average gaps for the best algorithm among ACS and EACS called ACS* with the latest best known solutions. Thus, column ACS* of Table 3 presents the average result, over five runs, of ACS* algorithm.

We can see from Tables 1 and 3 that on Solomon instances with 100 customers, HILS algorithm performs, on average, better than GVNS and DABC on Class 1 (C100, R100 and RC100) both with regard to solution quality and computational time. On C100 and R100 test instances, HILS algorithm performs, on average, better than FSA, GA and IterLS using approximately the same computational effort. On these instances of Class 1, ILS, SSA and GRASP-ELS and I3CH are, on average, better than HILS at the cost of extra computational time. On the test instances of Class 2 (C200, R200 and RC200), HILS algorithm performs, on average, better than GA using more computational time. On C200 test instances, HILS performs, on average, better than GVNS both with regard to solution quality and computational time. On these instances of Class 2, most of state-of-the-art algorithms outperform HILS algorithm using more computational effort. On these test instances of Solomon with 100 customers, HILS achieved the optimal solution 19 times.

On the test instances of Cordeau, HILS algorithm is not as competitive as state-of-the-art algorithms on PR01-10 test instances; HILS algorithm achieved the worst average gap which is equal to 6.8 %. On PR11-20 test instances of Cordeau, HILS algorithm performs, on average, better than ACS* both with regard to solution quality and computational time and better than FSA using more computational effort. However, the rest of state-of-the-art algorithms perform, on average, better than HILS on these test instances of Cordeau. HILS algorithm is able to achieve 1 new best solution on PR17 test instance.

On test instances with 50 customers, HILS algorithm is as competitive as VAN algorithm both with regard to solution quality and computational time. VNS algorithm performs, on average, better than HILS and VAN algorithms at the expense of a reasonable amount of computational time. On these instances, HILS is able to achieve the optimal solution on 19 instances over 29.

Table 1 Results on the OPTW test instances
Table 2 Estimate of single-thread performance
Table 3 Overall comparison on OPTW test instances
Table 4 Results on the OPSTW test instances

Computational results on OPSTW instances

In this section we computationally test the increase of the profit due to soft time windows.

Table 4 presents the results obtained by HILS algorithm on OPSTW test instances. Column one (Instance) presents the instance over which the algorithm is tested. Column two corresponds to the maximum allowable time window violation and the maximum allowable waiting time at any customer. Columns three to six present the best, worst and average profit, over five runs, of HILS algorithm and the average computational time. Columns \(N_R\) and %HTW present the number of routed customers on the average solution and the percentage of non-violated time windows on this solution respectively. The last column presents the sequence in which the customers are routed in the average solution.

The results show, as expected, that in all cases it is possible to increase the collected profit by allowing controlled violations of time windows. Allowing for example the maximum allowable violation of time window to 1 % of the maximum time duration and the maximum allowable waiting time at any customer to 7 % of the maximum time duration, results in solution with a profit of 330 and 95 % of non-violated time windows while the profit reported for hard time windows is 308. On the other hand, setting for example \(P_{max}\) to 4.5 % and \(W_{max}\) to 5 %, results in 23 routed customers while the number of routed customers reported for hard time windows is 21.

Conclusions

In this paper we have introduced the orienteering problem with soft time windows (OPSTW). This routing problem can serve as a model for many practical applications for which travel times cannot be accurately known or when hard time windows are not required. Computational results on OPSTW show that our hybrid algorithm is able to achieve solutions that increase the total collected profit without hurting customers’ satisfaction significantly. On OPTW test instances our hybrid algorithm is able to achieve promising solutions. In our test experiments, instances with tight time windows are solved better than that with broader time windows. A 2-Opt or 3-Opt procedure may reduce this gap by decreasing the time duration of the route and inserting other possible unrouted customers. Since the chosen acceptance criterion has a critical influence on the balance between intensification and diversification of the search, a possible improvement of the algorithm could involve also considering worst solutions during the search. One could work with a simulated annealing acceptance criterion.

References

  • Aghezzaf B, Fahim HE (2015) Solving the capacitated team orienteering problem with time windows through variable neighborhood search. Int Rev Comput Softw IRECOS 10(11):1134–1142

    Article  Google Scholar 

  • Aras N, Asken D, Tekin MT (2011) Selective multi-depot vehicle routing problem with pricing. Transp Res Part C 19:866–884

    Article  Google Scholar 

  • Awerbuch B, Azar Y, Blum A, Vempala S (1998) New approximation guarantees for minimum-weight k-trees and prize-collection salesmen. SIAM J Comput 28:254–262

    Article  MathSciNet  MATH  Google Scholar 

  • Balakrishnan N (1993) Simple heuristic for the vehicle routing problem with soft time windows. J Oper Res Soc 44:279–287

    Article  MATH  Google Scholar 

  • Butt SE, Cavalier TM (1994) A Heuristic for the multiple tour maximum collection problem. Comput Oper Res 21(1):101–111

    Article  MATH  Google Scholar 

  • Chiang WC, Russell RA (2004) A metaheuristic for the vehicle routing problem with soft time windows. J Oper Res Soc 55:1298–1310

    Article  MATH  Google Scholar 

  • Cordeau JF, Gendreau M, Laporte G (1997) A tabu search heuristic for periodic and multi-depot vehicle routing problems. Networks 30:105–119

    Article  MATH  Google Scholar 

  • Dongarra JJ (2014) Performance of various computers using standard linear equations software. Electrical Engineering and Computer Science Department University of Tennessee, Knoxville (2014)

  • Duque D, Lozano L, Medaglia AL (2015) Solving the orienteering problem with time windows via the pulse framework. Comput Oper Res 54:168–176

    Article  MathSciNet  Google Scholar 

  • Gendreau M, Laporte G, Semet F (1998) A tabu search heuristic for the undirected selective travelling salesman problem. Eur J Oper Res 106:539–545

    Article  MATH  Google Scholar 

  • Golden BL, Assad A, Dahl R (1984) Analysis of a large-scale vehicle routing problem with an inventory component. Large Scale Syst 7:181–190

    MATH  Google Scholar 

  • Golden BL, Levy L, Vohra R (1987) The orienteering problem. Nav Res Logist 34(3):307–318

    Article  MATH  Google Scholar 

  • Gunawan A, Lau HC, Lu K (2015) An iterated local search algorithm for solving the orienteering problem with time windows. In: Evolutionary computation in combinatorial optimization—15th European conference, EvoCOP 2015, Copenhagen, Denmark, April 8–10, 2015, Proceedings, pp 61–73

  • Gunawan A, Lau HC, Vansteenwegen P (2016) Orienteering problem: a survey of recent variants, solution approaches and applications. Eur J Oper Res 225(2):315–332

    Article  MathSciNet  MATH  Google Scholar 

  • Hu Q, Lim A (2014) An iterative three-component heuristic for the team orienteering problem with time windows. Eur J Oper Res 232(2):276–286

    Article  MATH  Google Scholar 

  • Karabulut K, Tasgetiren MF (2013) A discrete artificial bee colony algorithm for the team orienteering problem with time windows. In: IEEE symposium on computational intelligence in production and logistics systems, CIPLS 2013, Singapore, April 16–19, 2013, pp 99–106 (2013)

  • Karbowska-Chilinska J, Zabielski P (2014) Genetic algorithm with path relinking for the orienteering problem with time windows. Fundam Inf 135(4):419–431

    MathSciNet  MATH  Google Scholar 

  • Koskosidis YA, Solomon WBPMM (1992) An optimization-based heuristic for vehicle routing and scheduling with soft time windows constraints. Transp Sci 26:69–85

    Article  MATH  Google Scholar 

  • Labadie N, Mansini R, Melechovský J, Calvo RW (2011) Hybridized evolutionary local search for the team orienteering problem with time windows. J Heuristics 17:729–753

    Article  MATH  Google Scholar 

  • Labadie N, Mansini R, Melechovský J, Calvo RW (2012) The team orienteering problem with time windows: an LP-based granular variable neighborhood search. Eur J Oper Res 220(1):15–27

    Article  MathSciNet  MATH  Google Scholar 

  • Lahyani R, Khemakhem M, Semet F (2016) A unified matheuristic for solving multi-constrained traveling salesman problems with profits. EURO J Comput Optim. doi:10.1007/s13675-016-0071-1

    MATH  Google Scholar 

  • Lin SW, Yu VF (2012) A simulated annealing heuristic for the team orienteering problem with time windows. Eur J Oper Res 217(1):94–107

    Article  ADS  MathSciNet  MATH  Google Scholar 

  • Lourenço H, Martin O, Stützle T (2003) Iterated local search. In: Glover F, Kochenberger GA (eds) Handbook of metaheuristics. International series in operations research and management science, vol 57. Kluwer, Dordrecht, pp 321–353

    Chapter  Google Scholar 

  • Mladenović N, Hansen P (1997) Variable neighborhood search. Comput Oper Res 24:1097–1100

    Article  MathSciNet  MATH  Google Scholar 

  • Montemanni R, Gambardella LM (2009) An ant colony system for team orienteering problem with time windows. Found Comput Decis Sci 34(4):287–306

    Google Scholar 

  • Montemanni R, Weyland D, Gambardella LM (2011) An enhanced ant colony system for the team orienteering problem with time windows. In: International symposium on computer science and society, pp 381–384

  • Ramesh R, Brown KM (1991) An efficient four-phase heuristic for the generalized orienteering problem. Comput Oper Res 18(2):151–165

    Article  MathSciNet  Google Scholar 

  • Righini G, Salani M (2009) Decremental state space relaxation strategies and initialization heuristics for solving the orienteering problem with time windows with dynamic programming. Comput Oper Res 36(4):1191–1203

    Article  MATH  Google Scholar 

  • Solomon MM (1987) Algorithms for the vehicle routing and scheduling problem with time window constraints. Oper Res 35:254–265

    Article  MathSciNet  MATH  Google Scholar 

  • Taillard ED, P Badeau MG, Guertin F, Potvin JY (1997) A tabu search heuristic for the vehicle routing problem with soft time windows. Transp Sci 5(2):109–122

    MATH  Google Scholar 

  • Tasgetiren M (2001) A genetic algorithm with an adaptive penalty function for the orienteering problem. J Econ Soc Res 4(2):1–26

    Google Scholar 

  • Thomadsen T, Stidsen T (2003) The quadratic selective travelling salesman problem. Informatics and Mathematical Modelling, Technical University of Denmark, DTU, Lyngby

    MATH  Google Scholar 

  • Tricoire F, Romauch M, Doerner KF, Hartl RF (2010) Heuristics for the multi-period orienteering problem with multiple time windows. Comput Oper Res 37(2):351–367

    Article  MathSciNet  MATH  Google Scholar 

  • Tricoire F, Romauch M, Doerner KF, Hartl RF (2013) Addendum to heuristics for the multi-period orienteering problem with multiple time windows. Comput Oper Res 40(5) (2013)

  • Tsiligirides T (1984) Heuristics methods applied to orienteering. J Oper Res Soc 35(9):351–367

    Article  Google Scholar 

  • Tunchan C (2014) An artificial bee colony algorithm approach for the team orienteering problem with time windows. Comput Ind Eng 74:270–290

    Article  Google Scholar 

  • Vansteenwegen P (2008) Planning in tourism and public transportation. Centre for Industriel Management Katholieke Universiteit Leuven, Leuven

    MATH  Google Scholar 

  • Vansteenwegen P, Oudheusden DV (2007) The mobile tourist guide: an OR opportunity. OR Insight 20(3):21–27

    Article  Google Scholar 

  • Vansteenwegen P, Souffriau W, Berghe GV, Oudheusden DV (2009) Iterated local search for the team orienteering problem with time windows. Comput Oper Res 36(12):3281–3290

    Article  MATH  Google Scholar 

  • Vidal T, Crainic TG, Gendreau M, Prins C (2015) Time-window relaxations in vehicle routing heuristics. J Heuristics 21(3):329–358

    Article  Google Scholar 

Download references

Authors' contributions

All authors contributed equally and significantly to this work. All authors drafted the manuscript. Both authors read and approved the final manuscript.

Acknowledgements

We acknowledge the contribution of two reviewers that have helped us to improve a previous version of this paper.

Competing interests

The authors declare that they have no competing interests.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hassan El Fahim.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Aghezzaf, B., Fahim, H.E. Iterated local search algorithm for solving the orienteering problem with soft time windows. SpringerPlus 5, 1781 (2016). https://doi.org/10.1186/s40064-016-3440-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40064-016-3440-6

Keywords