Author: Maxime Lenormand
Date: 2025-10-03

# Tutorial for TDLM

#### Maxime Lenormand

#### 2025-10-03

# Introduction

This tutorial aims to describe the different features of the R package `TDLM`. The main purpose of the `TDLM` package is to provide a rigorous framework for fairly comparing trip distribution laws and models (Lenormand et al., 2016). This general framework is based on a two-step approach for generating mobility flows by separating the trip distribution law, such as gravity or intervening opportunities, from the modeling approach used to generate flows from this law.

# A short note on terminology

This framework is part of the four-step travel model. It corresponds to the second step, called trip distribution, which aims to match trip origins with trip destinations. The model used to generate trips or flows, and more generally the degree of interaction between locations, is often referred to as a spatial interaction model. Depending on the research area, a matrix or a network formalism may be used to describe these spatial interactions. Origin-Destination matrices (or trip tables) are common in geography or transportation, while in statistical physics or complex systems studies, the term mobility networks is usually preferred.

# Origin–Destination matrix

The description of movements within a given area is represented by an Origin-Destination (OD) matrix. The area of interest is divided into \(n\) locations, and \(T_{ij}\) represents the volume of flows between location \(i\) and location \(j\). This volume typically corresponds to the number of trips or a commuting flow (i.e., the number of individuals living in \(i\) and working in \(j\)). The OD matrix is square, contains only positive values, and may have a zero diagonal (Figure 1).

Figure 1: Schematic representation of an Origin-Destination matrix.

# Aggregated inputs information

Three categories of inputs are typically considered to simulate an OD matrix (Figure 2). The masses and distances are the primary ingredients used to generate a matrix of probabilities based on a given distribution law. Thus, the probability \(p_{ij}\) of observing a trip from location \(i\) to location \(j\) depends on the masses, the demand at the origin (\(m_i\)), and the offer at the destination (\(m_j\)). Typically, population is used as a surrogate for demand and offer. The probability of movement also depends on the costs, which are based on the distance \(d_{ij}\) between locations or the number of opportunities \(s_{ij}\) between locations, depending on the chosen law (more details are provided in the next “Trip distribution laws” section). In general, the effect of the cost can be adjusted with a parameter.

The margins are used to generate an OD matrix from the matrix of probabilities while preserving the total number of trips (\(N\)), the number of outgoing trips (\(O_i\)), and/or the number of incoming trips (\(D_j\)) (more details are provided in the “Constrained distribution models” section).

Figure 2: Schematic representation of the aggregated inputs information.

# Trip distribution laws

The purpose of a trip distribution law is to estimate the probability \(p_{ij}\) that, out of all the possible travels in the system, there is one between location \(i\) and location \(j\). This probability is asymmetric in \(i\) and \(j\), as are the flows themselves. It takes the form of a square matrix of probabilities. This probability is normalized across all possible pairs of origins and destinations, such that \(\sum_{i,j=1}^n p_{ij} = 1\). Therefore, a matrix of probabilities can be obtained by normalizing any OD matrix (Figure 3).

Figure 3: Schematic representation of the matrix of probabilities.

As mentioned in the previous section, most trip distribution laws depend on the demand at the origin (\(m_i\)), the offer at the destination (\(m_j\)), and a cost to move from \(i\) to \(j\). There are two major approaches for estimating the probability matrix. The traditional gravity approach, in analogy with Newton’s law of gravitation, is based on the assumption that the amount of trips between two locations is related to their populations and decays according to a function of the distance \(d_{ij}\) between locations. In contrast to the gravity law, the laws of intervening opportunities hinge on the assumption that the number of opportunities \(s_{ij}\) between locations plays a more important role than the distance (Lenormand et al., 2016). This fundamental difference between the two schools of thought is illustrated in Figure 4.

Figure 4: Illustration of the fundamental difference between gravity and intervening opportunity laws.

It is important to note that the effect of the cost between locations (distance or number of opportunities) can usually be adjusted with a parameter, which can be calibrated automatically or by comparing the simulated matrix with observed data.

# Constrained distribution models

The purpose of the trip distribution models is to generate an OD matrix \(\tilde{T}=(\tilde{T}_{ij})\) by drawing at random \(N\) trips from the trip distribution law \((p_{ij})_{1 \leq i,j \leq n}\) respecting different level of constraints according to the model. We considered four different types of models in this package. As can be observed in Figure 5, the four models respect different level of constraints from the total number of trips to the total number of out-going and in-coming trips by locations (i.e. the margins).

Figure 5: Schematic representation of the constrained distribution models.

More specifically, the volume of flows \(\tilde{T}_{ij}\) is generated from the matrix of probability with multinomial random draws that will take different forms according to the model used (Lenormand et al., 2016). Therefore, since the process is stochastic, each simulated matrix is unique and composed of integers. Note that it is also possible to generate an average matrix from the multinomial trials.

# Goodness-of-fit measures

Finally, the trip distribution laws can be calibrated, and both the trip distribution laws and models can be evaluated by comparing a simulated matrix \(\tilde{T}\) with the observed matrix \(T\). These comparisons rely on various goodness-of-fit measures, which may or may not account for the distance between locations. These measures are described above.

## Common Part of Commuters (CPC)

\[\displaystyle CPC(T,\tilde{T}) = \frac{2\cdot\sum_{i,j=1}^n min(T_{ij},\tilde{T}_{ij})}{N + \tilde{N}}\]

(Gargiulo et al., 2012; Lenormand et al., 2012, 2016)

## Normalized Root Mean Square Error (NRMSE)

\[\displaystyle NRMSE(T,\tilde{T}) = \sqrt{\frac{\sum_{i,j=1}^n (T_{ij}-\tilde{T}_{ij})^2}{N}}\]

## Kullback–Leibler divergence (KS)

\[\displaystyle KL(T,\tilde{T}) = \sum_{i,j=1}^n \frac{T_{ij}}{N}\log\left(\frac{T_{ij}}{N}\frac{\tilde{N}}{\tilde{T}_{ij}}\right)\] (Kullback & Leibler, 1951)

## Common Part of Links (CPL)

\[\displaystyle CPL(T,\tilde{T}) = \frac{2\cdot\sum_{i,j=1}^n 1_{T_{ij}>0} \cdot 1_{\tilde{T}_{ij}>0}}{\sum_{i,j=1}^n 1_{T_{ij}>0} + \sum_{i,j=1}^n 1_{\tilde{T}_{ij}>0}}\] (Lenormand et al., 2016)

## Common Part of Commuters based on the disance (CPC_d)

Let us consider \(N_k\) (and \(\tilde{N}_k\)) the sum of observed (and simulated) flows at a distance comprised in the bin \([\mbox{bin_size} \cdot k-\mbox{bin_size}, \mbox{bin_size} \cdot k[\).

\[\displaystyle CPC_d(T,\tilde{T}) = \frac{2\cdot\sum_{k=1}^{\infty} min(N_{k},\tilde{N}_{k})}{N+\tilde{N}}\]

(Lenormand et al., 2016)

## Kolmogorv-Smirnov statistic and p-value (KS).

These measures, described in Massey (1951), are based on the observed and simulated flow distance distributions and are computed using the ks_test function from the Ecume package.

# Example of commuting in Kansas

## Data

In this example, we will use commuting data from US Kansas in 2000 to illustrate
the main functions of the package. The dataset comprises three tables providing information on commuting flows between the 105 US Kansas counties in 2000. The observed OD matrix od is a zero-diagonal square matrix of integers. Each element of the matrix represents the number of commuters between a pair of US Kansas counties.

    data(od)

    od[1:5, 1:5]

    ##       20001 20003 20005 20007 20009
    ## 20001     0    71     0     0     0
    ## 20003   236     0     0     0     0
    ## 20005     0     0     0     0     0
    ## 20007     0     0     0     0     8
    ## 20009     0     0     0    11     0

    dim(od)

    ## [1] 105 105

The aggregated data are composed of the distance matrix,

    data(distance)

    distance[1:5, 1:5]

    ##           20001     20003    20005    20007    20009
    ## 20001   0.00000  36.50943 182.9291 306.8503 308.8995
    ## 20003  36.50943   0.00000 146.4335 317.5593 303.2348
    ## 20005 182.92913 146.43350   0.0000 389.5330 319.5319
    ## 20007 306.85034 317.55926 389.5330   0.0000 139.0661
    ## 20009 308.89947 303.23478 319.5319 139.0661   0.0000

    dim(distance)

    ## [1] 105 105

and the masses and margins contained in the data.frame mass.

    data(mass)

    mass[1:10,]

    ##       Population Out_Commuters In_Commuters
    ## 20001      14385          1267         1343
    ## 20003       8110          1346          361
    ## 20005      16774          1065         1247
    ## 20007       5307           260          201
    ## 20009      28205          1129         1324
    ## 20011      15379           662          761
    ## 20013      10724          1148          984
    ## 20015      59482         14182         3579
    ## 20017       3030           681           93
    ## 20019       4359           486          180

    dim(mass)

    ## [1] 105   3

    mi <- as.numeric(mass[,1])
    names(mi) <- rownames(mass)

    mj <- mi

    Oi <- as.numeric(mass[,2])
    names(Oi) <- rownames(mass)

    Dj <- as.numeric(mass[,3])
    names(Dj) <- rownames(mass)

The data must always be based on the same number of locations sorted in the same
order. The function check_format_names can be used to verify the validity of all inputs before running the main functions of the package.

    check_format_names(vectors = list(mi = mi, mj = mj, Oi = Oi, Dj = Dj),
                       matrices = list(od = od, distance = distance),
                       check = "format_and_names")

    ## The inputs passed the format_and_names checks successfully!

Optional spatial information are also provided here. county is a spatial object containing the geometry of the 105 US Kansas counties in 2000.

    library(sf)

    data(county)

    county[1:10,]

    ## Simple feature collection with 10 features and 4 fields
    ## Geometry type: MULTIPOLYGON
    ## Dimension:     XY
    ## Bounding box:  xmin: -99.0334 ymin: 36.99796 xmax: -94.6139 ymax: 40.0006
    ## Geodetic CRS:  WGS 84
    ##         ID Longitude Latitude     Area                       geometry
    ## 1016 20001 -95.30137 37.88581 1307.667 MULTIPOLYGON (((-95.08805 3...
    ## 983  20003 -95.29334 38.21429 1512.337 MULTIPOLYGON (((-95.07771 3...
    ## 869  20005 -95.31288 39.53194 1125.682 MULTIPOLYGON (((-95.56751 3...
    ## 1064 20007 -98.68482 37.22888 2941.524 MULTIPOLYGON (((-98.52686 3...
    ## 962  20009 -98.75650 38.47904 2330.541 MULTIPOLYGON (((-99.03239 3...
    ## 1017 20011 -94.84928 37.85522 1653.609 MULTIPOLYGON (((-94.61413 3...
    ## 843  20013 -95.56416 39.82657 1480.469 MULTIPOLYGON (((-95.77332 3...
    ## 1011 20015 -96.83911 37.78125 3744.168 MULTIPOLYGON (((-96.52571 3...
    ## 974  20017 -96.59395 38.30205 2013.697 MULTIPOLYGON (((-96.81972 3...
    ## 1079 20019 -96.24535 37.15007 1669.418 MULTIPOLYGON (((-96.52495 3...

    plot(county)

coords and coords_xy are two dataframes providing longitude/latitude and X/Y coordinates for each location, respectively.

    coords[1:10,]

    ##       Longitude Latitude
    ## 20001 -95.30137 37.88581
    ## 20003 -95.29334 38.21429
    ## 20005 -95.31288 39.53194
    ## 20007 -98.68482 37.22888
    ## 20009 -98.75650 38.47904
    ## 20011 -94.84928 37.85522
    ## 20013 -95.56416 39.82657
    ## 20015 -96.83911 37.78125
    ## 20017 -96.59395 38.30205
    ## 20019 -96.24535 37.15007

    coords_xy[1:10,]

    ##               X       Y
    ## 20001 -10608899 4563329
    ## 20003 -10608005 4609773
    ## 20005 -10610183 4798171
    ## 20007 -10985547 4471108
    ## 20009 -10993524 4647367
    ## 20011 -10558574 4559025
    ## 20013 -10638154 4840804
    ## 20015 -10780080 4548659
    ## 20017 -10752789 4622229
    ## 20019 -10713984 4460066

## Extract Additional Spatial Information

The functions extract_distances, extract_opportunities, and extract_spatial_information
can be used to extract matrices of distances and the number of intervening opportunities.

The first function computes distances in kilometers between pairs of locations based on geographical coordinates. It can calculate either great-circle distances, using longitude/latitude coordinates and the Haversine formula

    haversine_d <- extract_distances(coords = coords,
                                     method = "Haversine")
    haversine_d[1:5, 1:5]

    ##           [,1]      [,2]     [,3]     [,4]     [,5]
    ## [1,]   0.00000  36.50943 182.9291 306.8503 308.8995
    ## [2,]  36.50943   0.00000 146.4335 317.5593 303.2348
    ## [3,] 182.92913 146.43350   0.0000 389.5330 319.5319
    ## [4,] 306.85034 317.55926 389.5330   0.0000 139.0661
    ## [5,] 308.89947 303.23478 319.5319 139.0661   0.0000

    distance[1:5, 1:5]

    ##           20001     20003    20005    20007    20009
    ## 20001   0.00000  36.50943 182.9291 306.8503 308.8995
    ## 20003  36.50943   0.00000 146.4335 317.5593 303.2348
    ## 20005 182.92913 146.43350   0.0000 389.5330 319.5319
    ## 20007 306.85034 317.55926 389.5330   0.0000 139.0661
    ## 20009 308.89947 303.23478 319.5319 139.0661   0.0000

or Euclidean distances based on X/Y coordinates

    xy_d <- extract_distances(coords = coords_xy,
                              method = "Euclidean")

    oldmar <- par()$mar
    par(mar = c(4.5, 6, 1, 1))
    plot(haversine_d, xy_d, xlim=c(0,900), ylim=c(0,900),
         type="p", pch=16, cex=2, lty=1, lwd=3,
         col="steelblue3", axes=FALSE, xlab="", ylab="")
    axis(1, cex.axis=1.2)
    axis(2, cex.axis=1.2, las=1)
    mtext("Haversine (km)", 1, line = 3.25, cex = 1.75)
    mtext("Euclidean (km)", 2, line = 4, cex = 1.75)
    box(lwd=1.5)

    par(mar = oldmar)

The second function computes the number of opportunities between pairs of locations. For a given pair of locations, the number of opportunities between the origin and the destination is based on the number of opportunities within a circle of radius equal to the distance between the origin and the destination, centered at the origin. The number of opportunities at the origin and the destination are not included. In our case, the number of inhabitants (\(m_i\)) is used as a proxy for the number of opportunities.

    sij <- extract_opportunities(opportunity = mi,
                                 distance = distance,
                                 check_names = TRUE)
    sij[1:5, 1:5]

    ##         20001   20003   20005   20007   20009
    ## 20001       0   16997 1445725 2358187 2363494
    ## 20003       0       0 1374401 2403828 2354815
    ## 20005 1311224 1240896       0 2454129 2346302
    ## 20007 1433163 1481954 2489482       0  634786
    ## 20009 1778443 1651945 1820549  344665       0

The last function takes as input a spatial object containing the geometry of the locations that can be handled by the sf package. It returns a matrix of great-circle distances between locations (expressed in km). An optional `id`
can also be provided to be used as names for the outputs.

    spi <- extract_spatial_information(county, id = "ID")

    sp_d <- spi$distance

    sp_d[1:5, 1:5]

    ##              20001        20003       20005       20007       20009
    ## 20001 0.0000000000 0.0003285808 0.001646171 0.003446635 0.003505694
    ## 20003 0.0003285808 0.0000000000 0.001317793 0.003531738 0.003473271
    ## 20005 0.0016461705 0.0013177925 0.000000000 0.004083384 0.003600990
    ## 20007 0.0034466353 0.0035317381 0.004083384 0.000000000 0.001252210
    ## 20009 0.0035056940 0.0034732710 0.003600990 0.001252210 0.000000000

    distance[1:5, 1:5]

    ##           20001     20003    20005    20007    20009
    ## 20001   0.00000  36.50943 182.9291 306.8503 308.8995
    ## 20003  36.50943   0.00000 146.4335 317.5593 303.2348
    ## 20005 182.92913 146.43350   0.0000 389.5330 319.5319
    ## 20007 306.85034 317.55926 389.5330   0.0000 139.0661
    ## 20009 308.89947 303.23478 319.5319 139.0661   0.0000

This function also allows extracting the surface area of each location (in square kilometers), which can be useful to calibrate the trip distribution
laws’ parameter value (see below).

    mean(spi$surface)

    ## [1] 2028.05

## Run functions

The main function of the package is run_law_model. The function has two sets of arguments, one for the law and another one for the model. The inputs (described above) necessary to run this function depends on the law (either the matrix of distances or number of opportunities can be used, or neither of them for the uniform law) and on the model and its associated constraints (number of trips, out-going trips and/or in-coming trips). The example below will generate three simulated ODs with the normalized gravity law with an exponential distance decay function (Lenormand et al., 2016) and the Doubly Constrained Model.

    res <- run_law_model(law = "NGravExp",
                         mass_origin = mi,
                         mass_destination = mj,
                         distance = distance,
                         opportunity = NULL,
                         param = 0.01,
                         write_proba = TRUE,

                         model = "DCM",
                         nb_trips = NULL,
                         out_trips = Oi,
                         in_trips = Dj,
                         average = FALSE,
                         nbrep = 3)

The output is an object of class `TDLM`. In this case it is a list of matrices composed of the three simulated matrices (`replication_1`, `replication_2` and `replication_3`), the matrix of probabilities (called `proba`) associated with the law and returned only if `write_proba = TRUE`. The objects of class `TDLM` contain a table `info` summarizing the simulation run.

    print(res)

    ##        Argument    Value
    ## 1           Law NGravExp
    ## 2         Model      DCM
    ## 3 #Replications        3
    ## 4   #Parameters        1
    ## 5     Parameter     0.01

    str(res)

    ## List of 5
    ##  $ info         :'data.frame':   5 obs. of  2 variables:
    ##   ..$ Argument: chr [1:5] "Law" "Model" "#Replications" "#Parameters" ...
    ##   ..$ Value   : chr [1:5] "NGravExp" "DCM" "3" "1" ...
    ##  $ replication_1: num [1:105, 1:105] 0 24 4 0 2 15 4 101 6 7 ...
    ##   ..- attr(*, "dimnames")=List of 2
    ##  $ replication_2: num [1:105, 1:105] 0 25 4 0 2 15 4 106 5 6 ...
    ##   ..- attr(*, "dimnames")=List of 2
    ##  $ replication_3: num [1:105, 1:105] 0 23 4 0 2 15 4 103 5 6 ...
    ##   ..- attr(*, "dimnames")=List of 2
    ##  $ proba        : num [1:105, 1:105] 0.00 4.31e-05 2.16e-05 3.90e-06 1.81e-05 ...
    ##   ..- attr(*, "dimnames")=List of 2
    ##  - attr(*, "class")= chr [1:2] "TDLM" "list"
    ##  - attr(*, "from")= chr "run_law_model"
    ##  - attr(*, "proba")= logi TRUE

This simulation run was based on one parameter value. It is possible to use a vector instead of a scalar for the `param` argument.

    res <- run_law_model(law = "NGravExp",
                         mass_origin = mi,
                         mass_destination = mj,
                         distance = distance,
                         opportunity = NULL,
                         param = c(0.01,0.02),
                         write_proba = TRUE,

                         model = "DCM",
                         nb_trips = NULL,
                         out_trips = Oi,
                         in_trips = Dj,
                         average = FALSE,
                         nbrep = 3)

In this case a list of list of matrices will be returned (one for each parameter value).

    print(res)

    ##        Argument    Value
    ## 1           Law NGravExp
    ## 2         Model      DCM
    ## 3 #Replications        3
    ## 4   #Parameters        2
    ## 5   Parameter 1     0.01
    ## 6   Parameter 2     0.02

    str(res)

    ## List of 3
    ##  $ info       :'data.frame': 6 obs. of  2 variables:
    ##   ..$ Argument: chr [1:6] "Law" "Model" "#Replications" "#Parameters" ...
    ##   ..$ Value   : chr [1:6] "NGravExp" "DCM" "3" "2" ...
    ##  $ parameter_1:List of 4
    ##   ..$ replication_1: num [1:105, 1:105] 0 23 4 0 3 15 4 102 5 7 ...
    ##   .. ..- attr(*, "dimnames")=List of 2
    ##   ..$ replication_2: num [1:105, 1:105] 0 23 4 0 2 15 4 103 5 6 ...
    ##   .. ..- attr(*, "dimnames")=List of 2
    ##   ..$ replication_3: num [1:105, 1:105] 0 24 4 0 2 15 4 105 5 6 ...
    ##   .. ..- attr(*, "dimnames")=List of 2
    ##   ..$ proba        : num [1:105, 1:105] 0.00 4.31e-05 2.16e-05 3.90e-06 1.81e-05 ...
    ##   .. ..- attr(*, "dimnames")=List of 2
    ##  $ parameter_2:List of 4
    ##   ..$ replication_1: num [1:105, 1:105] 0 53 2 0 0 39 1 77 5 8 ...
    ##   .. ..- attr(*, "dimnames")=List of 2
    ##   ..$ replication_2: num [1:105, 1:105] 0 57 2 0 0 38 1 76 5 7 ...
    ##   .. ..- attr(*, "dimnames")=List of 2
    ##   ..$ replication_3: num [1:105, 1:105] 0 53 2 0 0 38 1 77 5 7 ...
    ##   .. ..- attr(*, "dimnames")=List of 2
    ##   ..$ proba        : num [1:105, 1:105] 0.00 8.13e-05 8.17e-06 7.10e-07 3.16e-06 ...
    ##   .. ..- attr(*, "dimnames")=List of 2
    ##  - attr(*, "class")= chr [1:2] "TDLM" "list"
    ##  - attr(*, "from")= chr "run_law_model"
    ##  - attr(*, "proba")= logi TRUE

It is also important to note that the radiation law and the uniform law are free of parameter.

    res <- run_law_model(law = "Rad",
                         mass_origin = mi,
                         mass_destination = mj,
                         distance = NULL,
                         opportunity = sij,
                         param = NULL,
                         write_proba = TRUE,

                         model = "DCM",
                         nb_trips = NULL,
                         out_trips = Oi,
                         in_trips = Dj,
                         average = FALSE,
                         nbrep = 3)

    print(res)

    ##        Argument Value
    ## 1           Law   Rad
    ## 2         Model   DCM
    ## 3 #Replications     3

The argument `average` can be used to generate an average matrix based on a multinomial distribution (based on an infinite number of drawings). In this case, the models’ inputs can be either positive integer or real numbers and the output (`nbrep = 1` in this case) will be a matrix of positive real numbers.

    res$replication_1[1:10,1:10]

    ##       [,1] [,2] [,3] [,4] [,5] [,6] [,7] [,8] [,9] [,10]
    ##  [1,]    0   32    0    0    0  121    0    1    0     0
    ##  [2,]  568    0    0    0    0   22    0    0    0     0
    ##  [3,]    0    0    0    0    0    0  199    0    0     0
    ##  [4,]    0    0    0    0    0    0    0    0    0     0
    ##  [5,]    0    0    0    1    0    0    0    3    0     0
    ##  [6,]   18    2    0    0    0    0    0    0    0     0
    ##  [7,]    0    0  200    0    0    0    0    0    0     0
    ##  [8,]    4    1    1    1   10    5    1    0    0     1
    ##  [9,]    0    0    0    0    0    0    0   39    0     0
    ## [10,]    0    0    0    0    0    0    0   13    0     0

    res <- run_law_model(law = "Rad",
                         mass_origin = mi,
                         mass_destination = mj,
                         distance = NULL,
                         opportunity = sij,
                         param = NULL,
                         write_proba = TRUE,

                         model = "DCM",
                         nb_trips = NULL,
                         out_trips = Oi,
                         in_trips = Dj,
                         average = TRUE,
                         nbrep = 3)

    print(res)

    ##        Argument       Value
    ## 1           Law         Rad
    ## 2         Model         DCM
    ## 3 #Replications 1 (average)

    res$replication_1[1:10,1:10]

    ##               [,1]         [,2]         [,3]         [,4]         [,5]
    ##  [1,] 4.207454e-04 3.248924e+01 1.629984e-01 0.0169209490 1.523725e-01
    ##  [2,] 5.645506e+02 6.155812e-04 1.486180e-01 0.0133929974 1.262074e-01
    ##  [3,] 8.174148e-02 2.927128e-02 8.564946e-04 0.0180562693 1.785403e-01
    ##  [4,] 5.866220e-03 1.762770e-03 5.461852e-03 0.0006206272 1.984250e-01
    ##  [5,] 7.824940e-02 2.902253e-02 2.083665e-01 1.3841229993 7.860351e-04
    ##  [6,] 1.794519e+01 2.896778e+00 1.227317e-01 0.0118216041 1.064531e-01
    ##  [7,] 4.854529e-02 1.825077e-02 2.003666e+02 0.0121155517 1.240133e-01
    ##  [8,] 4.235287e+00 1.150834e+00 1.817298e+00 1.5952317911 1.087001e+01
    ##  [9,] 1.701860e-02 6.442397e-03 1.358021e-02 0.0027705322 2.718136e-02
    ## [10,] 3.657437e-01 9.929259e-03 1.029943e-02 0.0078265447 2.624542e-02
    ##               [,6]         [,7]         [,8]         [,9]        [,10]
    ##  [1,] 1.206594e+02 8.830093e-02  1.637304888 0.0120698542 0.0777923728
    ##  [2,] 2.261365e+01 1.297312e-01  0.862290746 0.0050699294 0.0060667099
    ##  [3,] 1.934135e-01 1.973623e+02  0.918724724 0.0061614808 0.0053164987
    ##  [4,] 9.469349e-03 6.169547e-03  0.278155220 0.0008433002 0.0012892865
    ##  [5,] 1.033249e-01 2.460352e-01  3.462295645 0.0158169340 0.0150487684
    ##  [6,] 5.850044e-04 1.180099e-01  0.752499705 0.0038974570 0.0092130934
    ##  [7,] 1.138611e-01 2.549294e-03  0.633540548 0.0040869895 0.0021031775
    ##  [8,] 5.040588e+00 1.982879e+00  0.002650424 0.7993806174 1.0370497229
    ##  [9,] 2.296625e-02 1.230871e-02 39.049317001 0.0005691793 0.0015470504
    ## [10,] 6.732294e-02 1.102089e-02 13.987963900 0.0025478503 0.0002716179

The functions run_law and run_model have been designed to run only one of the two components of the two-step approach. They function the same as a run_law_model, but it is worth noting that only inter-location flows are considered for the distribution laws, meaning that the matrix of probabilities (and associated simulated OD matrices) generated by a given distribution law with run_law_model or run_law is a zero-diagonal matrix. Nevertheless, it is possible to generate intra-location flows with run_model taking any kind of matrix of probabilities as input.

## Parameters’ calibration & models’ evaluation

The package contains two function to help calibrating and evaluating the model. The function gof computes goodness-of-fit measures between observed and simulated OD matrices and the function calib_param that estimates the optimal parameter value for a given law and a given spatial distribution of location based on the Figure 8 in (Lenormand et al., 2016).

Let us illustrate the trip distribution laws and models’ calibration with the the normalized gravity law with an exponential distance decay function and the Doubly Constrained Model. Based on the average surface area of the Kansas counties (in square kilometers) it seems that the optimal parameter value of the normalized gravity law with an exponential distance decay function (as described in (Lenormand et al., 2016)) for commuting in US Kansas counties is around 0.085.

    print(calib_param(av_surf = mean(spi$surface), law = "NGravExp"))

    ## [1] 0.08521097

This is just an estimation that help us to identify the potential range of parameter value, so in order to rigorously calibrate and evaluate the trip distribution law and model we need to compute the goodness-of-fit measure for a wide range of parameter values.

    res <- run_law_model(law = "NGravExp",
                         mass_origin = mi,
                         mass_destination = mj,
                         distance = distance,
                         opportunity = NULL,
                         param = seq(0.05,0.1,0.005),
                         write_proba = TRUE,

                         model = "DCM",
                         nb_trips = NULL,
                         out_trips = Oi,
                         in_trips = Dj,
                         average = FALSE,
                         nbrep = 3)

    calib <- gof(sim = res, obs = od, measures = "all", distance = distance)

    print(calib)

    ##       Parameter Parameter_value    Simulation       CPC     NRMSE         KL
    ## 1   parameter_1            0.05 replication_1 0.8164335 10.525008 0.12955443
    ## 2   parameter_1            0.05 replication_2 0.8162738 10.534538 0.12958802
    ## 3   parameter_1            0.05 replication_3 0.8163985 10.499796 0.12955027
    ## 4   parameter_2           0.055 replication_1 0.8316371  9.420812 0.11322662
    ## 5   parameter_2           0.055 replication_2 0.8318168  9.392060 0.11321047
    ## 6   parameter_2           0.055 replication_3 0.8315822  9.413696 0.11335220
    ## 7   parameter_3            0.06 replication_1 0.8439308  8.646286 0.09828737
    ## 8   parameter_3            0.06 replication_2 0.8439607  8.648914 0.09874333
    ## 9   parameter_3            0.06 replication_3 0.8440456  8.638916 0.09820255
    ## 10  parameter_4           0.065 replication_1 0.8521316  8.163863 0.08815242
    ## 11  parameter_4           0.065 replication_2 0.8520367  8.176005 0.08801753
    ## 12  parameter_4           0.065 replication_3 0.8521865  8.162036 0.08792731
    ## 13  parameter_5            0.07 replication_1 0.8553410  7.954543 0.08023846
    ## 14  parameter_5            0.07 replication_2 0.8552611  7.952855 0.08023613
    ## 15  parameter_5            0.07 replication_3 0.8552362  7.969547 0.08030059
    ## 16  parameter_6           0.075 replication_1 0.8557303  7.956957 0.07924403
    ## 17  parameter_6           0.075 replication_2 0.8556405  7.959168 0.07941446
    ## 18  parameter_6           0.075 replication_3 0.8556405  7.960848 0.07932494
    ## 19  parameter_7            0.08 replication_1 0.8551463  8.108455 0.07437718
    ## 20  parameter_7            0.08 replication_2 0.8549567  8.120327 0.07432752
    ## 21  parameter_7            0.08 replication_3 0.8551763  8.103802 0.07409877
    ## 22  parameter_8           0.085 replication_1 0.8530699  8.383530 0.07380094
    ## 23  parameter_8           0.085 replication_2 0.8530899  8.382027 0.07374435
    ## 24  parameter_8           0.085 replication_3 0.8531648  8.373457 0.07376814
    ## 25  parameter_9            0.09 replication_1 0.8497806  8.714116 0.07542984
    ## 26  parameter_9            0.09 replication_2 0.8498355  8.710489 0.07524595
    ## 27  parameter_9            0.09 replication_3 0.8498655  8.708825 0.07521883
    ## 28 parameter_10           0.095 replication_1 0.8463516  9.099597 0.08102615
    ## 29 parameter_10           0.095 replication_2 0.8463466  9.093974 0.08087552
    ## 30 parameter_10           0.095 replication_3 0.8462767  9.099519 0.08108317
    ## 31 parameter_11             0.1 replication_1 0.8424384  9.480759 0.08345369
    ## 32 parameter_11             0.1 replication_2 0.8422038  9.497604 0.08362152
    ## 33 parameter_11             0.1 replication_3 0.8422737  9.487401 0.08345155
    ##          CPL     CPC_d    KS_stat   KS_pval
    ## 1  0.6602517 0.8954464 0.07407648 0.9998057
    ## 2  0.6594221 0.8952917 0.07416133 0.9998012
    ## 3  0.6595902 0.8954714 0.07401159 0.9998104
    ## 4  0.6709945 0.9155615 0.05097156 1.0000000
    ## 5  0.6715215 0.9156164 0.05098654 1.0000000
    ## 6  0.6711723 0.9155166 0.05112130 1.0000000
    ## 7  0.6727961 0.9318183 0.03125577 1.0000000
    ## 8  0.6735135 0.9317784 0.03121085 1.0000000
    ## 9  0.6722507 0.9318333 0.03127075 1.0000000
    ## 10 0.6724817 0.9430937 0.03476967 1.0000000
    ## 11 0.6732394 0.9430538 0.03476468 1.0000000
    ## 12 0.6732394 0.9429739 0.03476967 1.0000000
    ## 13 0.6736719 0.9496474 0.03835845 1.0000000
    ## 14 0.6746495 0.9495376 0.03843332 1.0000000
    ## 15 0.6740654 0.9494028 0.03848323 1.0000000
    ## 16 0.6716867 0.9481500 0.04456268 1.0000000
    ## 17 0.6724917 0.9481100 0.04452275 1.0000000
    ## 18 0.6716867 0.9480751 0.04453274 1.0000000
    ## 19 0.6631579 0.9408926 0.05049739 1.0000000
    ## 20 0.6625387 0.9407877 0.05046744 1.0000000
    ## 21 0.6629492 0.9409425 0.05049739 1.0000000
    ## 22 0.6513849 0.9329563 0.05751521 1.0000000
    ## 23 0.6513849 0.9328565 0.05755514 0.9999999
    ## 24 0.6513849 0.9328615 0.05749525 1.0000000
    ## 25 0.6413008 0.9257688 0.06327522 0.9999989
    ## 26 0.6408588 0.9257538 0.06339501 0.9999988
    ## 27 0.6408588 0.9257738 0.06334510 0.9999989
    ## 28 0.6357616 0.9187110 0.06820167 0.9999915
    ## 29 0.6350679 0.9185613 0.06832645 0.9999910
    ## 30 0.6353097 0.9186212 0.06830150 0.9999911
    ## 31 0.6237724 0.9121225 0.07371211 0.9999465
    ## 32 0.6242383 0.9120576 0.07368715 0.9999469
    ## 33 0.6237724 0.9120127 0.07378698 0.9999452

All the necessary information is stored in the object calib, most of the goodness-of-fit measures agree on a parameter value of 0.075 in that case with an associated average Common Part of Commuter equal to 85.6%.

    cpc <- aggregate(calib$CPC, list(calib$Parameter_value), mean)[,2]

    oldmar <- par()$mar
    par(mar = c(4.5, 6, 1, 1))
    plot(seq(0.05,0.1,0.005), cpc, type="b", pch=16, cex=2, lty=1, lwd=3,
         col="steelblue3", axes=FALSE, xlab="", ylab="")
    axis(1, cex.axis=1.2)
    axis(2, cex.axis=1.2, las=1)
    mtext("Parameter value", 1, line = 3.25, cex = 1.75)
    mtext("Common Part of Commuters", 2, line = 4, cex = 1.75)
    box(lwd=1.5)

    par(mar = oldmar)

# Reference

Gargiulo F, Lenormand M, Huet S & Baqueiro Espinosa O (2012) Commuting network model: Getting to the essentials. Journal of Artificial Societies and Social Simulation 15, 13.
Kullback S & Leibler RA (1951) On Information and Sufficiency. The Annals of Mathematical Statistics 22, 79–86.
Lenormand M, Bassolas A & Ramasco JJ (2016) Systematic comparison of trip distribution laws and models. Journal of Transport Geography 51, 158–169.
Lenormand M, Huet S, Gargiulo F & Deffuant G (2012) A Universal Model of Commuting Networks. PLoS ONE 7, e45985.
Massey FJ (1951) The Kolmogorov-Smirnov test for goodness of fit. Journal of the American Statistical Association 46, 68–78.