extfieldsofstudy:
Computer Science
Mathematics
Physics

s2fieldsofstudy:
Computer Science
Mathematics

text:
Machine learning moment closure models for the radiative transfer equation II: enforcing global hyperbolicity in gradient based closures

This is the second paper in a series in which we develop machine learning (ML) moment closure models for the radiative transfer equation (RTE). In our previous work \cite{huang2021gradient}, we proposed an approach to directly learn the gradient of the unclosed high order moment, which performs much better than learning the moment itself and the conventional $P_N$ closure. However, the ML moment closure model in \cite{huang2021gradient} is not able to guarantee hyperbolicity and long time stability. We propose in this paper a method to enforce the global hyperbolicity of the ML closure model. The main idea is to seek a symmetrizer (a symmetric positive definite matrix) for the closure system, and derive constraints such that the system is globally symmetrizable hyperbolic. It is shown that the new ML closure system inherits the dissipativeness of the RTE and preserves the correct diffusion limit as the Knunsden number goes to zero. Several benchmark tests including the Gaussian source problem and the two-material problem show the good accuracy, long time stability and generalizability of our globally hyperbolic ML closure model.

Introduction
In this paper we introduce an extension to our previous work on ML closures for radiative transfer modeling [20]. The new approach offers long time stability by ensuring mathematical consistency between the closure and the macroscopic model. Further, the numerical results in section 4 demonstrate the plausibility of capturing kinetic effects in a moment system with a handful of moments and an appropriate closure model.
The study of radiative transfer is of vital importance in many fields of science and engineering including astrophysics [35], heat transfer [24], and optical imaging [23]. The fundamental equation describing radiative transfer is an integro-differential equation, termed as the radiative transfer equation (RTE). Nevertheless, in most cases, any mesh based numerical discretization of the RTE equation leads to unacceptable computational costs due to the curse of dimensionality.
Moment methods study the evolution of a finite number of moments of the specific intensity in the RTE. Typically, the evolution of a lower-order moment depends on a higher-order moment, leading to what is known as the moment closure problem. Hence, one has to introduce suitable closure relations that relates the highest order moment included with the lower order moments in order to get a closed system of equations. Many moment closure models have been developed, including the P N model [8]; the variable Eddington factor models [28,33]; the entropy-based M N models [19,2,1]; the positive P N models [18]; the filtered P N models [32,25]; the B 2 models [3]; and the M P N model [12,13,29].
In moment closure problems, hyperbolicity is a critical issue, which is essential for a system of first-order partial differential equations (PDEs) to be well-posed [38]. The pioneering work on the moment closure for the gas kinetic theory by Grad in [15] is the most basic one among the moment models. However, it was discovered in [7] that the equilibrium is on the boundary of the hyperbolicity region for the Grad's 13-moment model in the three-dimensional case. Due to such a deficiency, the application of the moment method is severely restricted. This issue also attracts a lot of attention, with many papers in the literature focusing on the development of globally hyperbolic moment systems [6,12,13,29].
The traditional trade off in introducing a closure relation and solving a moment model instead of a kinetic equation is generic accuracy verses practical computability. However, thanks to the rapid development of machine learning (ML) and data-driven modeling [5,36,16], a new approach to solve the moment closure problem has emerged based on ML [17,37,21,4,30,40,31,20].
This approach offers a path for multi-scale problems that is relatively unique, promising to capture kinetic effects in a moment model with only a handful of moments. For the detailed literature review, we refer readers to [20]. We only remark that most of the works mentioned above are not able to guarantee hyperbolicity or long time stability, except the work in [21]. In [21], based on the conservation-dissipation formalism [43] of irreversible thermodynamics, the authors proposed a stable ML closure model with hyperbolicity and Galilean invariance for the Boltzmann BGK equation. Nevertheless, their model is limited to one extra non-equilibrium variable and it is still not clear how to generalize to arbitrary number of moments.
The work in this paper is a continuation of the previous work in [20], where we proposed to directly learn a closure that relates the gradient of the highest order moment to gradients of lower order moments. This new approach is consistent with the exact closure we derived for the free streaming limit and also provides a natural output normalization [20]. A variety of numerical tests show that the ML closure model in [20] has better accuracy than an ML closure based on learning a relation between the moments, as opposed to a relation between the gradients, and the conventional P N closure [20]. However, it is not able to guarantee hyperbolicity and long time simulations are not always satisfactory. Consequently, the focus of this work is to develop a method to enforce global hyperbolicity of the ML closure model. The main idea is motivated by the observation that the coefficient matrix for the P N closure is a tridiagonal matrix with positive off-diagonal entries. This indicates the existence of a diagonal symmetrizer matrix such that the P N closure is symmetrizable hyperbolic. Motivated by this observation, we propose to only keep the last several components in the ansatz, see equation (2.4) in Section 2.1, and seek a symmetrizer, which is a symmetric positive definite (SPD) matrix, of a block diagonal form. For degrees of freedom no larger than four in the ansatz, relating the gradient of the (N + 1) th moment to the gradient of the N th , (N − 1) th , (N − 2) th , and (N − 3) th moments, we derive constraints to guarantee the hyperbolicity of the ML closure model, see Theorem 2.1 in Section 2.1. Moreover, due to the block diagonal structure of the symmetrizer, we show that the ML closure system also satisfies the structural stability condition in [41] when taking into account the relaxation effects of the source terms, see Theorem 2.4 in Section 2.1. This condition characterises the dissipation feature of the moment closure system and is analogous to the H-theorem for the Boltzmann equation. We also consider our moment closure system under a diffusive scaling and formally show that our model preserves the correct diffusion limit as the Knunsden number goes to zero. The justification of the formal asymptotic analysis could be rigorously verified [34,27], with the aid of the structural stability condition. We also remark that, unlike [21], the work in this paper constructs ML closure models that are hyperbolic with an arbitrary number of moments. We numerically tested that the hyperbolic ML closure model has good accuracy in a variety of numerical examples. Moreover, the non-hyperbolic ML closure model in [20] blows up for long time simulations, while the hyperbolic one remains stable and has good accuracy.
The remainder of this paper is organized as follows. In Section 2, we introduce the hyperbolic ML moment closure model and discuss the diffusion limit of the model. In Section 3, we present the details in the training of the neural networks. The effectiveness of our ML closure model is demonstrated through extensive numerical results in Section 4. Some concluding remarks are given in Section 5.

ML moment closure for radiative transfer equation
In this section, we first review the ML moment closure method for the RTE in slab geometry proposed in [20] and propose our approach to enforce the hyperbolicity of the ML moment closure method. We then formally show that the resulting closure model can capture the correct diffusion limit.

Hyperbolic ML closure model
We consider the time-dependent RTE for a gray medium in slab geometry: Here, f = f (x, v, t) is the specific intensity of radiation. The variable v ∈ [−1, 1] is the cosine of the angle between the photon velocity and the x-axis. σ s = σ s (x) ≥ 0 and σ a = σ a (x) ≥ 0 are the scattering and absorption coefficients.
Denote the k-th order Legendre polynomial by P k = P k (x). Define the k-th order moment by Multiplying by P k (v) on both sides of (2.1) and integrating over v ∈ [−1, 1], we derive the moment equations: The learned gradient approach proposed in [20] is to find a relation between ∂ x m N +1 and the gradients on lower order moments: approximated by a neural network and learned from data. In this way, we obtain a quasi-linear first-order systems. This approach is shown to have uniform accuracy in the optically thick regime, intermediate regime and the optically thin regime. Moreover, the accuracy of this gradient-based model is much better than the approach based on creating a ML closure directly trained to match the moments, as well as the conventional P N closure. However, the learned gradient model exhibits numerical instability due to the loss of hyperbolicity [20]. This severely restricts the application of this model, especially for long time simulations.
The main idea of this work is to enforce the hyperbolicity by demanding that the coefficient matrix of the closure system A is real diagonizable. For this purpose, we seek a SPD matrix A 0 (also called a symmetrizer) such that A 0 A is a symmetric matrix. Namely, the system is symmetrizable hyperbolic, see the details in Appendix A. This places certain constraints on the functions N i .
Plugging (2.4) into the moment closure system, we have: Then, we can write down the coefficient matrix of this moment closure system: We first observe that, for the P N closure, i.e. when N j = 0 for 0 ≤ j ≤ N , A is a tridiagonal matrix with positive off-diagonal entries. In this case, A 0 can be taken as a diagonal matrix: and A 0 A is a tridiagonal symmetric matrix: Inspired by this observation, we propose to first investigate the case when the ansatz is given by only the last (k + 1) components where k is a parameter and k ≤ N . We will find a SPD matrix A 0 of the form With some algebraic calculation (details given in the appendix), when k = 3, we can derive the constraints explicitly as shown in the following theorem.
where a i has been specified in (2.6). If the coefficients a i for i = N − 3, N − 2, N − 1, N satisfy the following constraints: equivalent to the following constraints on N i : Proof. The proof is given in Appendix B.
Corollary 2.2. If we keep only 3 degrees of freedoms by setting a N −3 = 0, the constraint (2.12) reduces to 15) and the equivalent constraint (2.13) reduces to If we further set a N −3 = a N −2 = 0 by taking 2 degrees of freedoms, the constraint (2.12) reduces to a N −1 > 0, (2.17) and the equivalent constraint (2.13) reduces to In this case, the coefficient matrix A is a tridiagonal matrix with positive off-diagonal entries, which is real diagonalizable.
Remark 2.3. In principle, one could generalize the result in Theorem 2.1 to more than 4 degrees of freedom, by following the same lines in the proof given in Appendix B. However, the constraints for hyperbolicity will be a set of implicit inequalities. How to incorporate the implicit constraint into the architecture of the neural network would be an interesting topic to explore.
Besides the hyperbolicity for the convection term, one may also be interested in the relaxation effect of the source term. In this regard, the related property is the structural stability condition proposed in [41], which includes the constraints on the convection term, collision term, and the coupling of both. This stability condition is shown to be critical for the existence of the solutions [34], and satisfied by many moment closure systems [11]. In addition, the structural stability condition to the moment systems is same as H-theorem to the Boltzmann equation, which characterizes the dissipation property of the moment systems. For the convenience of the reader, we review the structural stability condition in Appendix C. It is easy to show that our new ML moment closure system also satisfied the structural stability condition: Theorem 2.4. For k = 3 and N ≥ 3, if the constraint (2.12) (or equivalently (2.13)) is satisfied, then the ML moment closure system with the closure relation (2.9) satisfies the structural stability condition in [41].
Proof. We only prove for the case σ a = 0. The other case can be proven by following the same line.
Denote Q = Q(U ) the source term of the closure system and Q U = ∂Q ∂U . Then we can compute Here, C = diag(0, σ s I N −3 ) and I r denote the identity matrix of order r. Notice that A 0 Q U is a symmetric negative semi-definite matrix. Then the structural stability condition can be easily checked for this moment closure system by taking P to be a scalar matrix in Appendix C.

Diffusion limit
In this part, we show formally that the hyperbolic ML moment closure model has the correct diffusion limit. Consider the RTE under a diffusive scaling: where ε > 0 denotes the Knudsen number, which is the ratio of mean free path of particles to the characteristic length. It is well known that as ε → 0, the kinetic transport equation (2.20) will converge to the diffusion limit-macroscopic model: where m 0 is the zeroth-order moment of f . For the RTE under a diffusive scaling (2.20), the corresponding moment closure equation is: Next, we formally show that the ML moment closure model (2.22) with N ≥ 3 converges to the diffusion limit (2.21) as ε → 0. We expand m k for k = 0, · · · , 2 as: and plug into the first three equations of (2.22). Collecting the O(ε) term of the first equation, we Collecting the O(1) term of the second equation, we have 1 . Combining the above three relations, we eventually reach: This indicates that the leading-order term of m 0 satisfies the diffusion equation (2.21).
To justify the above formal asymptotic analysis, it turns out that the structural stability condition is essential. Indeed, under the structural stability condition, one can rigorously prove that the solution of the ML moment closure model will converge to that of the macroscopic model (2.21) as ε goes to 0 [34,27], if the constraint (2.12) (or equivalently (2.13)) is satisfied and the neural network in (2.22) satisfies some regularity conditions. Although the regularity of the neural network seems not easy to be validated, we will show numerically in Section 4 that our hyperbolic ML closure model can capture the correct diffusion limit.

Training of the neural network
In this section, we provide details of the training of the proposed neural network that enforces the constraint (2.12) (or equivalently (2.13)) for the hyperbolicity for the case when k = 3. We design a fully-connected neural network denoted by M : R N +1 → R 4 with the input being the lower order moments (m 0 , m 1 , · · · , m N ) and the output being M = (M 1 , M 2 , M 3 , M 4 ). Then, we do the following post-processing to the output of the neural network: where h is the function defined in (2.14). Here σ : R → R is a positive function, i.e., σ(x) > 0 for any x ∈ R. We test several positive functions to enforce this constraint, including exponential function, ReLU (Rectified Linear Unit) function, softplus function and square function. Our numerical tests show that the neural network with σ to be the softplus function has the smallest L 2 error in the training data.
In the numerical implementation, we take the number of layers to be 6 and the number of nodes to be 256 in the fully-connected neural network and use the hyperbolic tangent activation function.
Other hyperparameters in the training are the same as those in [20]. The training data comes from numerically solving the RTE using the space-time discontinuous Galerkin (DG) method [9,10] with a range of initial conditions in the form of truncated Fourier series and different scattering and absorption coefficients which are constants over the computational domain. We train the neural network with 100 different initial data. For each initial data, we run the numerical solver up to t = 1. The other parameters are the same as in [20].

Numerical results
In this section, we show the performance of our ML closure model on a variety of benchmark tests, including problems with constant scattering and absorption coefficients, Gaussian source problems and two-material problems. The main focus of the tests is on the comparison of hyperbolic ML closure (termed as "hyperbolic closure") with k = 3, ML closure with learning gradient in [20] (termed as "non-hyperbolic closure") with k = N , and the classical P N closure [8].
In all numerical examples, we take the physical domain to be the unit interval [0, 1] and periodic boundary conditions are imposed. To numerically solve the moment closure system, we apply the fifth-order finite difference WENO scheme [22] with a Lax-Friedrichs flux splitting for the spatial discretization, and the third order strong-stability-preserving Runge-Kutta (RK) scheme [39] for the time discretization. We take the grid number in space to be N x = 256. For the hyperbolic ML closure model, the CFL condition is taken to be ∆t = 0.8∆x/c where c denote the maximum eigenvalues in all the grid points, and the penalty constant in the Lax-Friedrichs numerical flux α LF = c. For the non-hyperbolic ML closure model, we impose larger numerical diffusion by taking the penalty constant in the Lax-Friedrichs numerical flux α LF = 5 and fixing ∆t = 0.1∆x [20].  system (N = 6). It is observed that, at t = 0.5, the two ML moment closures agree well with the RTE, except that some minor oscillations appear in the non-hyperbolic ML closure. At t = 1, the solutions of non-hyperbolic ML moment closure blow up, while the hyperbolic one stays stable and has good agreement with the RTE. As a comparison, the P N closure has large deviations from the exact solution at both t = 0.5 and t = 1.
In Figure 4.2, we display the log-log scatter plots of the relative L 2 error versus the scattering coefficient for N = 6. We observe that, at t = 0.5, both ML closures have better accuracy than the P N closure. Moreover, in the optically thick regime, all the closures perform well. At t = 1, the numerical solutions of the non-hyperbolic ML moment closure blow up at some data points, while the hyperbolic one still has good accuracy.
In    Results obtained by the hyperbolic closure.
closure system and the solution generated by the RTE in the optically thin regime (σ s = σ a = 1).
We observe that the hyperbolic closure generates good predictions in the long time simulation up to t = 10. We also display the maximum eigenvalues in all the grid points during the time evolution in Figure 4.3 (b). It is observed that the eigenvalues are always real numbers, which validates the hyperbolicity feature of the closure system. However, the eigenvalues could be as large as four during the time evolution, which violates the physical characteristic speed of 1 in the RTE. This also results in smaller time step size in the simulation of the closure system. It is unclear how to preserve the physical characteristic speed in the moment closure system in this setting.
Example 4.2 (Gaussian source problem). In this example, we investigate the RTE with the initial condition to be Gaussian distribution in the physical domain, named Gaussian source problem in literature [14,12]: In this test, we take c 1 = 0.5, c 2 = 2.5, x 0 = 0.5 and θ = 0.01.
In Figure 4.4, we present the results obtained using various closure models. We observe good agreement between the two ML closure model and the kinetic model at t = 1, while the P N model has large deviations from the kinetic model. Moreover, the non-hyperbolic closure is more accurate than the hyperbolic closure, perhaps due to the fact that the non-hyperbolic closure has larger k values and thus can approximate the closure better. The solution of the non-hyperbolic ML closure model blows up at t = 2, while the hyperbolic ML model stays stable and is more accurate than the P N closure. Although the deviation of the hyperbolic ML model "looks" large in  respectively. This again illustrates that the hyperbolicity is an essential property in the ML closure model. Example 4.3 (two-material problem). In this example, we consider the two-material problem [26].
The numerical results are shown in Figure 4.5. The gray part is in the optically thin regime and the other part is in the intermediate regime. We observe that the two ML closure models are more accurate than the P N closure at t = 0.5 and the hyperbolic ML closure is slightly better than the non-hyperbolic one. At t = 1, the hyperbolic ML closure still agrees well with the kinetic model.
Large deviations exist for the P N closure in the optically thin regime and severe oscillations occur for the non-hyperbolic ML closure.

Concluding remarks
In this paper, we propose a method to enforce the global hyperbolicity of the ML closure model.
We find a symmetrizer (a symmetric positive definite matrix) for the closure system, and derive constraints that guarantee the system is globally symmetrizable hyperbolic. Moreover, we show that the closure system also inherits the dissipativeness of the RTE by checking the structural stability condition. A variety of benchmark tests including Gaussian source problem and the two-material problem show good accuracy, correct diffusion limit and generalization ability of our ML closure model. The new approach also offers long time stability by ensuring mathematical consistency between the closure system and the macroscopic model. Further, the new method demonstrates the plausibility of capturing kinetic effects in a moment system with a handful of moments and an appropriate closure model.
There are several issues that are worthy of further investigations. First, one could in principle generalize the result in Theorem 2.1 to more than 4 degrees of freedom, by following the same lines in the proof given in Appendix B. In this general case, the hyperbolicity constraints will be a set of implicit inequalities. How to incorporate the constraint of implicit inequalities into the architecture of the neural network would be an interesting topic to explore. Moreover, the moment closure model is expected to have better accuracy with more degrees of freedom. Another topic is that the characteristic speed of the current model may exceed the physical bound, as we observed in the numerical tests. This unphysical characteristic speed results in a small time step size in the computation, and is something we would like to address in our future work. Another interesting topic is to extend the current approach to the two dimensional case. These issues constitute the body of our ongoing work.

Acknowledgment
We thank Michael M. Crockatt from Sandia National Laboratories for providing a numerical solver for the radiative transfer equations. We also would like to acknowledge the High Performance Computing Center (HPCC) at Michigan State University for providing computational resources that have contributed to the research results reported within this paper.

Appendix A Hyperbolicity
In this part, we review the definition of the hyperbolicity and some equivalent conditions. See also the details in Chapter 3 in [38].
Consider the first-order system of equations in 1D: The following classical conclusion holds for these two definitions: Proposition A.3. The symmetrizable hyperbolicity is a necessary and sufficient condition for the first-order system (A.1) to be hyperbolic.
Proof. We start by the proof of sufficiency. By the definition of symmetrizable hyperbolic, there exists a symmetric positive definite (SPD) matrix A 0 such that A 0 A are symmetric. Since A 0 is a SPD matrix, there exists an invertible symmetric matrix B satisfying A 0 = B 2 . Then, we compute Thus, BAB −1 is symmetric since A 0 A and B are symmetric. Then we have A is real diagonlizable.
On the other hand, suppose that A is real diagonlizable, there exist an invertible real matrix P such that A = P −1 DP with D a real diagnoal matrix. Take A 0 = P T P . Then A 0 is a SPD matrix and A 0 A = P T DP is symmetric.

Appendix B Proof of Theorem 2.1
Proof. To save space, we only present the proof in the case of a N −3 = 0. One also can prove the case of a N −3 = 0 by following the same line.
We first write A in (2.11) into a block matrix: . Then we compute A 0 A: Here, 0 m×n denote the zero matrix of size m × n. It is easy to see that DA 1 is symmetric.
Next, we compute other blocks in A 0 A: Then, we compute (B.6) For A 0 A to be symmetric, we need BA 4 is symmetric and DA 2 = (BA 3 ) T . Thus, we have the (B.7) We solve for b 11 , b 12 and b 22 from the above linear system: This is just the condition (2.12) with a N −3 = 0 (or equivalently (2.15)). Finally, (2.13) can be easily derived, and the proof is omitted for brevity.

Appendix C Structural stability condition
In this part, we review the structural stability condition proposed in [41], which is fundamental for the quasilinear first-order hyperbolic system with source terms: The stability condition in [41] reads as: (i). There exists an invertible n × n matrix P (U ) and an invertible r × r matrix S(U ), defined on the equilibrium manifold E, such that Here Q U = ∂Q ∂U and I r is the identity matrix of order r.
This set of conditions has been tacitly respected by many well-developed physical models [42].
The first condition is classical for initial value problems of the system of ordinary differential equations (ODEs), while the second one means the symmetrizable hyperbolicity of the PDE system.
The third condition characterizes a kind of coupling between the convection term and the source term. This set of conditions implies the existence and stability of the zero relaxation limit of the corresponding initial value problems [41].


Analysis of Drivers’ Eye Movements on Roundabouts:A Driving Simulator Study

Roundabouts are considered as one of the most efficient forms of intersection that substantially reduce the types of crashes that result in injury or loss of life. Nevertheless, they do not eliminate collision risks, especially when human error plays such a large role in traffic crashes. In this study, we used a driving simulator and an eye tracker to investigate drivers’ eye movements under cell phone-induced distraction. A total of 45 drivers participated in two experiments conducted under distracted and non-distracted conditions. The results indicated that, under distracting conditions, the drivers’ fixation duration decreased significantly on roundabouts, and pupil size increased significantly.

Introduction
Roundabouts are a proven safety countermeasure and are safer than conventional signal-controlled and stop sign intersections. Nevertheless, they do not eliminate the risk of traffic crashes. Navigating through roundabouts can be an intricate task because of driver-car interactions, circulatory geometry, and environment perception. According to the Professional Association of Training Companies in Logistics, Transportation, and Road Safety, the majority of drivers make one or more mistakes when passing through roundabouts. That is, 65% do not occupy an appropriate lane as they exit roundabouts, 15% drive straight into roundabouts by crossing lanes, and 60% do not use proper turn signals [1]. Similar results were presented in the annual crash reports provided by Spain's National Traffic Department (DGT), which stated that traffic accidents at roundabouts increased by 34% from 2012 to 2016 and that fatal accidents in these road junctions doubled during the same period [2]. Most traffic crashes that occur at roundabouts are entering/exiting circulating crashes, rear-end crashes, collisions with pedestrians and cyclists, and collisions with parts of roundabouts (e.g., central island, curb) [3,4]. Arndt and Troutbeck [3] reported that roughly 80% of traffic crashes at roundabouts take place on entry lanes, mostly because of a driver's failure to give the right of way to oncoming traffic or vulnerable road users [5].
Distraction is one of the critical threats to the health and the safety of drivers, accounting for 22% of rear-end crashes [6] and 3% of single-vehicle crashes at roundabouts [7]. These statistics are supported by the findings of [8] from a roadside observation intended to capture the prevalence of drivers' secondary behaviors. The authors found that 21.1% of drivers are engaged in distracting activities at roundabouts and that the most common sources of distraction are holding and/or talking on a phone (8.4%) and having a conversation with passengers (3.4%). Distraction is also prevalent among pedestrians crossing the road [9,10]. According to the survey conducted by [9], talking on a mobile phone while crossing the street increases the risk of conflict with a vehicle.
As distraction is generally underreported in national databases and police reports, previous research attempted to determine its potential sources and prevalence using surveys [11][12][13] and experimental testing [14][15][16][17][18]. Although survey questionnaires can be used to identify potentially distracting activities that lead to traffic crashes, major concerns arise as to the reliability of self-reported data. In contrast, experimental testing approaches such as naturalistic driving studies, field observations, and driving simulations provide researchers with realistic information regarding distracting activities and driver performance.
Past research efforts uncovered that the use of cell phones while driving impairs a driver's performance [19][20][21]. However, most of these works focused on occurrences on straight road segments [22,23], intersections [24][25][26][27], and railway crossings [28,29]. Few investigated cell phone-induced distraction effects on drivers' performance parameters at roundabouts [30,31]. Nonetheless, these roundabout-oriented works did not assess drivers' eye movements on roundabouts under distracted and non-distracted conditions. Table 1 shows some driving simulation studies that revolved around cell phone-induced distraction.

Eye Movement and Distracted Driving
Given the increase in distracted driving-related crashes around the world, various researchers [33][34][35] attempted to investigate the visual characteristics relevant to distracted driving, as eye movement data can uncover important information in the assessment of secondary tasks. For example, Bao and Boyle [33] evaluated drivers' visual scanning behaviors using in-vehicle cameras to monitor drivers' head movements as they make rightand left-hand turns and straight-through driving maneuvers at intersections. Romoser and Fisher [34] used an eye tracker to determine participants' points of gaze during turns at intersections in two different conditions: (1) when drivers are stationary at an intersection and are waiting for a break in traffic to execute a turn and (2) when drivers begin a turn and are aiming to move in the direction from which other vehicles are most likely to come into conflict with their vehicles. Similarly, Romoser, Pollatsek, Fisher, and Williams [35] used an eye tracker to assess the glance patterns of drivers who approach and enter intersections.
In consideration of the above-mentioned issues, the present study was aimed at investigating differences in scanning behaviors under distracting and non-distracting conditions on roundabouts. We chose to focus on these junctions rather than intersections, as some crashes still occur on the former. Moreover, as some dominantly occurring crash types on roundabouts such as rear-end crashes, entering-circulating crashes, and singlevehicle collisions occur at different parts of roundabouts [4], we examined five locations on roundabouts to assess drivers' behaviors.

Driving Simulator
In carrying out our investigation, we used a driving simulator specially designed for training purposes. It enables the simulation of realistic driving scenarios under different traffic and weather conditions in a safe environment. A driving simulation system can calculate speed, acceleration, and other motorist or vehicle characteristics on the basis of the performance of a driver. The system can also configure vehicles through changes to traction, gears, and other components. The apparatus used in this work was equipped with three 43 inch monitors designed to visualize a simulated road environment. Computer graphics were used to produce a front image, a side mirror image, and a rear-view mirror image of road traffic conditions. Figure 1 presents the driving simulator used in our study.
Haque et al. [30] Single-lane roundabouts Reaction distance; initial speed; time to reduce initial speed to the minimum value; gap selection; post-encroachment time; time taken to cross the roundabout; time to recover speed N/A

Eye Movement and Distracted Driving
Given the increase in distracted driving-related crashes around the world, various researchers [33][34][35] attempted to investigate the visual characteristics relevant to distracted driving, as eye movement data can uncover important information in the assessment of secondary tasks. For example, Bao and Boyle [33] evaluated drivers' visual scanning behaviors using in-vehicle cameras to monitor drivers' head movements as they make right-and left-hand turns and straight-through driving maneuvers at intersections. Romoser and Fisher [34] used an eye tracker to determine participants' points of gaze during turns at intersections in two different conditions: (1) when drivers are stationary at an intersection and are waiting for a break in traffic to execute a turn and (2) when drivers begin a turn and are aiming to move in the direction from which other vehicles are most likely to come into conflict with their vehicles. Similarly, Romoser, Pollatsek, Fisher, and Williams [35] used an eye tracker to assess the glance patterns of drivers who approach and enter intersections.
In consideration of the above-mentioned issues, the present study was aimed at investigating differences in scanning behaviors under distracting and non-distracting conditions on roundabouts. We chose to focus on these junctions rather than intersections, as some crashes still occur on the former. Moreover, as some dominantly occurring crash types on roundabouts such as rear-end crashes, entering-circulating crashes, and singlevehicle collisions occur at different parts of roundabouts [4], we examined five locations on roundabouts to assess drivers' behaviors.

Driving Simulator
In carrying out our investigation, we used a driving simulator specially designed for training purposes. It enables the simulation of realistic driving scenarios under different traffic and weather conditions in a safe environment. A driving simulation system can calculate speed, acceleration, and other motorist or vehicle characteristics on the basis of the performance of a driver. The system can also configure vehicles through changes to traction, gears, and other components. The apparatus used in this work was equipped with three 43 inch monitors designed to visualize a simulated road environment. Computer graphics were used to produce a front image, a side mirror image, and a rear-view mirror image of road traffic conditions. Figure 1 presents the driving simulator used in our study.

Eye Tracker
To assess drivers' eye movements, we used Tobii Pro Glasses 2 ( Figure 2), which features a one-point calibration procedure, auto parallax compensation, and slippage compensation, thus allowing for persistent calibration throughout testing. The eye tracker was equipped with two cameras and had a sampling rate of 100 Hz. For the analysis of drivers' behaviors on roundabouts, we defined various areas of interest (AOIs), namely front mirror, windshield, driver-side mirror and window, and passenger-side mirror and window. The data recorded by the eye tracker were analyzed using the Tobii Pro Lab software, through which participants' fixation duration and eye pupil size for each AOI were determined. These two metrics are important because they reveal a driver's visual distraction. As reported by Jiang et al. [36], distraction among pedestrians is associated with increased pupil diameter and reduced fixation duration.
The data recorded by the eye tracker were analyzed using the Tobii Pro Lab softwa through which participants' fixation duration and eye pupil size for each AOI were det mined. These two metrics are important because they reveal a driver's visual distractio As reported by Jiang et al. [36], distraction among pedestrians is associated with increas pupil diameter and reduced fixation duration.

Participants
Prospective participants were screened for eligibility, and if eligibility criteria we satisfied, they were provided a consent form approved by the Institutional Review Boa of the University of Burgos. A total of 45 individuals, specifically 13 females and 32 mal participated in this study. They were healthy, 19 to 56-year-old adults living in Burg Spain, who had no eye diseases and mental illness but had intact physical functioning a limb movement. They were selected based on years of driving experience and frequen of vehicle use in real life.

Procedure
All the participants were given detailed information about the study in advance, a data were collected from those who provided informed consent. Each participant fill out a survey questionnaire with questions related to demographic factors and particul ities of individual driving. They later received an introductory tour of the simulator a were allowed a practice drive for familiarization with the apparatus and simulated ro environment. The virtual road environment featured a multi-lane rural and urban roa that encompassed six roundabouts with stable traffic flow and where drivers had a hi degree of freedom to select speed and operating conditions; nevertheless, such conditio were somewhat influenced by other vehicles on the road. Additionally, all the participan were tasked to drive in clear weather conditions and during the day. After the trainin they were instructed to operate in two counterbalanced experimental drives. Before ea experiment, a trained research assistant fitted the eye tracker onto each test participan head. During the calibration, the test participant was asked to look at a calibration ca (target) held in front of him/her for a few seconds. The assistant then initiated recordi using the Tobii Glasses Controller software running on a computer. After the session, t assistant stopped the recording and removed the head unit from the test participant. A interactions with the eye tracker (listing the participants to be tested, initiating calibratio starting/stopping recordings, etc.) were done through the Tobii Glasses Controller so ware. In the non-distracting experiment, the participants were asked to drive through simulated route with six roundabouts while refraining from using a cell phone. Depen ing on each individual driving style and behavior, every subject had to drive for appro imately 10 to 15 minutes without any distraction, keeping attention focused on the roa

Participants
Prospective participants were screened for eligibility, and if eligibility criteria were satisfied, they were provided a consent form approved by the Institutional Review Board of the University of Burgos. A total of 45 individuals, specifically 13 females and 32 males, participated in this study. They were healthy, 19 to 56-year-old adults living in Burgos, Spain, who had no eye diseases and mental illness but had intact physical functioning and limb movement. They were selected based on years of driving experience and frequency of vehicle use in real life.

Procedure
All the participants were given detailed information about the study in advance, and data were collected from those who provided informed consent. Each participant filled out a survey questionnaire with questions related to demographic factors and particularities of individual driving. They later received an introductory tour of the simulator and were allowed a practice drive for familiarization with the apparatus and simulated road environment. The virtual road environment featured a multi-lane rural and urban roads that encompassed six roundabouts with stable traffic flow and where drivers had a high degree of freedom to select speed and operating conditions; nevertheless, such conditions were somewhat influenced by other vehicles on the road. Additionally, all the participants were tasked to drive in clear weather conditions and during the day. After the training, they were instructed to operate in two counterbalanced experimental drives. Before each experiment, a trained research assistant fitted the eye tracker onto each test participant's head. During the calibration, the test participant was asked to look at a calibration card (target) held in front of him/her for a few seconds. The assistant then initiated recording using the Tobii Glasses Controller software running on a computer. After the session, the assistant stopped the recording and removed the head unit from the test participant. All interactions with the eye tracker (listing the participants to be tested, initiating calibration, starting/stopping recordings, etc.) were done through the Tobii Glasses Controller software. In the non-distracting experiment, the participants were asked to drive through a simulated route with six roundabouts while refraining from using a cell phone. Depending on each individual driving style and behavior, every subject had to drive for approximately 10 to 15 min without any distraction, keeping attention focused on the road. The other experiment was performed fully under cell phone-induced distraction. That is, the trained research assistant placed a single phone call as well as sent multiple WhatsApp messages to participants during the experiment. During the call, the research assistant maintained a natural conversational flow that required participants to respond to various open-ended questions. Typical questions included inquiries related to future plans, the academic course, and preferred leisure activities. In addition, the participants were asked to open Instagram and go through the feed. These applications were selected because they are downloaded frequently from the app store/play store and are popular among young people, which is this study's target group. The participants were instructed to drive as they typically would on a real road, adhering to the speed limit as well as other traffic laws outlined by DGT.

Data Analysis
First, the Tobii Pro Lab software was used to output videos and corresponding CSV files. Second, we extracted information related to pupil diameter and fixation duration via the AOIs and for each location inside and outside roundabouts. As shown in Figure 3, all the measurements were made in five roundabout locations, namely, (1) 50 m behind the entry line, (2) pre-entrance, (3) at the entry line, (4) at the entrance, and (5) on the exit line. The total fixation duration for each AOI inside roundabouts was measured. For between-group comparisons (distracting vs. non-distracting conditions), multiple paired t-tests were conducted for matched samples to determine whether the measured parameters under distracting and non-distracting conditions significantly differed. Paired t-tests were chosen, as the observations were not independent of one another (e.g., each subject participated in both experiments.). For each participant, we essentially looked into differences in the values of fixation duration and eye pupil diameter and tested whether the mean of these differences was equal to zero. We also used a one-sided alternative that involved calculating the task load (TL) score in cases wherein such load was higher under distracted driving than under non-distracted driving:

Between-Group Comparison of Eye Parameters in Roundabouts
A total of 13 participants were excluded from the analysis because their eye movements were not detected by the eye tracker. In location 1, there was a significant betweengroup difference in fixation durations when the drivers were looking at all the AOIs: front mirror (p = 0.0005), windshield (p = 0.020), driver-side mirror (p = 0.005), driver-side window (p = 0.030), passenger-side mirror (p = 0.034), and passenger-side window (0.003). In location 2, a significant between-group difference in fixation durations was found when the participants were looking at front mirror (p = 0.030), windshield (p = 0.040), driver-side mirror (p = 0.009), driver-side window (p = 0.014), and passenger-side window (p = 0.049). However, no such difference was found with respect to gazes on the passenger-side mirror. With reference to location 3, the between-group difference in fixation durations was significant only when the participants looked at front mirror (p = 0.080), windshield (p = 0.050), driver-side mirror (p = 0.085), and driver-side window (p = 0.077). As regards location 4, a significant between-group difference in fixation duration occurred only when the drivers looked at the driver-side mirror (p = 0.087). Finally, in the matter of location 5, the With regard to the eye pupil size, we proposed a one-sided alternative wherein the median pupil dimeter (PD) under distracting conditions was higher than that under nondistracting conditions: H a : mean (PD distracting − PD Non-distracting ) > 0 A similar one-sided alternative was put forward for fixation duration, that is, a case wherein fixation duration (FD) under non-distracting conditions was higher than that under distracting conditions: Lastly, in order to realize whether there exist gender differences in fixation durations under distracting condition, the non-parametric Mann-Whitney U test was used because of its robust properties in calculating unequal sample size between conditions [37].
To reject the null hypothesis, we considered a level of significance of 0.1 (one-sided) and used STATA (version 16) for this purpose.

Between-Group Comparison of Eye Parameters in Roundabouts
A total of 13 participants were excluded from the analysis because their eye movements were not detected by the eye tracker. In location 1, there was a significant betweengroup difference in fixation durations when the drivers were looking at all the AOIs: front mirror (p = 0.0005), windshield (p = 0.020), driver-side mirror (p = 0.005), driver-side window (p = 0.030), passenger-side mirror (p = 0.034), and passenger-side window (0.003). In location 2, a significant between-group difference in fixation durations was found when the participants were looking at front mirror (p = 0.030), windshield (p = 0.040), driver-side mirror (p = 0.009), driver-side window (p = 0.014), and passenger-side window (p = 0.049). However, no such difference was found with respect to gazes on the passenger-side mirror. With reference to location 3, the between-group difference in fixation durations was significant only when the participants looked at front mirror (p = 0.080), windshield (p = 0.050), driver-side mirror (p = 0.085), and driver-side window (p = 0.077). As regards location 4, a significant between-group difference in fixation duration occurred only when the drivers looked at the driver-side mirror (p = 0.087). Finally, in the matter of location 5, the fixation durations differed significantly between the groups when the driver looked at mirror (p = 0.037), windshield (p = 0.006), and driver-side mirror (p = 0.088). Table 2 summarizes the results. For each AOI inside roundabouts, a significant between-group difference in total fixation durations arose when the participants looked at front mirror (p = 0.0003), windshield (p = 0.005), driver-side mirror (p = 0.001), driver-side window (p = 0.010), and passengerside window (0.012). As for pupil size (Figure 4), the results of the paired t-test showed that the median left (p = 0.02) and right (p = 0.04) pupil diameters increased significantly. In contrast, for each AOI inside roundabouts, there was no significant difference between male and female participants in fixation duration under distracting condition.
For each AOI inside roundabouts, a significant between-group difference in total fixation durations arose when the participants looked at front mirror (p = 0.0003), windshield (p = 0.005), driver-side mirror (p = 0.001), driver-side window (p = 0.010), and passengerside window (0.012). As for pupil size (Figure 4), the results of the paired t-test showed that the median left (p = 0.02) and right (p = 0.04) pupil diameters increased significantly. In contrast, for each AOI inside roundabouts, there was no significant difference between male and female participants in fixation duration under distracting condition.

Discussion
This study investigated the effects of cell phone-induced distraction on drivers' eye movements inside and outside roundabouts. For this purpose, two driving simulator scenarios featuring distracting and non-distracting conditions were featured in experiments.
The analysis of the drivers' eye movements suggested that the participants drove less cautiously when they were approaching roundabouts (location 1), considering the reduced fixation durations in all AOIs as a result of cell phone-induced distraction. Similar trends for all the AOIs except the passenger-side mirror were observed in location 2, where the drivers were near entry lines. This similarity can be explained by the attempts of most of the drivers to exit the left lane and keep right when approaching an entry line and before entering a roundabout. Moreover, the majority of the drivers involved in the experimented reduced fixation duration on an entry lane approaching a roundabout (location 3), especially for the driver-side window. This finding is critical, as it indicates that the drivers paid reduced attention to oncoming traffic in roundabouts, which can result in entering-circulating crashes. In contrast, in location 4, no significant change in fixation duration was observed with respect to the driver-side window, meaning that the drivers started paying attention to oncoming traffic only when their vehicles were fully inside the roundabout. This behavior can elevate the risk of side-swipe crashes. As for location 5, a

Discussion
This study investigated the effects of cell phone-induced distraction on drivers' eye movements inside and outside roundabouts. For this purpose, two driving simulator scenarios featuring distracting and non-distracting conditions were featured in experiments.
The analysis of the drivers' eye movements suggested that the participants drove less cautiously when they were approaching roundabouts (location 1), considering the reduced fixation durations in all AOIs as a result of cell phone-induced distraction. Similar trends for all the AOIs except the passenger-side mirror were observed in location 2, where the drivers were near entry lines. This similarity can be explained by the attempts of most of the drivers to exit the left lane and keep right when approaching an entry line and before entering a roundabout. Moreover, the majority of the drivers involved in the experimented reduced fixation duration on an entry lane approaching a roundabout (location 3), especially for the driver-side window. This finding is critical, as it indicates that the drivers paid reduced attention to oncoming traffic in roundabouts, which can result in entering-circulating crashes. In contrast, in location 4, no significant change in fixation duration was observed with respect to the driver-side window, meaning that the drivers started paying attention to oncoming traffic only when their vehicles were fully inside the roundabout. This behavior can elevate the risk of side-swipe crashes. As for location 5, a significant drop in fixation duration in connection to front mirror, windshield, and driver-side window was found, thereby likely increasing the risk of rear-end and exitingcirculating crashes when drivers exit a roundabout. Finally, comparing distracting and non-distracting scenarios highlighted that the total fixation duration inside roundabouts decreased by 36% on average, thus posing a significant crash risk. The participants who drove in roundabouts under distracting conditions exhibited wider eye pupil diameters Sustainability 2021, 13, 7463 8 of 10 than those shown by those who drove in roundabouts under non-distracting conditions, which is consistent with the findings of [36].
To tackle distracted driving challenges on roadways, especially on roundabouts, various effective countermeasures are recommended. Awareness campaigns are proven strategies to educate about distracted driving. According to reference [38], a one week distracted driving awareness campaign at a large university, which consisted of mass emails and group discussions with students, substantially improved distracted driving behaviors among students. In addition, legislative countermeasures such as cell phone use bans were associated with reductions in observed handheld phone use among young drivers [39]. As for technology countermeasures, the most current technology is phonebased blocking applications, which often use the phone's GPS to track whether the user is in a moving vehicle. There are many other technology-based approaches that monitor driver's performance [40], eye behavior [41], and phone usage [42] and provide real-time alerts to drivers aimed at reducing distracted driving.

Conclusions
The results on driver performance and eye movements indicated that between-group differences in fixation durations and eye pupil diameters were significant. That is, the participants drove less cautiously near and inside roundabouts when they were exposed to cell phone-induced distraction. Our exploration into the drivers' behavior during travel on a roundabout under distracting and non-distracting scenarios showed that the drivers were compelled to exert more effort to keep their eyes on the road as they used their cell phones.
The findings can be used by decision makers as reference in developing distractionspecific technologies so that cell phones cannot be used by drivers on roadways, especially when they pass through roundabouts. The results can also serve as a guide in the establishment of test methods designed specifically to compare eye glance metrics for each AOI with accepted criteria for evaluating whether a task excessively interferes with driver attention and becomes unsuitable for a driver to perform while driving. Funding: This research was funded by FEDER European Regional Development Fund (Fondo Europeo de Desarrollo Regional-Junta de Castilla y León), grant number BU300P18.

Institutional Review Board Statement:
The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of Burgos University (protocol code IR 17/2020 on 28 May 2018).

Informed Consent Statement:
Design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Data Availability Statement:
The data presented in this study are available on request from the corresponding author.