Quasi-Monte Carlo methods in finance
Encyclopedia
High-dimensional integrals in hundreds or thousands of variables occur commonly in finance. These integrals have to be computed numerically to within a threshold 
. If the integral is of dimension 
then in the worst case, where one has a guarantee of error at most 
, the computational complexity is typically of order 
. That is, the problem suffers the curse of dimensionality
. In 1977 P. Boyle, University of Waterloo, proposed using Monte Carlo (MC)
to evaluate options. Starting in early 1992, J. F. Traub, Columbia University, and a graduate student at the time, S. Paskov, used quasi-Monte Carlo
(QMC) to price a Collateralized mortgage obligation
with parameters specified by Goldman Sachs. Even though it was believed by the world's leading experts that QMC should not be used for high dimensional integration, Paskov and Traub found that QMC beat MC by one to three orders of magnitude and also enjoyed other desirable attributes. Their results were first published in 1995. Today QMC is widely used in the financial sector to value financial derivatives.
QMC is not a panacea for all high dimensional integrals. A number of explanations have been proposed for why QMC is so good for financial derivatives. This continues to be a very fruitful research area.
. It is well known that if a worst case guarantee of error at most 
is required then the computational complexity of integration may be exponential in 
, the dimension of the integrand; See Ch. 3 for details. To break this curse of dimesionality one can use the Monte Carlo (MC) method defined by
where the evaluation points
are randomly chosen. It is well know that the expected error of Monte Carlo is of order 
. Thus the cost of the algorithm that has error 
is of order 
breaking the curse of dimensionality.
Of course in computational practice pseudo-random points are used. Figure 1 shows the distribution of 500 pseudo-random points on the unit square.
Note there are regions where there are no points and other regions where there are clusters of points. It would be desirable to sample the integrand at uniformly distributed points. A rectangular grid would be uniform but even if there were only 2 grid points in each Cartesian direction there would be 
points. So the desideratum should be as few points as possible chosen as uniform as possible.
It turns out there is a well-developed part of number theory which deals exactly with this desideratum. Discrepancy is a measure of deviation from uniformity so what one wants are low discrepancy sequences (LDS). Numerous LDS have been created named after their inventors, e.g.
Figure 2. gives the distribution of 500 LDS points.
The quasi-Monte Carlo (QMC) method is defined by
where the
belong to an LDS. The standard terminology quasi-Monte Carlo is somewhat unfortunate since MC is a randomized method whereas QMC is purely deterministic.
The uniform distribution of LDS is desirable. But the worst case error of QMC is of order
where
is the number of sample points. See for the theory of LDS and references to the literature. The rate of convergence of LDS may be contrasted with the expected rate of convergence of MC which is 
. For 
small the rate of convergence of QMC is faster than MC but for 
large the factor 
is devastating. For example, if 
, then even with 
the QMC error is proportional to 
. Thus it was widely believed by the world's leading experts that QMC should not be used for high dimensional integration. For example, in 1992 Bratley, Fox and Niederreiter performed extrensive testing on certain mathematical problems. They conclude "in high-dimensional problems (say 
), QMC seems to offer no practical advantage over MC". In 1993, Rensburg and Torrie compared QMC with MC for the numerical estimation of high dimensional integrals which occur in computing virial coefficients for the hard-sphere fluid. They conclude QMC is more effective than MC only if 
. As we shall see, tests on 360-dimensional integrals arising from a collateralized mortgage obligation (CMO) lead to very different conclusions.
Woźniakowski's 1991 paper showing the connection between average case complexity of integration and QMC led to new interest in QMC.
Woźniakowski's result received considerable coverage in the scientific press
.
In early 1992, I. T. Vanderhoof, New York University, became aware of Woźniakowski's result and gave Woźniakowski's colleague J. F. Traub, Columbia University, a CMO with parameters set by Goldman Sachs. This CMO had 10 tranches each requiring the computation of a 360 dimensional integral. Traub asked a Ph.D. student, Spassimir Paskov, to compare QMC with MC for the CMO. In 1992 Paskov built a software system called FinDer and ran extensive tests. To the Columbia's research group's surprise and initial disbelief Paskov reported that QMC was always superior to MC in a number of ways. Details are given below. Preliminary results were presented by Paskov and Traub to a number of Wall Street firms in Fall 1993 and Spring 1994. The firms were initially skeptical of the claim that QMC was superior to MC for pricing financial derivatives. A January 1994 article in Scientific American by Traub and Woźniakowski discussed the theoretical issues and reported that "Preliminary results obtained by testing certain finance problems suggests the superiority of the deterministic methods in practice".
In Fall 1994 Paskov wrote a Columbia University Computer Science Report which appeared in slightly modified form in 1997.
In Fall 1995
Paskov and Traub published a paper in the "Journal of Portfolio Management". They compared MC and two QMC methods. The two deterministic methods used Sobol and Halton points. Since better LDS were created later, no comparison will be made between Sobol and Halton sequences. The experiments drew the following conclusions regarding the performance of MC and QMC on the 10 tranche CMO:
To summarize, QMC beats MC for the CMO on accuracy, confidence level, and speed.
This paper was followed by reports on tests by a number of researchers which also led to the conclusion the QMC is superior to MC for a variety of high-dimensional finance problems. This includes papers by Caflisch and Morokoff (1996),
Joy, Boyle, Tan (1996),
Ninomiya and Tezuka (1996),
Papageorgiou and Traub (1996),
Ackworth, Broadie and Glasserman (1997)
Further testing of the CMO was carried out by Anargyros Papageorgiou, who developed an improved version of the FinDer software system. The new results include the following:
A possible explanation of why QMC is good for finance is the following. Consider a tranche of the CMO mentioned earlier. The integral gives expected future cash flows from a basket of 30 year mortgages at 360 monthly intervals. Because of the discounted value of money variables representing future times are increasingly less important. In a seminal paper I. Sloan and H. Woźniakowski
introduced the idea of weighted spaces. In these spaces the dependence on the successive variables can be moderated by weights. If the weights decrease sufficiently rapidly the curse of dimensionality is broken even with a worst case guarantee. This paper led to a great amount of work on the tractability of integration and other problems. A problem is tractable when its complexity is of order
and 
is independent of the dimension.
On the other hand, effective dimension was proposed by Caflisch, Morokoff and Owen as an indicator
of the difficulty of high dimensional integration. The purpose was to explain
the remarkable success of quasi-Monte Carlo (QMC) in approximating the very
high dimensional integrals in finance. They argued that
the integrands are of low effective dimension and that is why QMC is much
faster than Monte Carlo (MC).
The impact of the arguments of Caflisch et al. was great.
A number of papers deal with the relationship between the error of QMC and the effective dimension
.
It is known that QMC fails for certain functions that have high effective dimension.
However, low effective dimension is not a necessary condition for QMC to beat MC and for
high dimensional integration
to be tractable. In 2005, Tezuka exhibited a class of functions of
variables, all with maximum effective dimension equal to 
. For these functions QMC is very fast since its convergence rate is of order 
, where 
is the number of function evaluations.
where
denotes the Euclidean norm and 
. Keister reports that using a standard numerical method some 220,000 points were needed to obtain a relative error on the order of 
. A QMC calculation using the generalized Faure low discrepancy sequence (QMC-GF) used only 500 points to obtain the same relative error. The same integral was tested for a range of values of 
up to 
. Its error was
, where 
is the number of evaluations of 
. This may be compared with the MC method whose error was proportional to 
.
These are empirical results. In a theoretical investigation Papageorgiou proved that the convergence rate of QMC for a class of
-dimensional isotropic integrals which includes the integral defined above is of the order
This is with a worst case guarantee compared to the expected convergence rate of
of Monte Carlo and shows the superiority of QMC for this type of integral.
In another theoretical investigation Papageorgiou presented sufficient conditions for fast QMC convergence. The conditions apply to isotropic and non-isotropic problems and, in particular, to a number of problems in computational finance. He presented classes of functions where even in the worst case the convergence rate of QMC is of order
where
is a constant that depends on the class of functions.
But this is only a sufficient condition and leaves open the major question we pose in the next section.
. If the integral is of dimension then in the worst case, where one has a guarantee of error at most , the computational complexity is typically of order . That is, the problem suffers the curse of dimensionalityCurse of dimensionality
The curse of dimensionality refers to various phenomena that arise when analyzing and organizing high-dimensional spaces that do not occur in low-dimensional settings such as the physical space commonly modeled with just three dimensions.There are multiple phenomena referred to by this name in...
. In 1977 P. Boyle, University of Waterloo, proposed using Monte Carlo (MC)
Monte Carlo method
Monte Carlo methods are a class of computational algorithms that rely on repeated random sampling to compute their results. Monte Carlo methods are often used in computer simulations of physical and mathematical systems...
to evaluate options. Starting in early 1992, J. F. Traub, Columbia University, and a graduate student at the time, S. Paskov, used quasi-Monte Carlo
Quasi-Monte Carlo method
In numerical analysis, a quasi-Monte Carlo method is a method for the computation of an integral that is based on low-discrepancy sequences...
(QMC) to price a Collateralized mortgage obligation
Collateralized mortgage obligation
A collateralized mortgage obligation is a type of financial debt vehicle that was first created in 1983 by the investment banks Salomon Brothers and First Boston for U.S. mortgage lender Freddie Mac. A collateralized mortgage obligation (CMO) is a type of financial debt vehicle that was first...
with parameters specified by Goldman Sachs. Even though it was believed by the world's leading experts that QMC should not be used for high dimensional integration, Paskov and Traub found that QMC beat MC by one to three orders of magnitude and also enjoyed other desirable attributes. Their results were first published in 1995. Today QMC is widely used in the financial sector to value financial derivatives.
QMC is not a panacea for all high dimensional integrals. A number of explanations have been proposed for why QMC is so good for financial derivatives. This continues to be a very fruitful research area.
Monte Carlo and quasi-Monte Carlo methods
Integrals in hundreds or thousands of variables are common in computational finance. These have to be approximated numerically to within an error threshold. It is well known that if a worst case guarantee of error at most is required then the computational complexity of integration may be exponential in , the dimension of the integrand; See Ch. 3 for details. To break this curse of dimesionality one can use the Monte Carlo (MC) method defined bywhere the evaluation points
are randomly chosen. It is well know that the expected error of Monte Carlo is of order . Thus the cost of the algorithm that has error is of order breaking the curse of dimensionality.Of course in computational practice pseudo-random points are used. Figure 1 shows the distribution of 500 pseudo-random points on the unit square.
points. So the desideratum should be as few points as possible chosen as uniform as possible.It turns out there is a well-developed part of number theory which deals exactly with this desideratum. Discrepancy is a measure of deviation from uniformity so what one wants are low discrepancy sequences (LDS). Numerous LDS have been created named after their inventors, e.g.
- Halton
- Hammersley
- Sobol
- Faure
- Niederreiter
Figure 2. gives the distribution of 500 LDS points.
where the
belong to an LDS. The standard terminology quasi-Monte Carlo is somewhat unfortunate since MC is a randomized method whereas QMC is purely deterministic.The uniform distribution of LDS is desirable. But the worst case error of QMC is of order
where
is the number of sample points. See for the theory of LDS and references to the literature. The rate of convergence of LDS may be contrasted with the expected rate of convergence of MC which is . For small the rate of convergence of QMC is faster than MC but for large the factor is devastating. For example, if , then even with the QMC error is proportional to . Thus it was widely believed by the world's leading experts that QMC should not be used for high dimensional integration. For example, in 1992 Bratley, Fox and Niederreiter performed extrensive testing on certain mathematical problems. They conclude "in high-dimensional problems (say ), QMC seems to offer no practical advantage over MC". In 1993, Rensburg and Torrie compared QMC with MC for the numerical estimation of high dimensional integrals which occur in computing virial coefficients for the hard-sphere fluid. They conclude QMC is more effective than MC only if . As we shall see, tests on 360-dimensional integrals arising from a collateralized mortgage obligation (CMO) lead to very different conclusions.Woźniakowski's 1991 paper showing the connection between average case complexity of integration and QMC led to new interest in QMC.
Woźniakowski's result received considerable coverage in the scientific press
.
In early 1992, I. T. Vanderhoof, New York University, became aware of Woźniakowski's result and gave Woźniakowski's colleague J. F. Traub, Columbia University, a CMO with parameters set by Goldman Sachs. This CMO had 10 tranches each requiring the computation of a 360 dimensional integral. Traub asked a Ph.D. student, Spassimir Paskov, to compare QMC with MC for the CMO. In 1992 Paskov built a software system called FinDer and ran extensive tests. To the Columbia's research group's surprise and initial disbelief Paskov reported that QMC was always superior to MC in a number of ways. Details are given below. Preliminary results were presented by Paskov and Traub to a number of Wall Street firms in Fall 1993 and Spring 1994. The firms were initially skeptical of the claim that QMC was superior to MC for pricing financial derivatives. A January 1994 article in Scientific American by Traub and Woźniakowski discussed the theoretical issues and reported that "Preliminary results obtained by testing certain finance problems suggests the superiority of the deterministic methods in practice".
In Fall 1994 Paskov wrote a Columbia University Computer Science Report which appeared in slightly modified form in 1997.
In Fall 1995
Paskov and Traub published a paper in the "Journal of Portfolio Management". They compared MC and two QMC methods. The two deterministic methods used Sobol and Halton points. Since better LDS were created later, no comparison will be made between Sobol and Halton sequences. The experiments drew the following conclusions regarding the performance of MC and QMC on the 10 tranche CMO:
- QMC methods converge significantly faster than MC
- MC is sensitive to the initial seed
- The convergence of QMC is smoother than the convergence of MC. This makes automatic termination easier for QMC.
To summarize, QMC beats MC for the CMO on accuracy, confidence level, and speed.
This paper was followed by reports on tests by a number of researchers which also led to the conclusion the QMC is superior to MC for a variety of high-dimensional finance problems. This includes papers by Caflisch and Morokoff (1996),
Joy, Boyle, Tan (1996),
Ninomiya and Tezuka (1996),
Papageorgiou and Traub (1996),
Ackworth, Broadie and Glasserman (1997)
Further testing of the CMO was carried out by Anargyros Papageorgiou, who developed an improved version of the FinDer software system. The new results include the following:
- Small number of sample points: For the hardest CMO tranche QMC using the generalized Faure LDS due to S. Tezuka achieves accuracy
with just 170 points. MC requires 2700 points for the same accuracy. The significance of this is that due to future interest rates and prepayment rates being unknown, financial firms are content with accuracy of 
. - Large number of sample points: The advantage of QMC over MC is further amplified as the sample size and accuracy demands grow. In particular, QMC is 20 to 50 times faster that MC with moderate sample sizes, and can be up to 1000 times faster than MC when high accuracy is desired QMC.
Theoretical explanations
The results reported so far in this article are empirical. A number of possible theoretical explanations have been advanced. This has been a very research rich area leading to powerful new concepts but a definite answer has not been obtained.A possible explanation of why QMC is good for finance is the following. Consider a tranche of the CMO mentioned earlier. The integral gives expected future cash flows from a basket of 30 year mortgages at 360 monthly intervals. Because of the discounted value of money variables representing future times are increasingly less important. In a seminal paper I. Sloan and H. Woźniakowski
introduced the idea of weighted spaces. In these spaces the dependence on the successive variables can be moderated by weights. If the weights decrease sufficiently rapidly the curse of dimensionality is broken even with a worst case guarantee. This paper led to a great amount of work on the tractability of integration and other problems. A problem is tractable when its complexity is of order
and is independent of the dimension.On the other hand, effective dimension was proposed by Caflisch, Morokoff and Owen as an indicator
of the difficulty of high dimensional integration. The purpose was to explain
the remarkable success of quasi-Monte Carlo (QMC) in approximating the very
high dimensional integrals in finance. They argued that
the integrands are of low effective dimension and that is why QMC is much
faster than Monte Carlo (MC).
The impact of the arguments of Caflisch et al. was great.
A number of papers deal with the relationship between the error of QMC and the effective dimension
.
It is known that QMC fails for certain functions that have high effective dimension.
However, low effective dimension is not a necessary condition for QMC to beat MC and for
high dimensional integration
to be tractable. In 2005, Tezuka exhibited a class of functions of
variables, all with maximum effective dimension equal to . For these functions QMC is very fast since its convergence rate is of order , where is the number of function evaluations.Isotropic integrals
QMC can also be superior to MC and to other methods for isotropic problems, that is, problems where all variables are equally important. For example, Papageorgiou and Traub reported test results on the model integration problems suggested by the physicist B. D. Keisterwhere
denotes the Euclidean norm and . Keister reports that using a standard numerical method some 220,000 points were needed to obtain a relative error on the order of . A QMC calculation using the generalized Faure low discrepancy sequence (QMC-GF) used only 500 points to obtain the same relative error. The same integral was tested for a range of values of up to . Its error was, where is the number of evaluations of . This may be compared with the MC method whose error was proportional to .These are empirical results. In a theoretical investigation Papageorgiou proved that the convergence rate of QMC for a class of
-dimensional isotropic integrals which includes the integral defined above is of the orderThis is with a worst case guarantee compared to the expected convergence rate of
of Monte Carlo and shows the superiority of QMC for this type of integral.In another theoretical investigation Papageorgiou presented sufficient conditions for fast QMC convergence. The conditions apply to isotropic and non-isotropic problems and, in particular, to a number of problems in computational finance. He presented classes of functions where even in the worst case the convergence rate of QMC is of order
where
is a constant that depends on the class of functions.But this is only a sufficient condition and leaves open the major question we pose in the next section.
Open questions
- Characterize for which high-dimensional integration problems QMC is superior to MC.
- Characterize types of financial instruments for which QMC is superior to MC.