Notes On Spectral Methods
Notes On Spectral Methods
In imaging and inversion applications, and with the recent advances in our computa-
tional capacity, short changing the wave equation with high frequency approximations
is no longer necessary for modeling, and thus, waveeld time extrapolation methods
are now commonly used in practice (Geller and Takeuchi, 1998; Kristek et al., 2010).
Wave equation solutions based on waveeld time extrapolation are still relatively ex-
pensive. In addition, waveeld extrapolation methods, in general, have long been
accused of being big on results and short on the details, compared to those commonly
associated with waveeld geometrical methods (traveltimes).
Background
Reverse-time migration can correctly handle complex velocity models without dip
limitations on the image. However, it has large memory requirements and needs a
signicant amount of computation. The most popular and straightforward way to
implement reverse-time migration is the method of explicit nite dierences, which
is only conditionally stable because of the limit on time-step size. Finite-dierence
methods also suer from numerical dispersion problems, which can be overcome either
by decreasing the time step or by high-order schemes (Wu et al., 1996; Liu and Sen,
2009). Several alternative algorithms have been developed for seismic wave extrapola-
tion in variable velocity media. Soubaras and Zhang (2008) introduced an algorithm
based on a high-order dierential operator, which allows a large extrapolation time
step by solving a coecient optimization problem. Zhang and Zhang (2009) proposed
one-step extrapolation method by introducing a square-root operator. This method
can formulate the two-way wave equation as a rst-order partial dierential equation
in time similar to the one-way wave equation. Etgen and Brandsberg-Dahl (2009)
modied the Fourier Transform of the Laplacian operator to compensate exactly for
the error resulting from the second-order time marching scheme used in conventional
pseudo spectral methods (Reshef et al., 1988b). Fowler et al. (2010) provided an
accurate VTI P-wave modeling method with coupled second-order pseudo-acoustic
equations. Pestana and Stoa (2010) presented an application of Rapid Expansion
Method (REM) (Tal-Ezer et al., 1987) for forward modeling with one-step time evolu-
tion algorithm and RTM with recursive time stepping algorithm. As a chain operator
of Fast Fourier Transform and Finite Dierence operators, the proposed extrapola-
tor can be as accurate as the parameter interpolation approach employed by Etgen
and Brandsberg-Dahl (2009) but at a cost of only one Fast Fourier Transform (FFT)
and inverse Fast Fourier Transform (IFFT) operation. The advantages of the FFD
operator are even more apparent in the anisotropic case: no need for several inter-
polations for dierent parameters with the corresponding computational burden of
several FFTs and IFFTs. In addition, the operator can overcome the coupling of
qP-waves and qSV-waves (Zhang et al., 2009). We demonstrate the method on syn-
thetic examples and propose to incorporate FFD into reverse-time migration in order
to enhance migration accuracy and stability.
Starting from the representation of the acoustic isotropic wave equation for homoge-
neous media in the Fourier wavenumber domain:
@ 2 P^
@t2
= jkj vP^ (k; t) (1)
@ 2 P^
@t2
= (k)P^ (k; t) (2)
where P^ (t; k) is the n-dimensional Fourier transform of P (t; x):
P (t; k) =
1 Z
(2 )n P (t; x)e dx ; (3)
i kx
Alkhalifah 3 Spectral methods
and x represent the space coordinates x = fx; y; zg. The solution to this second-order
ordinary dierential equation is given by
P^ (k; t) = P^ (k; 0)ei (x;k)t : (4)
The re
ects two sets of ingoing and outgoing solutions. For a small enough time
step any inhomogeneous medium can be approximated to be locally homogeneous,
and thus
P^ (k; t + t) = P^ (k; t)ei (x;k)t : (5)
This is synonymous to Huygens principal for plane waves. However, to apply such
an operator in inhomogeneous media we need to access the space domain. Thus, for
inhomogeneous media, we consider a mixed-domain space-wavenumber operator, ,
for time stepping given by
Z
P (t + t; x) = P (t; k) ei (x;k;t) dk ; (6)
In the geometrical (high-frequency) approximation, the function (x; k; t) appearing
in equation 6 should satisfy the appropriate eikonal equation, which is, in the case of
isotropic 3D media, the dispersion relation
v
u !2
@ u 1
= v2(x; y; z) @t
t @
jrT j2; (7)
@z
where v(x; y; z) is the velocity of the medium.
In the case of VTI (vertical transverse isotropy) or TTI (tilted transverse isotropy),
the DSR equation can be eectively extended with the help of the acoustic approxi-
mation of Alkhalifah (1998). For simplicity, we limit the following discussion to the
isotropic 2D case.
If we consider equation 6 as an evolution in time, the initial condition for it is
(x; k; 0) = k x ; (8)
which simply turns equation 6 into an inverse Fourier transform from wavenumber to
space coordinates.
For small steps t, it is appropriate to replace with its Taylor series approxi-
mation
(x; k; t) k x + 0 (x; k) t : (9)
Our nal approximation for the wave extrapolation operator, valid for small t,
is Z
P (t t; x) P (t; k) ei (x;k)t+i kx dk
0
(10)
For a second order accuracy in time, we sum up the contributions of P (t + t; x)
and P (t t; x) to obtain:
Z
P (t + t; x) + P (t t; x) 2 P (t; k) cos [0 (x; k); t] ei kx dk : (11)
Alkhalifah 4 Spectral methods
Thus,
Z
P (t + t; x) 2P (t; x) P (t t; x) + 2 P (t; k) (cos [0(x; k); t] 1) ei kx dk :(12)
Equation 11 is too expensive to implement directly. One can, however, further
approximate it with nite-dierence or Fourier-domain operators.
We can tie the waveeld extrapolation form 11 to the conventional second order space
domain representation we are accustom to and studied last week. This is done by
expanding the cosine function using Taylor series as follows:
cos [0(x; k)t] = 1 t2 0 + 24 t4 40 t6 60
2 2
720 + O 7 : (13)
Using only two terms of the expansion in equation 11, we obtain
Z
P (t + t; x) 2P (t; x) P (t t; x) + 2 P (t; k)
t220 ei kx dk : (14)
2
For acoustic isotropic media, 0 = v(x) jkj, and thus,
P (t + t; x) 2P (t; x) P (t t; x) + v 2 (x)(t)2 r2 P (t; x): (15)
This is our conventional wave equation with the 2nd order time derivative approxi-
mated by a 2nd order nite dierence approximation. The terms dropped in the Tay-
lor's series approximation of the cosine function provides higher accuracy in waveeld
extrapolation using the nite dierence representation of the time derivative. In fact,
for homogeneous media, using the cosine provides exact extrapolation regardless of
t.
In the pseudo spectral approach, space derivatives are computed in the Fourier
domain. This amounts to a nite dierence approximation with order accuracy given
by the number of samples in each dimension. Thus, it results in extrapolations free
of dispersions considering that we have enough samples to properly represent the
wavelength. As a result, equation 15 has the form:
P (t + t; x) 2P (t; x) P (t t; x) + v 2 (x)(t)2 IF F T fjkj F T T fP (t; x)gg: (16)
Unlike the spectral method, we can use Fast Fourier transforms (FFT) and the ex-
trapolation is generally dispersion free granted they are not aliased. However, the
accuracy of the extrapolation now depends on the time step even in homogeneous
media. The accuracy can be evaluated by comparing the exact phase needed to shift
the waveeld, given by the spectral implementation, and one corresponding to the
Taylor's series expansion. We can also evaluate the amplitude to ensure that the
Alkhalifah 5 Spectral methods
pseudo spectral approximate approach does not alter the amplitude by much, have
an amplitude close to one. Using more terms in the expansion of the cosine function
in equation A-4 yields higher accuracy, but requires more FFT's. Accuracy tests are
provided later.
To use the highly accurate spectral method in inhomogeneous media, we have
to nd ways to reduce the cost of the 3-dimensional integral calculation granted the
mixed domain nature of the phase operator. This is done by nding ways to sepa-
rate the space dependency from the wavenumber dependency in the phase operator,
which will allow us to use FFTs. Pseudo spectral methods are one type of approxi-
mation. Next we investigate other approximations that retain the spectral approach
categorization.
Since the cost of evaluating equation 11 for every time step is expensive for inhomo-
geneous media, we can extrapolate many homogeneous media versions and then use
the velocity model to interpolate between these solutions. The number of forward
and inverse FFT's depend on the number of homogeneous media extrapolations. Et-
gen and Brandsberg-Dahl (2009) used two velocities, specically the maximum and
minimum velocities in the model. Thus, equation 11 is evaluated twice per time step
to obtain P1(t + t; x) and P2(t + t; x) corresponding to the minimum (vmin) and
maximum velocity (vmax), respectively. We then use the velocity model, v(x), with
the following formula based on linear interpolation
v (x)
v
P (t + t; x) P (t + t; x) max
1 vmax vmin
+ P (t + t; x) v(x) vmin ; ; (17)
2 vmax vmin
granted that the medium is not homogenous.
A split step implementation is also possible at a cost of a single 3D forward and
inverse Fourier transform per time step.
The spectral approach given by form 11 requires expensive integral evaluations every
time step. In 3D, the cost is of an of order O(n6), which is prohibitive. Note for a
constant velocity, the integrals become classical inverse Fourier transforms in which
we can use Fast divide and conquer methods, like those we learned earlier and the
cost reduces to O(n3(log n)3), which is much more forgiven.
The key idea of the variable seperation is decomposing the wave extrapolation
matrix
W (x; k) = ei [(x;k;t) kx] (18)
Alkhalifah 6 Spectral methods
Let " be a prescribed accuracy of this separated representation, and r" be the numer-
ical rank of W. The construction of the separated representation in equation (21)
follows the method of Engquist and Ying (2007, 2009) and is detailed in the appendix.
The main observation is that the columns of W1 and the rows of W2 should span the
column space and row space of W, respectively, as well as possible. The algorithm
for computing takes the following steps:
1. Pick a uniformly random set S of r" columns of W where is chosen to be 3
or 4 in practice. Perform the pivoted QR factorization to (W(:; S )). The rst
r" pivoted columns correspond to r" rows of the matrix W(:; S ). Dene W1
to be the submatrix of W that consists of these rows and set x1; : : : ; xN with
n = r" to be the corresponding x values of these rows.
Alkhalifah 7 Spectral methods
2. Pick a uniformly random set T of r" rows of W and perform the pivoted QR
factorization to W(T; :). Dene W2 to be the submatrix of W that consists of
these columns and set k1; : : : ; kM with m = r" to be the corresponding k values
of these columns.
3. Set the middle matrix A = Wy(xn; km)1nN;1mM where y stands for the
pseudoinverse.
4. Combining the result of the previous three steps gives the required separated
representation W W1 A W2.
The algorithm does not require, at any step, access to the full matrix W, only to its
selected rows and columns. Once the decomposition is complete, it can be used at
every time step during the wave extrapolation process. In multiple-core implementa-
tions, the matrix operations in equation (19) are easy to parallelize.
where 0 is the phase corresponding to the background medium (velocity, v0). Taking
to be small, we can expand the exponential in equation 25 that includes using
any one of the many series or rational approximations, some will be discussed in the
next section, but most admit the following form:
ei t = 1 + F (t); (26)
where F includes the expansion terms as a function t, using any approach in-
cluding Taylor's series (Etgen, 1989). Inserting equation 26 into equation 25 yields,
Z Z
P (t + t; x) P (t; k) ei 0 t+i kx dk + P (t; k) F (t) ei 0 t+i kx dk: (27)
Combining formulas 24 and 27, I obtain a standalone residual waveeld extrapolation:
Z Z
P (t +t; x) P (t; k) ei t+i kx dk +
0
P (t; k) F (t) ei 0 t+i kx dk; (28)
where P = P0 + P . Note that the second term on the right hand side need to
be computed only when 6= 0. On the other hand, the rst term propagates the
residual waveeld using the background, possibly homogenous, model represented by
0 . This is equivalent to implementing a Born-like approximation at every time step.
Though Born has its limitations in the velocity perturbation, considering the small
time step nature of this implementation the impact of these limitations are heavily
mitigated to allow for a Huygen's principle type wave propagation.
If the background waveeld is obtained for a homogeneous medium, which can
be done analytically, the residual waveeld will approximately address the inhomo-
geneity. Up to this point there is no advantage to extrapolating the residual operator
instead of the full one, other than its potential usage for velocity estimation.
THE EXPANSION
To derive the residual exponential operator using a form that allows us to separate the
background contribution from the residual one, we utilize Taylor's series expansion (to
the second order) of the residual exponential extrapolation operator (Etgen, 1989),
as follows
F = eit 1 = it
t22 1 it33+ t44 + 1 it55 t66 +O 7 :
2 6 24 120 720
(29)
Truncating F to only the rst term amounts to a split-step type implementation.
Using this polynomial based expansion allows us to readily separate the space depen-
dence part (residual velocity) from the wavenumber part (the Laplace operator), in
a form commonly referred to as the pseudo-spectral implementation (Reshef et al.,
1988b). The accuracy of the residual extrapolation relies on the order of the expan-
sion, the amount of velocity residual and the time step of the extrapolation.
Alkhalifah 9 Spectral methods
To improve the accuracy of the Taylor's series expansion I use Shanks transform
to predict the higher-order behavior of the series by introducing a denominator, thus
requiring fewer terms. The rst-order Shanks transform (Bender and Orszag, 1978)
admits the following form
i
F = eit 1 = (30)
1 it2 :
This form, unlike Taylor's series, does not allow us to factor out the velocity requiring
a full spectral implementation. We will later address this issue through additional
approximations. Pade approximations are also possible (Zhang et al., 2004) for the
spectral implementations, but they do not admit a series form required by the residual
formulation given by equation 26.
ACCURACY TESTS
a b
0.10 0.10
0.05 0.05
Φ ErrorH%L
Φ ErrorH%L
0.00 0.00
-0.05 -0.05
-0.10 -0.10
0 5 10 15 20 -1.0 -0.5 0.0 0.5 1.0
-1
kr Ikm M DΥHkmsL
Figure 1: Percent errors in the phase of the extrapolator operator given by the rst-
order (solid black curve) and second-order (solid grey curve) expansions, rst-order
Shanks transform 30 (dashed black curve), and sixth-order Taylor's series expansion
(dashed grey curve, almost zero), as a function of wavenumber for a perturbation
v = 1km=s (a) and perturbation velocity for kr = 10km 1 (b). The model has a
velocity of 2 km/s and a time step of 0.01 s.
average velocity for the denominator reduces the number of required inverse Fourier
transforms for the perturbation part to one instead of 2 for the second-order expan-
sion.
We can also evaluate the amplitude of the approximated phase operator, which
should be one. Figure 3 shows such amplitude for the second-order approximation.
We have to use a time step of 0.02 s (Figure 3c), which is large, to see some errors
especially in the high wavenumber components. Shanks transform provides exact
amplitudes.
a b
0.10 0.10
0.08 0.08
Φ ErrorH%L
Φ ErrorH%L
0.06 0.06
0.04 0.04
0.02 0.02
0.00 0.00
0 5 10 15 20 0 5 10 15 20
-1 -1
kr Ikm M kr Ikm M
Figure 2: Percent errors in the phase of the extrapolator operator given by the
Shanks transform expansion 30 (solid black curve), second-order Taylor's series ex-
pansion(solid grey curve), Shanks transform with the perturbation velocity o by 20%
(dashed black curve), and the perturbation velocity o by 50% (dashed grey curve),
in the negative direction (a) and the positive direction (b). The model has a velocity
of 2 km/s, v = 1km=s and a time step of 0.01 s.
a b c
1.003 1.003 1.003
Amplitude
Amplitude
Figure 3: Amplitude of the exact phase operator (solid curve), equal 1, compared
to that extracted using the second-order Taylor's series expansion in the residual
velocity (dashed curve)., for (a) t = 0:004s, (b) t = 0:01s, and (c) t = 0:02s.
The velocity is equal to 2 km/s and v=1 km/s.
Alkhalifah 12 Spectral methods
0 ! 0 1
n
X X
= eit0 @1 + it i + t2 @ ij A
i=1 (i6=j )
1
X
it3 ij k + R (t; n)A ; (31)
(i6=j 6=k)
where i = vijkj, n is the number of velocity discretization terms (n > 2), and
Q
stands for the product symbol. The function R contains the other terms of the
expansion. For n = 3, R = 0, and for n > 3, R contains terms up to the order
tn. For n =1 2, only the rst two terms of the expansion remain. In this case,
v1 = v2 = 2 v, and thus
F it t2 2 : (32)
Compared to the Taylor's series expansion 30, we are missing the division over two in
the second term. A similar result is obtainable by dividing the time step to articially
smaller ones, but the velocity implementation allows for more options as velocity may
vary with position.
We now test the accuracy of this new implementation. To reduce the number of
inverse Fourier transforms required I will investigate the cases where n=2 and n=4.
For n = 4, we also truncate the product expansion back to two terms stopping at
t2, and thus only consider the rst three terms in brackets in equation 31, which is
equivalent to a second order approximation. Figure 4a shows the percent error in the
phase operator as a function of wavenumber. Among the second-order equivalent (in
cost) implementations, the truncated four-step (n = 4) implementation (dashed grey
curve) has the highest accuracy. This is appreciated even more in Figure 4b where
the errors in the operators are given as a function of the velocity perturbation.
WAVEFIELD EXTRAPOLATION
Using the low rank approach of Fomel et al. (2010) to deal with the mixed space-
wavenumber domain nature of the phase operator function in equation 22, we extrap-
olate waves in inhomogeneous media. The rank of the separable operators (space and
wavenumber dependent) control the number of inverse Fourier transforms required
in each extrapolation step, and thus, the cost. This is typically dependent on the
complexity of the velocity model and the size of time step used in the extrapolation.
We apply the residual extrapolator on the BP model (Billette and Brandsberg-
Dahl, 2004) using a Ricker-wavelet at a point source with a maximum frequency of
50 Hz. The horizontal grid size x is 37.5 m, the vertical grid size z is 12.5 m and
the time step is 1 ms. Figure 5 shows the part of the model with a salt body.
A snap shot of the waveeld at time 3.2 s extracted from waveeld extrapolation
using the low rank method applied to the exact operator given by equation 22 is shown
in Figure 6(a). We compare this reference waveeld with that obtained using the
Alkhalifah 13 Spectral methods
a b
0.10 0.10
0.05 0.05
Φ ErrorH%L
Φ ErrorH%L
0.00 0.00
-0.05 -0.05
-0.10 -0.10
0 5 10 15 20 -1.0 -0.5 0.0 0.5 1.0
-1
kr Ikm M DΥHkmsL
Figure 4: Percent errors in the phase of the extrapolator operator given by the
second-order expansion (solid black curve) and two-step velocity perturbation, which
is equivalent to second order (solid grey curve), four-step velocity perturbation, which
is equivalent to fourth order (dashed black curve), and the four step truncated to
second order (dashed grey curve), as a function of wavenumber for a perturbation
v = 1km=s (a) and as a function of the perturbation velocity for kr = 10km 1 (b).
The background model has a velocity of 2 km/s and an extrapolation time step of
0.01 s.
Though the emphasis here is on accuracy, a residual implementation has potential cost
advantages. Considering a background time extrapolation operator, 0, for homoge-
neous or smoothly inhomogeneous media, the extrapolation of such operators tend
Alkhalifah 14 Spectral methods
REFERENCES
(a) (b)
(c) (d)
Figure 6: Snap shots of the waveeld at 3.2 s using the conventional extrapolation
operator, equation 22 (a), using the linear approximation (b), the dierence (c), and
the dierence between the exact operator and the Shanks transform approximation
(d) for the BP model shown in Figure 5, with a source near the surface.
Alkhalifah 16 Spectral methods
(a)
(b)
Figure 7: Snap shots of the dierence in the waveeld at 3.2 s (a) between the exact
operator and linear approximation, and (b) and the Shanks transform approximation
with the constant average velocity used in the denominator to allow for the residual
implementation. Both plots are at the same scale, 10 times that in Figures 6(a)-6(d).
The cost of implementing both operators is the same.
Alkhalifah 17 Spectral methods
time migration: 79th Ann. Internat. Mtg., Soc. Expl. Geophys., 2849{2853.
Zhang, L., J. W. Rector, G. M. Hoversten, and S. Fomel, 2004, Splitstep complex
padfourier depth migration: SEG, Expanded Abstracts, 23, 989{992.
Zhang, Y., and G. Zhang, 2009, One-step extrapolation method for reverse time
migration: Geophysics, 74, A29{A33.