CIII Communication Theory and Physics
CIII Communication Theory and Physics
D. Gabor
To cite this article: D. Gabor (1950) CIII. Communication theory and physics, The London,
Edinburgh, and Dublin Philosophical Magazine and Journal of Science, 41:322, 1161-1187, DOI:
10.1080/14786445008561157
Article views: 45
B y D. GABOR,
Imperial College, London*.
[Received August 10, 1950.]
SUMMARY.
The electromagnetic signals used in communication are subject to the
general laws of radiation. One obtains a complete representation of a
signal b y dividing the time-frequency plane into cells of unit area and
associating with every cell a " ladder " of distinguishable steps in signal
intensity. The steps are determined b y Einstein's law of energy
fluctuation, involving both waves and photons.
This representation, however, gives only one datum per cell, viz.,
the energy, while in the classical description one has two d a t a : an
amplitude and a phase. It is shown in the second part of the paper that
both descriptions are practically equivalent in the long-wave region, or
for strong signals, as they contain approximately the same number of
independent, distinguishable data, but the classical description is always
a little less complete than the quantum description. In the best possible
experimental analysis by an electronic device the number of distinguishable
steps in the measurement of amplitude and phase is only the fourth
root of the number of photons. Thus it takes a hundred million photons
per cell in order to define amplitude and phase to one per cent each.
Fig. 1.
C~÷I,K
ci,K c4K+J
W
Cz'_l.K _At
oJ dv
L
q,_
--F
II
(Fig. 2.) These share with other functions the p r o p e r t y t h a t their Fourier
t r a n s f o r m s h a v e the same shape, b u t t h e y are unique in t h a t respect
t h a t the p r o d u c t of their " effective " duration a n d of their effective
f r e q u e n c y w i d t h is the smallest possible for a n y function. Thus, it can
be said t h a t these e l e m e n t a r y functions overlap as little as possible.
T h e y h a v e also the a d v a n t a g e t h a t the familiar concepts " amplitude "
and " p h a s e " can be used in connection with t h e m in the same w a y as
with infinite harmonic functions. The complex e l e m e n t a r y function is
Cos Jr jSin, if we denote b y Cos the even, and b y Sin the odd t y p e of
real e l e m e n t a r y signal. Multiplying these with suitable complex
coefficients ci~, as indicated in fig. 1, we can represent a n y a r b i t r a r y
signal. Time-description and frequency-description (Fourier integral}
Fig. 2.
Cosine t'y/z~
[ " _.
L. 5/he t y p e l
Elementary signals of the " cosine type " (even), and of the " sine type " (odd).
* The energies of the elementary signals of the type discussed will not add up
exactly to the energy of the whole signal, because they are not quite orthogonal,
but the error will vanish in the mean over large number of cells. One can,
however, to meet objections, consider instead an orthogonal set of elementary
signals, such as the signals with " limited spectrum ", introduced by Shannon
(1949) and by Oswald (1949, 1950) which have uniform spectral density inside and
zero outside a frequency strip. This makes no difference to the following
discussion, as no reference will be made to any special type of elementary signal.
Communication Theory and Physics 1165
NT, the number of " thermal " photons per cell, is a large number for
the frequencies used in electrical communications. One can use the
approximate formula
bT
- - kT
biT= ~ = ~ - ~=0.7~T
2 . . . . . 2N~2
---- 1-~-2~r {INto(1+2NT)--N~]I/~--[NT(1 +NT)]I/2} ~ (1 +2N--T) 1/2" (7)
Fig. 3.
-_$
f
0
The energy required for the transmission of the first " bit " of information.
p: (7r/4)~n nRn-12Ai~
F(½n+l)
- - F(½n-~-l)(Tr/4)tnn(nS-~)l/~ --~-ASn~~ (½e~rS'~)tn V(n)
ASns_
~ (9)
Fig. 5.
l---z, 1
Analysis of an electromagnetic signal in a wave guide by an electron beam.
u:[1 - A
must be as small as possible. But the smallest value is reached when U
vanishes at. the low-frequency limit, v--½Av, of the band. Substituting
those values into equation (14), one obtains in the optimum case
= 1-~\c] N. . . . . . . (]5)
* Quantal energy exchange between electrons and the field in a wave guide at
high quantum numbers has been previously discussed by Lloyd P. Smith (1946),
but we cannot agree with most of his results. Monokinetic electrons and
exchange of sharply defined quanta on the one hand, well-defined entrance phases
and short transit times on the other, are mutually exclusive phenomena by the
Uncertainty Principle; hence we believe that only certain averages over Smith's
detailed results have physical significance.
Communication Theory and Physics 1173
All special features of the device have vanished in this formula, apart,
perhaps, from the unimportant factor, 1.5. But it is evident that the
factor of N must always be much smaller than unity, while its best value
as will be shown later, is just unity. There exists, however, a further
possibility for improving the performance. Assume that we can make
each electron perform repeated passages through the guide, each transit,
in the opposite direction exactly half a cycle after the last. (This is
possible in principle, as the optimum transit angle is about 134°.) I f
the frequency were known beforehand, the number of passages would
be limited only by the consideration that, by repeated gains or losses,
the electron would be bound to fall out of synchronism. But if the
signal had a single frequency, known in advance, there would of course be
no communication. However, even if the frequency is known beforehand
Fig. 6.
nnn
Ifalqql |
UU
Repeated passages.
only within v±½Av, one can make the number P of passages as great as
v/Av, without risking a phase error of more than i½~r, and it can be shown
that these passages are almost of equal value, so that ~ is increased very
nearly by a factor__ P. The number of passages required to make the
coefficient of N in equation (15) unity is
Popt= 9.5 (v)l/~ \~-~v] . . . . . . . (16)
i.e., at least of the order ten. But this number must not exceed v/Av ;
hence we obtain the condition that, in order to realize optimum conditions,
the frequency band must be so restricted that
>20-2 . . . . . . . . (17)
Fig. 7.
1 f/~Oenera[ law
o 3 9 lo
Mean quantum exchange between electrons and photons. The initial tangent
is calculated from wave mechanics, the asymptotic parabola classically.
Apart from the factor 2/3, the coefficient of N is" the same in both cases,
but this time the quantum exchange ~ is proportional to the photon
number itself, not to its square root It can be said, therefore, that
f o r small photon concentrations, the device acts as a counter, at large con-
centrations, as a field-measuring instrument. The intermediate region is
difficult to calculate, but, as shown in fig 7, the two branches can be
connected by a plausible curve.
One can also interpret the results in this way: If there are few photons
present, there will be few collisions, and--as shown in Appendix I I I . - -
equal probabilities of gains and losses, at any instant. With increasing
photon concentration, repeated collisions will increase in number, and the
resulting loss or gain increases with the square root of the photon number
only, b u t this resultant has now a prevailing direction, which changes
Communication Theory and Physics 1175.
its sign with the frequency of the signal. At this stage the " classical
field " has developed.
Having ascertained that, with certain reservations, we can make the
exchange as strong as w e l i k e , we ask the question: If we know the
average photoa number N, how must we adjust the electron beam
current J, and the exchange parameter ~ in order to measure the field
amplitude E with maximum accuracy ? And having made these adjust-
ments, how many steps shall we be able to distinguish in the scale of the
field amplitudes ? Evidently this question has a precise meaning only in
the " classical" range of large ~ and N, and the following considerations
relate only to this case. In order to simplify the problem, we neglect
the thermal noise, i.e., we put NT~-0 , so that the relative accuracy on
the photon scale would be 1/N 1/2, and the total number of steps in the
photon ladder 2N 1/2. The calculations are carried out in Appendix IV.,
here we give only the physical considerations
The quantity to be measured is the electric amplitude in the information
cell, which is proportional to the square root of the photon number. The
measured quantity, on the other hand, is the alternating electron current,
which, as mentioned above, is proportional to ~. J or to n. M for not too
strong signals, M being the mean number of exploring electrons per cell.
For the optimum, we impose the condition that the relative mean square
deviation of the quantity measured from the quantity to be measured
shall be as small as possible, i.e.,
(nM--CN1/~) 2
=rain, . . . . . . . (20)
(uM)~
where the proportionality factor C is determined from the condition
(nM--CNlI2)___0.
We have to choose n and M so as to satisfy the condition (20) for given N.
There must be an optimum, for these reasons: A too weak interchange
would leave the cell unexplored. A too strong interchange, on the other
hand, will interfere with the object of the measurement and spoil it. Though
in the mean electrons are as often accelerated as retarded, fluctuations
in the numbers M1 and M 2 of electrons which pass through accelerating
and retarding phases might produce extra photons, which could not be
distinguished from those belonging to the signal, or annihilate some.
The spurious photons are generated according to a law
~N-~(M1--M2)-~n(~MI--~M2) . . . . . (21)
as M1----M2-~½M. We have written 8.zN for this number, considering it
as a fluctuation which must be added to the natural fluctuation 3~N,
whose law is 8~N2=N. The two fluctuations must be considered as
independent.
It is already evident from the above that the fluctuations in the number
of beam electrons, i.e., the " shot effect ", play an important part in
these phenomena. A too weak current has a high relative fluctuation.
A too strong current, especially aided b y a large exchange, will again spoil
1176 D. Gabor on the
the object. It may be noted that we have here a type of uncertainty which
springs directly from the fact that photons and electrons are discrete, without
any reference to the physical values of h and of e.*
The relative error according to equation (20) is calculated on the basis of
equation (21), together with such evident assumptions as the independence
-of the fluctuations of n and M and of the "natural" part of 6N. We
assume also '' normal " shot effect, ~ M Z = M . The result is
.As we are dealing with large photon numbers only, the first term a t the
right-hand side can be neglected with respect to the second. Thus we
.see, applying the same rule which we have used in constructing the
photon ladder, that the smallest distinguishable relative step in the
.amplitude scale is ~ ' times
2 larger than the square root of the corre-
sponding quantity in the photon scale. I n other words, the proper
scale of the amplitzLdes will contain a l w a y ~less than the sqmre root of the
number of steps in the photon scale; apart from the factor 4 2 for the
reason that the optimum setting is, of course, possible for one level only.
Having determined the proper scale of the amplitudes, a simple
.application of the Uncertainty Principle (Appendix IV.) shows that the
proper scale of the phase must also contain less steps than the square
root of the photon scale. Thus, summing up, we see that the classical
description of the signal, by being too detailed, gives in fact a somewhat
smaller total amount o f 6nformatiok than the qua&mn description.
The classical methdd of description, though theoretically inferior, may
of course be still the best practically in the range of frequencies used for
electrical communications, where efficient photon counters are not
* I t may be noted, however, that the shot effect, that is to say the random
arrival of t,he exploring electrons, is a practical rather than a fundamental
limitation. As Prof. R. E. Peierls has pointed out to me, it must be ideally
possible to measure amplitude arid phase simultaneously up to the limit given
by the relation 12. In fact if one could make the exploring electrons arrive at
regular intervals, all terms but the first on the right-hand side of equation 22
would vanish. But as it is practically impossible to suppress the shot effect to
any significant degree, our results retain their practical importance.
Communication Theory and Physics 1177
]~EFERENCES.
BoR~, IV[., 1949, Natural Philosophy of Cause and Chanve (Oxford:
University Press), p. 81.
CARSON, J. R., and F~Y, T. C., 1937, Bell Syst. T. J., 16, 513.
GABOR, D., 1946, Journ. I.E.E., 93, III, 429 ; 1947, Ibid., 94, III, 369 ; 1947,
Nature, Lond., 159, 591.
I~EITLER, W., 1944, The Quantum Theory of Radiation (Oxford: University
Press, 2rid edn.).
JOrDAn, P., 1933, Statistische Mechanilc (Braunschweig : Fr. View•g).
vow LAu]~, M., 1914, Ann. d. Phys. [4] 44, 1197.
MACDON~LD, D. K. C., and Ko~P~E~, R., 1949, Proc. I.R.E., 37, 1424.
MACKAY, D. M., 1950, Phil. Mag. [7] 41, 189.
NYQws% H., 1928, Phys. Rev., 32, 753.
OSWALD, J., 1949, C.~., 229, 21.
OSWALD, J., 1950, Cables et Transmission, 2, 197.
VAn D ~ POL, B., 1930, Proc. I.R.E., 18, 1194 ; 1946, Journ. I.E.E., 93, III, 153.
SHA~O~, C. E., 1948, Bell Syst. T.J., 27, 379, 623 ; 1949, Proc. I.R.E., 37, 10.
S~rH, L. P., 1946, Phys. Rev., 69, 195.
SZmXRD, L., 1925, Zeitschr. f. Phys., 32, 753, 1925 ; 1929, Ibid., 53, 840.
TELLER, W. G., 1949, Proc. I,R.E., 37, 468.
VILLE, J. A., 1948, Cables et Transmissions, 1, 61.
1178 D. Gabor on the
APPENDIX I.
ENERGY FLUCTUATIONS IN AN INFORMATION CELL IN THE PRESENCE
OF A SIGNAL.
As in the case of t h e r m a l equilibrium, the m e a n square energy
fluctuation is the sum of a classical and of a q u a n t u m term.
The classical term. Consider, for simplicity, a (complex) Fourrier-
c o m p o n e n t E s of the signal, and a c o m p o n e n t E T of the t h e r m a l noise,
corresponding to two different (circular) frequencies, say, wl and ~o~.
The instantaneous e n e r g y density, resulting from the interference, is
proportional to
E s E ~ ' + E T E ~ + {EsE ~ exp [ j ( w l - - w 2 ) t ] + E ~ E T exp [ - - j ( % - - w2)t] },
where the asterisks stand for the conjugate complex values. The first
two terms are the energy of the signal and the energy of the noise, the
rest arises from interference. (Beats.) L e t us write
e=eS+eT+EST.
The m e a n value of the interference energy ~sT is nil, b u t its m e a n square is
2 *
%,r~--2EsEs . ETE~=2~se T.
Using this and the relations
ESEST ~ ~TEST = 0
which are evident, as there is no correlation between the signal and the
noise, one obtains
(~-~)'~ = [(Es + ~ + %T) - (% +~T)] 2 = ~-~ + 2 ~s~T"
.One knows the first two t e r m s from Lorentz's calculation, which gives,
in the absence of a signal
2 -2 -2
ET - - ET - ET
hence (e--~)2=2¢S~T+~,
or, as %=E--ET,
(~--~)~L=(2~--~T)~T . . . . . . . . (I.1)
This is the classical p a r t o f the fluctuation, arising from t h e interference
of waves. The quantum term is always given b y the " law of rare events "
(~--~)~u.=hv~ . . .. . . . . . (I.2)
as if the energy were present in the form of particles (photons), with
energy hr. Adding (I.1) and {I.2), one obtains e q u a t i o n (4).
APPENDIX II.
CLASSICAL ENERGY EXCHANGE BETWEEN A WAVE AND AN ELECTRON
BEAM.
I n a rectangular wave guide with cross-section a × b (fig. 5), the com-
p o n e n t s of the electric field are, in the TE01 mode,
= 0cos
Communication Theory and Physics 1179
V = e E l - - (\267]c
~2-]1=_1
Thus the mean electric energy is, per unit length of wave guide,
1 i_ 2
8¢r 4 E° ab,
and the mean total energy, electric and magnetic, is twice as much.
This energy moves with the group velocity U=c~/V. The mean number
of photons in the information cell is obtained b y equating the energy
flux expressed by N and expressed b y E 0. As the cell occupies a time
A t = I / A v , the flux per second, i.e., the power, is
-- i 1 F [ c ~2]i/~.
hvNAv = ~ ½E~abU = ~ E2°abc h 1 -- \2b-v~] .J " (II. 1 )
= E dx = I E dt
J --1/2a J to
_i-kFfQ] 7-N
I 32 sine0 v [1 [ e "~27-1/~Av--
--137 r~ 0 vb_ -\2-b-v] J TN" (II.3)
As explained in the text, the coefficient of N must be made as large as
possible. The depth a appears only in the form sin 2 0/0, whose maximum
value 0.723 is reached at 0 = 6 7 °, i.e., at a transit angle of 134 °. The
width b, on the other hand, appears in the factor
1/b [1 / c \2ql/2
1180 D. Gabor on the
assuming Av/v < 1, i.e., the band to be narrow. Substituting these values,
one obtains
1-~ c \-~-] N . . . . . . . (II.4}
which is equation (15) of the text.
I f repeated passages are used, it is evidently permissible to consider
them of equal value, so long as their number P is small. I t m a y be asked
when this assumption will lead to an appreciable error. An estimate can
be made b y introducing the concept of the "instantaneous frequency"*
which will vary slowly between the limits v~½Av. A somewhat long
calculation, which m a y be omitted, gives the result that for large P's the
factor of ~ is not exactly P but approximately
APPENDIX Ill.
ENERGY EXCHANGE OF ELECTRONS AND W E A K FIELDS ACCORDING TO
QUANTUM MECHANICS.
We apply to the problem the standard perturbation method of wave
mechanics. As the beam width can be considered as small in comparison
to the spatial periods 0 f t h e field, it is sufficient to start from Schr0dinger's
one-dimensional equation with vector potential A z,
h OT h~ 02T ieh . @T
2~ri Ot = 8~r2m'Ox 2 ~-~-m-~Ax ~-~. (III.ly
We put
A x = A o cos ~ot, Ay----A~-~0, o~o=2~vo,
* This concept is due to I-Ielmholtz and has been first applied in communication
theory by Balth. v.d. Pol. (1930). Cf. also J. R. Carson and T. C. Fry (1937).
Communication Theory and _Physics 1181
dc m e O~m (III.2)
f ¢*¢~ d x = ~ rim.
Multiplying equation (IIL2) by T*, integrating over the whole domain and
making use of the orthonomality conditions, we obtain ordinary differential
,equations for the coefficients %(0 in the form
dc r ~'eAo _ .
-- :i ~ Z c,~pmr{ex p [i(~o0+~o~)t]+exp [--i(wo--wm)t]} ,
dt men ,~
(111.3)
hr,O
where Pro,= ~ J~b, - ~ ~,~ dx
{\mt, o] Ipo, is +
There are several interesting features in which this differs from the classical
result. N o t e first, t h a t t h e expression is even in wr, hence an electron
has the same probability to gain or to lose a certain a m o u n t of energy.
N o t e also t h a t only the last t e r m depends on the phase of the electric field
at the instant t o, the others d e p e n d only on the interaction time t - - t o . B u t
even this last t e r m has a f r e q u e n c y twice t h a t of the electric field. I t is
r a t h e r d o u b t f u l w h e t h e r this corresponds to an e x p e r i m e n t a l l y observable
effect. Our calculation re]ares to weak fields, where ~ will be smaller t h a n
u n i t y ; b u t in order to observe even n---- 1, the electron b e a m m u s t be mono-
chromatized to such an e x t e n t t h a t its entrance phase becomes indefinite
within a whole cycle. This is of no i m p o r t a n c e for our subsequent
calculations, as we will consider only the m e a n value of (III.4), averaged
over the entrance times to, in which the last t e r m vanishes.
There remains now the problem to a p p l y e q u a t i o n (III.4), which is a
well-known result of wave mechanics, to our problem of an electron
traversing the oscillating field between two conducting plates. This means
calculating the m a t r i x of the (mechanical) m o m e n t u m p. We will evaluate
this b y a classical method, m a k i n g use o f the correspondence principle.
This is justified in our case, as the de Broglie wavelength of the electrons
is always v e r y small with respect to the distance a between the plates.
I n order to simplify the calculations, and to avoid singularities, we
replace the electron b y a plane density wave of t o t a l charge e (per unit
cross-section)
D(x) is an " annihilation factor " which is u n i t y inside the guide, i.e., for
--½a ~ x ~½a, and zero outside. A p a r t from this, i.e., ff the electron is at
more t h a n a b o u t w from the wails, the distribution is gaussian. ~ is a
small time, with which we will go u l t i m a t e l y to the limit zero. I t will
m a k e the calculations easier if for the start we ignore the factor D(x)
and m a k e use of it only towards the end.
W e m a k e use of the F o u r i e r formula
E = I ® E~dv.
J --C~
O oob ain
for the progressive field waves which accompany the free electron. But in
a plane condenser with boundaries at x = ± ½ a , this field induces surface
charges
%(~=½a)=T~rE~(~a)=T~-~ex p --2~iu t T ~ ,
take the absolute square of the matrix elements to form the quantities
]P0r [2 which figure in equation (III.4). But here we have to do with
continuous states, and we must also remember that the oscillators,
according to equation (III.6), replace the electron during the finite transit
time only. I n order to obtain the equivalents of t h e " oscillator strengths"
I P0r I~, we must now multiply the momentum amplitudes P~ dv with the
conjugate amplitudes P* dtz which belong to another interval/z, d/~ ; we
must integrate over the whole domain of the t~, and finally average over the
transit time a/v. I t is to say that we must calculate, instead of ! P0r [2,
V r½a/v (
]P0, [2 d r = 2 - dv | dt / P,P* d/z. (III.7)
a d - ½al. d -
~vv2f~_ ~ sin½0(lq-x).sin½0(1--X)l
-- x ~ dx = ~vv2~feosOx-cOSOo 1 -- x 2 dx-----lsinO'v
thus finally
(mv'~ 2v sin20
v dr.
] P0, I~ dv = 2 \--~--/ a --'-K- ..... (III.8)
This means simply that during the transit time a/v the coherence region of
any frequency v is v±v/2a, with a bandwidth v/a, whieh is the reeiproeal of
the transit time. A frequency v cooperates with any frequency/z inside
this band in producing the oscillator strength.
Substituting (III.8) instead of ]P0r 12 into equation (III.4),,where we
drop the last term whose mean value is zero, and replacing t--t o by the
transit time a/v, we obtain
1/2~re~ E~acv dv sin2 (~rvatv) ~Sing ~r<voq-v)a/v sin~r(vo--v)a/v~
(III.9)
This is the probability for an electron to be, after the passage, in a state
v, dr, that is to say, to have absorbed the energy hr. Thus the energy
spectrum of the originally monokinetic electrons after the passage through
the field is of the form
sin 2 Of sin 2 (0+0o) sin 2 (0--0o) ~
S ( O ) - - - - - ~ [ ~ff÷-~o)2 q- ~-~o)2 j , (III.10)
Communication Theory and Physics 1185
where the frequencies (and energies) are expressed b y the half transit-
angles
O=rrva/v, Oo=rn,oa/V.
This function is shown in fig. 8 for a few values of 0o. Experimental
checking, t h o u g h difficult, m a y not be impossible (cf. Maedonald a n d
K o m p f n e r 1949).
The mean energy exchanged with the field, lost or gained, is by (III.10)
1 E~acv
~h~o = ~J o~ h~ I ~ I~ d~ - 137 4~3v~ F(0°)' (III.ll)
Fig. 8.
2
%,
1.5
The function S(0), equation (III.10), which gives the energy distribution of
electrons after the transit. Gains and losses have equal probabilities.
The " resonance point " at which the electron has gained or lost one
quantum hv0 of the oscillating field is at 0 = 0o.
F(0o)
; dO['sin 2 (0+0o)
~o ~ s in2 (0-00)7
Jo YL ~+-~o)~ ~ J
F o r 0 ~ 67 °, which was the most favourable case in the classical theory, t h e
value of the integral is found to be 1.22. Substituting this into equation
(III.11) and expressing, as before the field E o b y the n u m b e r of photons, N,
b y means of equation (II.1), and finally giving the wave guide the same
width b which was found the best in the classical case, one finds
137 c
where we have again written v for the field frequency, instead of vo. This
is the energy exchange in weak fields, discussed in the text.
1186 D. G a b o r on the
APPENDIX IV.
COI~TDITIO:NSFOR OPTIMUM EXPLORATION OF ELECTRIC FIELDS BY
ELECTRONS.
As explained in the t e x t , we a d o p t as the criterion of o p t i m u m measure-
m e n t the condition t h a t
(nM._CN~'~)~
(nM) 2
must be as small as possible. The p r o p o r t i o n a l i t y factor C is given b y the
condition
(riM -- CN ~/~)= 0,
or, as we are dealing here only with the " classical " case, in which the
fluctuations are relatively small, C = - n M . (N) -1~'. As the fluctuations of n,
the energy exchange p a r a m e t e r , and of M, the electron number, can be
s u p p o s e d as i n d e p e n d e n t of one another, we can write nM----~. M.
L e t us now first calculate
+ C~N1/2 +2l~ )
1~2 M )
1/22 ~ M 2n+ 1c 2 N ,
(IV.D
where the first t e r m is zero.
I n order to calculate the last term, we consider the fluctuation ~N o f
the photons as the sum of two i n d e p e n d e n t c o m p o n e n t s 8N1 and ~N2
~N=SNlq-~N2,
o f which the first represents t h e " n a t u r a l " f l u c t u a t i o n s , subject to the law
~BN~-=I~I, and the second is due to the exploring electrons, i.e., it is the excess
Communication Theory and Physics 1187