Lecture 7:

Image coding and

compression
Robin Strand
Centre for Image Analysis
Swedish University of Agricultural Sciences
Uppsala University

Today

Information and Data

Redundancy
Image Quality
Coding
Compression
File formats

Redundancy

information and data

Data is not the same thing as information.
Data is the means with which information is expressed.
The amount of data can be much larger than the amount
of information.
Redundant data doesn't provide additional information.
Image coding or compression aims at reducing the
amount of data while keeping the information by
reducing the amount of redundancy.

Definitions
data
data redundancy (i.e., data after compression)
Compression ratio
Relative redundancy

Different Types of Redundancy

Coding Redundancy
Some gray levels are more common than other.

Interpixel redundancy
The same gray level may cover
a large area.

Psycho-Visual Redundancy
The eye can only resolve about
32 gray levels locally.

M.C. Escher 1948

Image Coding and Compression

Image Compression
Image compression can be:
Reversible (lossless), with no loss of information.
The image after compression and decompression is
identical to the original image. Often necessary in image
analysis applications.
The compression ratio is typically 2 to 10 times.
Non reversible (lossy), with loss of some information.
Lossy compression is often used in image communication,
compact cameras, video, www, etc.
The compression ratio is typically 10 to 30 times.

Image Coding and Compression

Image coding
How the image data can be represented.

Image compression
Reducing the amount of data required to represent an
image.
Enabling efficient image storing and transmission.

Objective Measures of Image Quality

Error
Total Error
Root-Mean-Square

Subjective Measures of Image Quality

Problem
The objective image quality measures previously shown
does not always fit with our perception of image quality.

Solution
Let a number of test persons rate the image quality of the
images on a scale. This will result in a subjective measure
of image quality, or rather fidelity, but it will be based on
how we perceive the quality of the images.

10

11

Measure the amount of data

The amount of data in an
equal to
, where

image with

gray levels is

is the number of bits used to represent gray level

and
is the probability of gray level in the image.

Example 3-bit image

dfs

12

Dealing with coding redundancy

Basic idea: Different gray levels occur with different

probability (non uniform histogram). Use shorter code words
for the more common gray levels and longer code words for
less common gray levels. This is called Variable Code Length.

13

Huffman Coding
First
1. Sort the gray levels by decreasing probability
2. Sum the two smallest probabilities.
3. Sort the new value into the list.
4. Repeat 1 to 3 until only two probabilities remains.
Second
1. Give the code 0 to the highest probability, and the code 1 to
the lowest probability in the summed pair.
2. Go backwards through the tree one node and repeat from 1
until all gray levels have a unique code.

14

Example of Huffman coding

15

Example of Huffman coding

16

Example of Huffman coding

17

Example of Huffman coding

18

Example of Huffman coding

19

Example of Huffman coding

20

Example of Huffman coding

21

Huffman Coding
First
1. Sort the gray levels by decreasing probability
2. Add the two smallest probabilities.
3. Sort the new value into the list.
4. Repeat 1 to 3 until only two probabilities remains.
Second
1. Give the code 0 to the highest probability, and the code 1 to
the lowest probability in the summed pair.
2. Go backwards through the tree one node and repeat from 1
until all gray levels have a unique code.

22

Example of Huffman coding

Assigning codes

23

Example of Huffman coding

Assigning codes

24

Example of Huffman coding

Assigning codes

25

Example of Huffman coding

Assigning codes

26

Example of Huffman coding

Assigning codes

[email protected]

27

Example of Huffman coding

Assigning codes

28

Example of Huffman coding

Assigning codes

29

30

Example of Huffman coding

( Before Huffman coding

Huffman Coding
The Huffman code is completely reversible, i.e., lossless.
The table for the translation has to be stored together with
the coded image.
The resulting code is unambiguous.
That is, for the previous example, the encoded string
011011101011 can only be parsed into the code
words 0, 110, 1110, 1011 and decoded as 7, 4, 5,
0.
The Huffman code does not take correlation between
adjacent pixels into consideration.

31

Interpixel Redundancy

Also called spatial or geometric redundancy

Adjacent pixels are often correlated, i.e., the value of
neighboring pixels of an observed pixel can often be
predicted from the value of the observed pixel.
Coding methods:
Run-length coding
Difference coding

32

Run-length coding
Every code word is made up of a pair (g,l) where g is the
gray level, and l is the number of pixels with that gray
level (length or run).
56 56 56 82 82 82 83 80
E.g.,
56 56 56 56 56 80 80 80

creates the run-length code (56,3)(82,3)(83,1)

(80,4)(56,5)
The code is calculated row by row.

33

Difference Coding
Keep the first pixel in a row. The rest of the pixels are
stored as the difference to the previous pixel
Example:
original 56 56 56 82 82 82 83 80 80 80 80
code
56 0 0 26 0 0 1 -3 0 0 0

The code is calculated row by row.

Both run-length and difference coding are reversible
and can be combined with, e.g., Huffman coding.

34

Example of Combined Difference and

Huffman Coding

Number of bits used to represent

the gray scale values: 4
Lavg=4

35

36

Huffman Coding

Lavg=3.01
CR=4/3.01=1.33

37

Difference Coding and Huffman Coding

Lavg=2
CR=4/2=2

LZW Coding
LZW, Lempel-Ziv-Welch
In contrast to Huffman with variable code length LZW uses fixed
lengths of code words which are assigned to variable length
sequences of source symbols.
The coding is done from left-to-right and row-by-row.
Requires no a priori knowledge of the probability of occurrence of
the symbols to be encoded.
Removes some of the interpixel redundancy.
During encoding a dictionary or code-book with symbol
sequences is created which is recreated when decoding.

38

Psycho-Visual Redundancy
If the image will only be used for visual observation much of the
information is usually psycho-visual redundant. It can be removed
without changing the visual quality of the image. This kind of
compression is usually lossy.
50 kB (uncompressed TIFF)

5 kB (JPEG)

39

Transform Coding

40

Divide the image into blocks.

Transform each block with discrete cosine transform or
discrete Fourier transform.
The transformed blocks are truncated to exclude the least
important data.

Code the resulting data using

variable length coding, e.g.,
Huffman coding in a zigzag scan
pattern.

41

JPEG: example of transform coding

File size in bytes
JPEG quality
9486
100 %

3839
90 %

2086
80 %

1711
60 %

1287
40 %

822
20 %

533
10 %

380
5%

File Formats with Lossy Compression

JPEG, Joint Photographic Experts Group, based on a
cosine transform on 8x8 pixel blocks and Run-Length
coding. Give arise to ringing and block artifacts.
(.jpg .jpe .jpeg)
JPEG2000, created by the Joint Photographic Experts
Group in 2000. Based on wavelet transform and is
superior to JPEG. Give arise only to ringing artifacts and
allows flexible decompression (progressive transmission,
region of interest, ...) and reading. (.jp2 .jpx)

42

File Formats with Lossless Compression

TIFF, Tagged Image File Format, flexible format often supporting
up to 16 bits/pixel in 4 channels. Can use several different
compression methods, e.g., Huffman, LZW.
GIF, Graphics Interchange Format. Supports 8 bits/pixel in one
channel, that is only 256 colors. Uses LZW compression.
Supports animations.
PNG, Portable Network Graphics, supports up to 16 bits/pixel in
4 channels (RGB + transparency). Uses Deflate compression
(~LZW and Huffman). Good when interpixel redundancy is
present.

43

Vector based file formats

Uses predefined shapes

44

Vector based file formats

PS, PostScript, is a page description language developed in 1982 for
sending text documents to printers.
EPS, Encapsulated PostScript, like PS but can embed raster images
internally using the TIFF format.
PDF, Portable Document Format, widely used for documents and are
supported by a wide range of platforms. Supports embedding of
fonts and raster/bitmap images. Beware of the choice of coding.
Both lossy and lossless compressions are supported.
SVG, Scalable Vector Graphics, based on XML supports both static
and dynamic content. All major web browsers supports it (Internet
Explorer from version 9).

45

Choosing image file format

46

Image analysis
Lossless formats are vital. TIFF supports a wide range of different
bit depths and lossless compression methods.
Images for use on the web
JPEG for photos (JPEG2000), PNG for illustrations. GIF for small
animations. Vector format: SVG, nowadays supported by web
browsers.
Line art, illustrations, logotypes, etc.
Lossless formats such as PNG etc. (or a vector format)

Lossy, lossless, and vector graphics

47