Multiresolution Image Processing: Image Pyramids and Subband Coding - Prof. S. Todorovic, Study notes of Electrical and Electronics Engineering

Multiresolution image processing, specifically image pyramids and subband coding. The motivation for multiresolution analysis, the construction of image pyramids, typical filters used, and perfect reconstruction. Subband coding is also explained, including the use of biorthogonal filters and orthonormal filter banks.

Typology: Study notes

Pre 2010

Uploaded on 08/30/2009

koofers-user-4ar
koofers-user-4ar ๐Ÿ‡บ๐Ÿ‡ธ

10 documents

1 / 14

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
ECE 468: Digital Image Processing
Lecture 9
Prof. Sinisa Todorovic
1
Multiresolution Image Processing
โ€ขInformal motivation:
โ€ขImages may show both very large and very small objects.
โ€ขIt may be useful to process the images at different resolutions.
2
pf3
pf4
pf5
pf8
pf9
pfa
pfd
pfe

Partial preview of the text

Download Multiresolution Image Processing: Image Pyramids and Subband Coding - Prof. S. Todorovic and more Study notes Electrical and Electronics Engineering in PDF only on Docsity!

ECE 468: Digital Image Processing

Lecture 9

Prof. Sinisa Todorovic

[email protected]

1

Multiresolution Image Processing

โ€ข Informal motivation:

โ€ข Images may show both very large and very small objects.

It may be useful to process the images at different resolutions.

Multiresolution Image Processing

  • A more formal motivation:

An image is a 2D random process with locally varying

statistics of pixel intensities

Analysis of statistical properties of pixel neighborhoods of

varying sizes may be useful

3

Histogram of Small Pixel Neighborhoods

Steps to Construct the Image Pyramid

1. Given an image at level j

2. Filter the input and and downsample the filtered result by

a factor of 2; This gives the image at level j-

3. Goto 1

4. Upsample and filter the image at level j-1; this gives an

approximation of the image at level j

5. Subtract this result from the image at level j; this give the

prediction residual at level j

6. Goto 1

7

Typical Filters

  • For the multiresolution pyramid, we use spatial filters:
    • Neighborhood averaging
    • Lowpass Gaussian filter
  • For the residual pyramid, we use interpolation filters:
    • bilinear
    • bicubic

Upsampling/Downsampling

  • Upsampling = Inserting zeros
  • Downsampling = Discarding pixels

f 2 โ†‘

(x, y) =

{

f (x/ 2 , y/2) , x, y are even

0 , o.w.

f 2 โ†“

(x, y) = f (2x, 2 y)

9

Subband Image Coding

Subband Image Coding

g 0 (n) = (โˆ’1)

n

h 1 (n)

g 1

(n) = (โˆ’1)

n+ h 0

(n)

for perfect reconstruction:

13

Subband Image Coding

g 0 (n) = (โˆ’1)

n

h 1 (n)

g 1

(n) = (โˆ’1)

n+ h 0

(n)

for perfect reconstruction:

flp(n) =

f (2n)! h 0

(2n) , 2 n

0 , 2 n + 1

f hp

(n) =

f (2n + 1)! h 1

(2n + 1) , 2 n + 1

0 , 2 n

Subband Image Coding

g 0 (n) = (โˆ’1)

n

h 1 (n)

g 1

(n) = (โˆ’1)

n+ h 0

(n)

for perfect reconstruction:

flp(n) =

f (2n)! h 0

(2n) , 2 n

0 , 2 n + 1

f hp

(n) =

f (2n + 1)! h 1

(2n + 1) , 2 n + 1

0 , 2 n

f = f (2n)! h 0

(2n)! g 0

(2n) + f (2n + 1)! h 1

(2n + 1)! g 1

(2n + 1)

13

Subband Image Coding

g 0 (n) = (โˆ’1)

n

h 1 (n)

g 1

(n) = (โˆ’1)

n+ h 0

(n)

for perfect reconstruction:

flp(n) =

f (2n)! h 0

(2n) , 2 n

0 , 2 n + 1

f hp

(n) =

f (2n + 1)! h 1

(2n + 1) , 2 n + 1

0 , 2 n

f = f (2n)! h 0

(2n)! g 0

(2n) + f (2n + 1)! h 1

(2n + 1)! g 1

(2n + 1)

f = f (2n)! h 0 (2n)! h 1 (2n) + f (2n + 1)! h 1 (2n + 1)! h 0 (2n + 1)

Vector Inner Product

Given sequences

f 1

(n), f 2

(n)

ใ€ˆf 1

, f 2

ใ€‰ =

โˆ‘

n

f

โˆ—

1

(n)f 2

(n)

14

Subband Image Coding

g 0

(n) = (โˆ’1)

n

h 1

(n)

g 1

(n) = (โˆ’1)

n+

h 0

(n)

h 0 , h 1 , g 0 , g 1 are biorthogonal

ใ€ˆh i

(2n โˆ’ k), g j

(k)ใ€‰ = ฮด(i โˆ’ j)ฮด(n), i, j = { 0 , 1 }

Subband Image Coding

g

0

(n) = (โˆ’1)

n

h

1

(n)

g

1

(n) = (โˆ’1)

n+

h

0

(n)

h 0 , h 1 , g 0 , g 1 are biorthogonal

ใ€ˆh

i

(2n โˆ’ k), g

j

(k)ใ€‰ = ฮด(i โˆ’ j)ฮด(n), i, j = { 0 , 1 }

Example:

ใ€ˆh

0

(2n โˆ’ k), g

1

(k)ใ€‰ = 0

15

Subband Image Coding

g

0

(n) = (โˆ’1)

n

h

1

(n)

g

1

(n) = (โˆ’1)

n+

h

0

(n)

h 0 , h 1 , g 0 , g 1 are orthonormal

ใ€ˆh

i

(2n โˆ’ k), g

j

(k)ใ€‰ = ฮด(i โˆ’ j)ฮด(n), i, j = { 0 , 1 }

ใ€ˆg

i

(n), g

j

(n + 2m)ใ€‰ = ฮด(i โˆ’ j)ฮด(m), i, j = { 0 , 1 }

Example: Orthonormal Filter Bank

g 1

(n) = (โˆ’1)

n

g 0

(K even

โˆ’ 1 โˆ’ n)

h

i

(n) = g

i

(K

even

โˆ’ 1 โˆ’ n), i = { 0 , 1 }

= g 0

(n)

18

Example: Orthonormal Filter Bank

g 1

(n) = (โˆ’1)

n

g 0

(K even

โˆ’ 1 โˆ’ n)

h

i

(n) = g

i

(K

even

โˆ’ 1 โˆ’ n), i = { 0 , 1 }

= g 0

(n)

= g 1

(n)

Example: Orthonormal Filter Bank

g 1

(n) = (โˆ’1)

n

g 0

(K even

โˆ’ 1 โˆ’ n)

h

i

(n) = g

i

(K

even

โˆ’ 1 โˆ’ n), i = { 0 , 1 }

= g 0

(n)

= g 1

= h (n) 0

(n)

18

Example: Orthonormal Filter Bank

g 1

(n) = (โˆ’1)

n

g 0

(K even

โˆ’ 1 โˆ’ n)

h

i

(n) = g

i

(K

even

โˆ’ 1 โˆ’ n), i = { 0 , 1 }

= g 0

(n)

= g 1

= h (n) 0

(n) = h 1

(n)