Stereo Vision: Recovering Depth Information and Finding Correspondences - Prof. Ramani Dur, Study notes of Computer Science

An overview of stereo vision, a technique used to recover depth information from two or more images. It explains the concept of stereo vision, the importance of solving the correspondence problem, and various methods for finding correspondences. The document also discusses the epipolar constraint and photometric constraint, which are used to improve matching accuracy. It includes references to relevant research papers.

Typology: Study notes

Pre 2010

Uploaded on 07/30/2009

koofers-user-9gv
koofers-user-9gv 🇺🇸

10 documents

1 / 32

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Stereopsis
pf3
pf4
pf5
pf8
pf9
pfa
pfd
pfe
pff
pf12
pf13
pf14
pf15
pf16
pf17
pf18
pf19
pf1a
pf1b
pf1c
pf1d
pf1e
pf1f
pf20

Partial preview of the text

Download Stereo Vision: Recovering Depth Information and Finding Correspondences - Prof. Ramani Dur and more Study notes Computer Science in PDF only on Docsity!

Stereopsis

Exam#1 5 pts "-2.5 any computational error, error with units, etc"#2 2pts each

all or nothing (tend to give credit unless answer is very far off)

i. (answers for 'perspective projection' were uniformly weak, so I was unusually

liberal with credit)

iii must mention parallel linesiv. Partial credit unavoidable here. -.5 per missedvi. Must mention neighbors, or a neighborhood, etc.x.

must say power per unit area, (Can use meters^2 instead of area, etc.)

I write OK if their answer is less than great, but I'm not taking off credit#3 4 pts formula for convolution of filter H with image I. Don't care about if they

put limits on the summation.8 pts the actual output. 1 pt per pixel. (there are 8 pixels fully covered.)

#4 9 pts -0 If they choose mask 1, regardless of reasoning'

-4 if they choose mask 2 or mask 3, and give some reasonably plausiblereasoning'-9 if they choose mask 4, or choose (2 or 3) with very bad reasoning

Mark Twain at Pool Table", no date, UCR Museum of Photography

Woman getting eye exam during immigration procedure at Ellis

Island, c. 1905 - 1920 , UCR Museum of Phography

Stereo•

Assumes (two) cameras.

Known positions.

Recover depth.

Recovering Depth Information:

O O

22

P

P’

2 2

=Q

=Q’

2 2

PP

Q

Q

OO

11

P’P

1 1

Q

Q’

1 1

Depth can be recovered with two images and triangulation. Depth can be recovered with two images and triangulation.

Slide adapted from: Darrell

Stereo correspondence•

Determine Pixel Correspondence

Pairs of points that correspond to same scene point

Epipolar Constraint

  • Reduces correspondence problem to 1D search along

conjugate epipolar lines

epipolar plane

epipolar lineepipolar line

epipolar lineepipolar line

(Seitz)

Epipolar Geometryfor Parallel Cameras

f f

f f

T

T

P

P

O

O

l l

O

O

r r

e e

l l

e e

r r

Epipoles Epipoles are at infinity

are at infinity

Epipolar Epipolar lines are parallel to the baseline

lines are parallel to the baseline

We can always achieve thisgeometry with image rectification•

Image Reprojection

reproject image planes onto commonplane parallel to line between optical centers

Notice, only focal point of camera really matters

(Seitz)

Correspondence: What should we match?•

Objects?

Edges?

Pixels?

Collections of pixels?

Finding Correspondences:

O O

22

P

P’

2 2

Q

Q’

2 2

PP

Q

Q

OO

11

P

P’

1 1

Q

Q’

11

Julesz: had huge impact because it showed thatrecognition not needed for stereo.