Context and Spatial Layout - Introduction to Computer Version - Lecture Sli, Lecture notes of Computer Science

These are the Lecture Slides of Introduction to Computer Version which includes Machine Learning, Framework, Prediction Function, Feature Representation, Image, Desired Output, Prediction Function, Prediction Error, Predicted Value etc. Key important points are: Context and Spatial Layout, Context In Recognition, Surrounded, Provide Context, Scene Category, Surfaces, Context Provides, Function, Component of Recognition, Context

Typology: Lecture notes

2012/2013

Uploaded on 03/23/2013

dhruv
dhruv 🇮🇳

4.3

(12)

194 documents

1 / 53

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Context and Spatial Layout
Computer Vision
Docsity.com
pf3
pf4
pf5
pf8
pf9
pfa
pfd
pfe
pff
pf12
pf13
pf14
pf15
pf16
pf17
pf18
pf19
pf1a
pf1b
pf1c
pf1d
pf1e
pf1f
pf20
pf21
pf22
pf23
pf24
pf25
pf26
pf27
pf28
pf29
pf2a
pf2b
pf2c
pf2d
pf2e
pf2f
pf30
pf31
pf32
pf33
pf34
pf35

Partial preview of the text

Download Context and Spatial Layout - Introduction to Computer Version - Lecture Sli and more Lecture notes Computer Science in PDF only on Docsity!

Context and Spatial Layout

Computer Vision

Docsity.com

Context in Recognition

• Objects usually are surrounded by a scene

that can provide context in the form of nearby

objects, surfaces, scene category, geometry,

etc.

Docsity.com

Context provides clues for function

• What is this?

• Now can you tell?

Docsity.com

Sometimes context is the major

component of recognition

  • What is this?

Docsity.com

More Low-Res

• What are these blobs?

Docsity.com

More Low-Res

• The same pixels! (a car)

Docsity.com

There are many types of context

  • Local pixels
    • window, surround, image neighborhood, object boundary/shape, global image statistics
  • 2D Scene Gist
    • global image statistics
  • 3D Geometric
    • 3D scene layout, support surface, surface orientations, occlusions, contact points, etc.
  • Semantic
    • event/activity depicted, scene category, objects present in the scene and their spatial extents, keywords
  • Photogrammetric
    • camera height orientation, focal length, lens distortion, radiometric, response function
  • Illumination
    • sun direction, sky color, cloud cover, shadow contrast, etc.
  • Geographic
    • GPS location, terrain type, land use category, elevation, population density, etc.
  • Temporal
    • nearby frames of video, photos taken at similar times, videos of similar scenes, time of capture
  • Cultural
    • photographer bias, dataset selection bias, visual cliches, etc.

from Divvala et al. CVPR 2009Docsity.com

Cultural context

Jason Salavon: http://salavon.com/SpecialMoments/Newlyweds.shtml Docsity.com

Cultural context

Andrew Gallagher: http://chenlab.ece.cornell.edu/people/Andy/projectpage_names.html

Age given Appearance Age given Name

Docsity.com

Spatial layout is especially important

1. Context for recognition

Docsity.com

Spatial layout is especially important

1. Context for recognition

2. Scene understanding

Slide: Derek HoiemDocsity.com

Slide: Derek Hoiem

Spatial layout is especially important

1. Context for recognition

2. Scene understanding

3. Many direct applications

a) Assisted driving

b) Robot navigation/interaction

c) 2D to 3D conversion for 3D TV

d) Object insertion

Docsity.com

21

Context in Image Space

[Torralba Murphy Freeman 2004] [Kumar Hebert 2005]

[He Zemel Cerreira-Perpiñán 2004]

Slide: Derek HoiemDocsity.com

But object relations are in 3D…

Close

Not

Close

Slide: Derek HoiemDocsity.com