CS-803
803(A) Image Processing and Computer Vision#
Subject In-charge :
Prof Shilpa Sharma
Asst. Prof. CSE / IT Department
MITM, Ujjain (M.P.)
Understand practice and theory of computer vision.
Elaborate computer vision algorithms, methods and
concepts
Implement computer vision systems with emphasis
on applications and problem solving
Apply skills for automatic analysis of digital images
to construct representations of physical objects and
scenes.
Design and implement real-life problems using
Image processing and computer vision.
Reference Text
1. Robert Haralick and Linda Shapiro, "Computer
and Robot Vision", Vol I, II, Addison-
Wesley, 1993
2. David A. Forsyth, Jean Ponce, "Computer Vision:
A Modern Approach" Pearson
3. Milan Sonka,VaclavHlavac, Roger Boyle, "Image
Processing, Analysis, and Machine Vision" Thomson
Learning.
Introduction to computer vision and Image
processing (CVIP): Basics of CVIP, History of CVIP,
Evolution of CVIP, CV Models, Image Filtering,
Image Representations, Image StatisticsRecognition
Methodology: Conditioning, Labeling, Grouping,
Extracting, and Matching,
Morphological Image Processing: Introduction,
Dilation, Erosion, Opening, Closing,
Hit-or-Miss transformation, Morphological algorithm
operations on binary images,
Morphological algorithm operations on gray-scale
images, Thinning, Thickening,
Region growing, region shrinking.
Computer vision is concerned with modeling and
replicating human vision using computer software
and hardware.
Formally if we define computer vision then its
definition would be that computer vision is a
discipline that studies how to reconstruct, interrupt
and understand a 3d scene from its 2d images in
terms of the properties of the structure present in
scene.
Computer Vision
Make computers understand images and video.
What kind of
scene?
Where are the cars?
How far is the
building?
Vision is really hard
• Vision is an amazing feat of natural intelligence
– Visual cortex occupies about 50% of Macaque brain
– More human brain devoted to vision than anything
else
Is that a
queen or a
bishop?
Why computer vision matters
Safety Health Security
Comfort Fun Access
brief history of computer vision
• 1966: Minsky assigns computer
vision as an undergrad summer
project
Guzman ‘68
• 1960’s: interpretation of synthetic
worlds
• 1970’s: some progress on
Ohta Kanade ‘78
interpreting selected images
Turk and Pentland ‘91
• 1980’s: ANNs come and go; shift toward
geometry and increased mathematical rigor
• 1990’s: face recognition; statistical analysis in
vogue
• 2000’s: broader recognition; large annotated
datasets available; video processing starts
It needs knowledge from the following fields in order to
understand and stimulate the operation of human vision
system.
Computer Science
Electrical Engineering
Mathematics
Physiology
Biology
Cognitive Science
Computer vision is divided into three basic categories
that are as following:
Low-level vision: includes process image for feature
extraction.
Intermediate-level vision: includes object recognition
and 3D scene Interpretation
High-level vision: includes conceptual description of
a scene like activity, intention and behavior.
Computer Vision overlaps significantly with the
following fields:
Image Processing: it focuses on image manipulation.
Pattern Recognition: it studies various techniques to
classify patterns.
Photogrammetry: it is concerned with obtaining
accurate measurements from images.
Image processing studies image to image
transformation. The input and output of image
processing are both images.
Computer vision is the construction of explicit,
meaningful descriptions of physical objects from
their image. The output of computer vision is a
description or an interpretation of structures in 3D
scene.
Computer Vision and Nearby
Fields
• Computer Graphics: Models to Images
• Comp. Photography: Images to Images
• Computer Vision: Images to Models
1) Robotics
2) Medicine
3) Security
4) Transportation
5) Industrial Automation
Localization-determine robot location automatically
Navigation
Obstacles avoidance
Assembly (peg-in-hole, welding, painting)
Manipulation (e.g. PUMA robot manipulator)
Human Robot Interaction (HRI): Intelligent robotics
to interact with and serve people
Classification and detection (e.g. lesion or cells
classification and tumor detection)
2D/3D segmentation
3D human organ reconstruction (MRI or ultrasound)
Vision-guided robotics surgery
Biometrics (iris, finger print, face recognition)
Surveillance-detecting certain suspicious activities or
behaviors
Autonomous vehicle
Safety, e.g., driver vigilance monitoring
Industrial inspection (defect detection)
Assembly
Barcode and package label reading
Object sorting
Document understanding (e.g. OCR)
How vision is used now
• Examples of state-of-the-art
Optical character recognition (OCR)
Technology to convert scanned docs to text
• If you have a scanner, it probably came with OCR software
Digit recognition, AT&T labs License plate readers
http://www.research.att.com/~yann/ http://en.wikipedia.org/wiki/Automatic_number_plate_recognition
Face detection
• Many new digital cameras now detect
faces
– Canon, Sony, Fuji, …
Smile detection
Sony Cyber-shot® T70 Digital Still Camera
3D from thousands of images
Object recognition (in
supermarkets)
LaneHawk by EvolutionRobotics
“A smart camera is flush-mounted in the checkout lane, continuously
watching for items. When an item is detected and recognized, the
cashier verifies the quantity of items that were found under the basket,
and continues to close the transaction. The item can remain under the
basket, and with LaneHawk,you are assured to get paid for it… “
Vision-based biometrics
“How the Afghan Girl was Identified by Her Iris Patterns” Read the story
wikipedia
Login without a password…
Face recognition systems now
Fingerprint scanners on
beginning to appear more widely
many new laptops, http://www.sensiblevision.com/
other devices
Object recognition (in mobile
phones)
Point & Find, Nokia
Google Goggles
Special effects: shape capture
The Matrix movies, ESC Entertainment, XYZRGB, NRC
Special effects: motion capture
Pirates of the Carribean, Industrial Light and Magic
Sports
Sportvision first down line
Nice explanation on www.howstuffworks.com
http://www.sportvision.com/video.html
Smart cars Slide content courtesy of Amnon Shashua
• Mobileye
– Vision systems currently in high-end BMW,
GM, Volvo models
– By 2010: 70% of car manufacturers.
Google cars
http://www.nytimes.com/2010/10/10/science/10google.html?ref=artificialintelligence
Interactive Games: Kinect
• Object Recognition:
http://www.youtube.com/watch?feature=iv&v=fQ59dXOo
63o
• Mario: http://www.youtube.com/watch?v=8CTJL5lUjHg
• 3D: http://www.youtube.com/watch?v=7QrnwoO1-8A
• Robot:
http://www.youtube.com/watch?v=w8BmgtMKFbY
Vision in space
NASA'S Mars Exploration Rover Spirit captured this westward view from atop
a low plateau where Spirit spent the closing months of 2007.
Vision systems (JPL) used for several tasks
• Panorama stitching
• 3D terrain modeling
• Obstacle detection, position tracking
• For more, read “Computer Vision on Mars” by Matthies et al.
Industrial robots
Vision-guided robots position nut runners on wheels
Mobile robots
NASA’s Mars Spirit Rover
http://en.wikipedia.org/wiki/Spirit_rover http://www.robocup.org/
Saxena et al. 2008
STAIR at Stanford
Medical imaging
Image guided surgery
3D imaging
Grimson et al., MIT
MRI, CT
