Computer Vision
Camera models, features, geometry — robots that see.
Prerequisites
Why it matters in robotics
Most robots perceive the world through cameras, and computer vision is the bridge from pixels to a metric 3-D world model. Camera calibration, projection, and triangulation turn images into geometry, while matching the same points across images, discarding bad matches, and recovering camera motion from two or more views underpin visual odometry, mapping from images, and visual SLAM. The classical geometry beneath these pipelines is what makes modern perception robust rather than a black box.
What to study
- ✓Camera models: pinhole/perspective projection, intrinsic & extrinsic matrices, lens distortion, and calibration
- ✓Features and matching: detectors/descriptors (SIFT, ORB), correspondence, and RANSAC for robust outlier rejection
- ✓Two-view geometry: epipolar constraint, fundamental & essential matrices, pose recovery, and triangulation
- ✓Structure from Motion & visual SLAM: bundle adjustment, multi-view reconstruction, and visual odometry
Where to study
Cheatsheet
Symbols used below
Pinhole projection
A 3-D point at depth projects to the image plane by similar triangles: , .
In pixels this is packaged as , where holds focal length and principal point, and places the point in the camera frame.
Stereo depth from disparity
Closer points have larger disparity; depth resolution degrades quadratically with distance since is inversely proportional to .
Epipolar constraint
For a correspondence between two views: .
This says must lie on the epipolar line — it collapses a 2-D search for correspondences into a 1-D search along a line. relates the calibrated and uncalibrated forms.
RANSAC for robust fitting
Repeatedly: sample a minimal set of correspondences, fit a model (, , or ), count inliers within a threshold, keep the best-scoring model.
The number of trials needed grows sharply as the outlier fraction rises, which is why a good initial match filter (e.g. descriptor ratio test) matters before RANSAC runs.
Homography vs epipolar geometry
holds when points lie on a common plane, or when the camera only rotates between views (no baseline, no parallax).
General 3-D scenes with camera translation need the epipolar constraint instead — a single can't explain parallax.
Triangulation
Given two calibrated views and a matched pixel pair, the 3-D point is the intersection of the two back-projected rays.
In practice the rays rarely intersect exactly due to noise, so triangulation finds the point minimizing reprojection error in both images (linear least squares or iterative refinement).
Application focus
Practice questions (17)
- Camera Calibration and the Pinhole Modelmedium
- Robustness of Vision Perception to Real-World Conditionsmedium
- What is a homography, and its assumptions?Interviewmedium
- Explain stereo vision in simple termsIntervieweasy
- Explain epipolar geometryInterviewhard
- Stereo rectification — what and whenInterviewmedium
- Image features — detectors and descriptorsInterviewmedium
- Estimating depth from a feature seen in two framesInterviewmedium
- Fundamental vs essential matrixInterviewhard
- How does RANSAC work?Interviewmedium
- Handling outliers in geometric estimationInterviewmedium
- Geometric fitting of a bounding box to segmented pointsInterviewhard
- Clustering a lidar point cloudInterviewhard
- Clustering algorithms and their trade-offsInterviewmedium
- Design a stop-sign detector with classical methods (no ML)Interviewhard
- Design a road/ground plane detectorInterviewmedium
- Measuring vehicle speed from a fixed monocular cameraInterviewhard