Advanced Topic 44 of 49 Graphics, Vision & Media
Structure from Motion
Reconstructing 3D scenes from image sequences.
How it works
Structure from motion reconstructs 3D structure of a scene and the camera poses from a set of overlapping 2D images taken from different viewpoints. The pipeline detects and matches features across images, estimates geometry with the essential or fundamental matrix, triangulates 3D points, incrementally registers new cameras with perspective-n-point and refines everything with bundle adjustment, a large nonlinear least-squares problem minimizing reprojection error. Dense multi-view stereo then builds detailed surfaces. COLMAP is a popular implementation.
Where it is used
Photogrammetry for mapping, archaeology and film, 3D scanning from photos, drone surveying, visual effects and creating datasets for neural radiance fields use structure from motion.
Common pitfall
It needs sufficient texture and parallax; pure rotation or planar scenes cause degeneracy. The result has unknown scale unless a reference is given. Drift and wrong matches can break the reconstruction, so robust estimation with RANSAC and good image overlap are essential. Processing large collections is computationally heavy. Capture with plenty of overlap and varied viewpoints.
Where it fits in the course
Structure from Motion is topic 44 of 49 in Graphics, Vision & Media, rated Advanced. It follows Stereo Vision. The next topic is SLAM.
Practice and explore
- Open the interactive lesson, with a mini quiz.
- Take the Graphics, Vision & Media quiz.
How to study this topic
- Read the explanation above and restate the definition in your own words.
- Open the interactive lesson and answer its mini quiz.
- Read the common pitfall, then write a short example that avoids it.
- Check your understanding in the Graphics, Vision & Media quiz, and revisit the topic if you miss a question.
Frequently asked questions
What is Structure from Motion?
Where do people use Structure from Motion?
What is the most common mistake with Structure from Motion?
What should I learn before this topic?
How can I practice it?
Is Structure from Motion hard to learn?
How long does it take to learn Structure from Motion?
Which topics are related to Structure from Motion?
What should I study after Structure from Motion?
Related topics
- Stereo Vision (Graphics, Vision & Media)
- SLAM (Graphics, Vision & Media)
- Optical Flow (Graphics, Vision & Media)
- Augmented and Virtual Reality (Graphics, Vision & Media)
- LRU Cache Structure (Data Structures)
- Rope Data Structure (Data Structures)