Monday, January 18, 2021
  • Setup menu at Appearance » Menus and assign menu to Top Bar Navigation
Advertisement
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
No Result
View All Result
Home Neural Networks

Stereo 3D reconstruction with openCV using an iPhone camera. Part I.

January 10, 2019
in Neural Networks
Stereo 3D reconstruction with openCV using an iPhone camera. Part I.
603
SHARES
3.4k
VIEWS
Share on FacebookShare on Twitter

The steps required for 3D reconstruction.

There are many ways to reconstruct the world around but it all reduces down to getting an actual depth map.

A depth map is a picture where every pixel has depth information (instead of color information). It is normally represented like a grayscale picture.

You might also like

What Can You Do With Python in 2021? (Python Real Life Applications) | by Doga Ozgon | Dec, 2020

The Why, What, and How of Affective Computing | by Javier Gonzalez | Jan, 2021

Write Your First AI Project in 15 Minutes | by Doga Ozgon | Jan, 2021

Depth map from the Tsukuba dataset. Courtesy of OpenCV

As mentioned before there are different ways to obtain a depth map and these depend on the sensor being used. A type of sensor could be a simple camera (from now on called RGB camera in this text) but it is possible to use others like LiDAR or infrared or a combination.

The type of sensor will determine the accuracy of the depth map. In terms of accuracy it normally goes like this: LiDAR > Infrared > Cameras. Depth maps can also be colorized to better visualize depth.

A selfie of me taking a depth selfie using the Kinect camera.

Depending on the kind of sensor used, theres more or less steps required to actually get the depth map. The Kinect camera for example uses infrared sensors combined with RGB cameras and as such you get a depth map right away (because it is the information processed by the infrared sensor).

But what if you don’t have anything else but your phone camera?. In this case you need to do stereo reconstruction. Stereo reconstruction uses the same principle your brain and eyes use to actually understand depth.

The gist of it consists in looking at the same picture from two different angles, look for the same thing in both pictures and infer depth from the difference in position. This is called stereo matching.

In order to do stereo matching it is important to have both pictures have the exact same characteristics. Put differently, both pictures shouldn’t have any distortion. This is a problem because the lens in most cameras causes distortion. This means that in order to accurately do stereo matching one needs to know the optical centers and focal length of the camera.

In most cases this information will be unknown (especially for your phone camera) and this is why stereo 3D reconstruction requires the following steps:

  1. Camera calibration: Use a bunch of images to infer the focal length and optical centers of your camera
  2. Undistort images: Get rid of lens distortion in the pictures used for reconstruction
  3. Feature matching: Look for similar features between both pictures and build a depth map
  4. Reproject points: Use depth map to reproject pixels into 3D space.
  5. Build point cloud: Generate a new file that contains points in 3D space for visualization.
  6. Build mesh to get an actual 3D model (outside of the scope of this tutorial, but coming soon in different tutorial)

Step 1 only needs to be executed once unless you change cameras. Steps 2–5 are required every time you take a new pair of pictures…and that is pretty much it.

The actual mathematical theory (the why) is much more complicated but it will be easier to tackle after this tutorial since you will have a working example that you can experiment with by the end of it.

In the next part we will explore how to actually calibrate a phone camera, and some best practices for calibration, see you then.

Don’t forget to give us your 👏 !

Credit: Source link

Previous Post

MongoDB in 2019: Cloud, transactions, and mobile will be on the agenda

Next Post

LinkedIn’s most promising jobs

Related Posts

What Can You Do With Python in 2021? (Python Real Life Applications) | by Doga Ozgon | Dec, 2020
Neural Networks

What Can You Do With Python in 2021? (Python Real Life Applications) | by Doga Ozgon | Dec, 2020

January 16, 2021
The Why, What, and How of Affective Computing | by Javier Gonzalez | Jan, 2021
Neural Networks

The Why, What, and How of Affective Computing | by Javier Gonzalez | Jan, 2021

January 15, 2021
Write Your First AI Project in 15 Minutes | by Doga Ozgon | Jan, 2021
Neural Networks

Write Your First AI Project in 15 Minutes | by Doga Ozgon | Jan, 2021

January 15, 2021
Building a small knowledge graph using NER | by Swayatta Daw | Jan, 2021
Neural Networks

Building a small knowledge graph using NER | by Swayatta Daw | Jan, 2021

January 14, 2021
The story of machine proofs — Part II | by Sharad Sundararajan | Jan, 2021
Neural Networks

The story of machine proofs — Part II | by Sharad Sundararajan | Jan, 2021

January 14, 2021
Next Post
LinkedIn’s most promising jobs

LinkedIn’s most promising jobs

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Recommended

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

January 6, 2019
Microsoft, Google Use Artificial Intelligence to Fight Hackers

Microsoft, Google Use Artificial Intelligence to Fight Hackers

January 6, 2019

Categories

  • Artificial Intelligence
  • Big Data
  • Blockchain
  • Crypto News
  • Data Science
  • Digital Marketing
  • Internet Privacy
  • Internet Security
  • Learn to Code
  • Machine Learning
  • Marketing Technology
  • Neural Networks
  • Technology Companies

Don't miss it

AI Machine Learning Used to Predict Psychosis
Machine Learning

AI Machine Learning Used to Predict Psychosis

January 18, 2021
Reading Multiple CSVs into Merged R Dataframe
Data Science

Reading Multiple CSVs into Merged R Dataframe

January 18, 2021
Machine Learning Models: Generative vs. Discriminative
Machine Learning

Machine Learning Models: Generative vs. Discriminative

January 18, 2021
Phishing warning: These are the brands most likely to be impersonated by crooks, so stay alert
Internet Security

Phishing warning: These are the brands most likely to be impersonated by crooks, so stay alert

January 18, 2021
Cloud Migration Planning & Checklist for Effective Migration
Data Science

Cloud Migration Planning & Checklist for Effective Migration

January 17, 2021
Forget coding, you can now solve your AI problems with Excel
Machine Learning

Forget coding, you can now solve your AI problems with Excel

January 17, 2021
NikolaNews

NikolaNews.com is an online News Portal which aims to share news about blockchain, AI, Big Data, and Data Privacy and more!

What’s New Here?

  • AI Machine Learning Used to Predict Psychosis January 18, 2021
  • Reading Multiple CSVs into Merged R Dataframe January 18, 2021
  • Machine Learning Models: Generative vs. Discriminative January 18, 2021
  • Phishing warning: These are the brands most likely to be impersonated by crooks, so stay alert January 18, 2021

Subscribe to get more!

© 2019 NikolaNews.com - Global Tech Updates

No Result
View All Result
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News

© 2019 NikolaNews.com - Global Tech Updates