Finding surface data in 3d space
16 year
I would like to ask for assistance in programming a specialized filter.

Essentially, this filter would look through the input from a video stream (webcam or otherwise), would remove all pixels except for bright red, green, and blue, and then would find the pixel at the center of each group of colored pixels.  At this point, it would count the number of pixels in each group, and find the distance of each one from the camera.  Then, it would take an image plane, taken from an arbitrary folder, and scale it so that it shares the same orientation as the dots, assuming they are on a level plane, and arranged in a triangular pattern.  

The result is that the pattern of three dots is overlaid in the image stream by a secondary image of the user's choice, that will continue to have the same apparent orientation and position regardless of the camera's position, so long as all three markers are visible.  

Is this doable?  If so, could someone talk me through the steps necessary to achieve it?  (I am relatively new to this, so the instruction would have to be fairly specific).

If you can help me, I thank you very much for your time and help.

Anonymous 16 year

Yes, this is very doable. In fact there are already some very nice systems that do this. Check out


which does what you are asking for but instead of using colored circles it does rectangular squares.

RoboRealm has some of these capabilities but does not have the 3D graphical routines needed to insert virtual objects into the real scene. RR is mainly concerned with recognizing the object and determining the orientation/position of the robot with respect to that object fiducial ... that's something that will be released in the next couple of weeks. Regardless, I think ARToolkit is what you're looking for.


This forum thread has been closed due to inactivity (more than 4 months) or number of replies (more than 50 messages). Please start a New Post and enter a new forum thread with the appropriate title.

 New Post   Forum Index