Are there any computer vision algorithms specifically targeting depth images?
-
I've been looking into marker detection algorithms to use with a kinect based application, and the majority of the work I've been able to find is obviously focused on feature detection in 'normal' images. However, the kinect hardware provides (essentially, once you've adjusted) an 11-bit depth value per pixel. This depth image also has various visual artifacts in it from the shadows cast around the edges of objects (see for example the strong black border in this video http://www.youtube.com/watch?v=-q8rRk8Iqww&feature=related). While some traditional machine vision techniques (eg. edge detection) work well with this, others don't, and it seems like there's little information on the net discussing this. As a simple example, using the depth value makes it trivial to detect the orientation of a marker block once you've located it. So, has anyone seen any discussions / papers / etc. that cover processing a depth image for feature detection? Can anyone recommend a good algorithm for detecting "depth" markers (effectively origami blocks instead of printed b/w markers)? What I've done so far has been adhoc experimentation using opencv to process the images, but that's no where near stable or fast enough. If you link to a commercial machine vision product without some kind of trial, please mention in your answer why you think it's appropriate.
-
Answer:
My favourite 2.5D/3D feature descriptor for registration and recognition is the http://www.ri.cmu.edu/pub_files/pub2/johnson_andrew_1999_1/johnson_andrew_1999_1.pdf (original paper + more details in http://www.ri.cmu.edu/publication_view.html?pub_id=559 and http://www.cs.cmu.edu/~vmr/software/meshtoolbox/executables.html available from CMU). Other recent advances (all searchable on-line for suitable algorithims) include: 3D-Sift, Fast Point Feature Histogram, Normal Aligned Radial Features (NARF), Depth Kernel Descriptors. Older methods simply used surface properties such as curvature and edges to identify region patches. Which is best? Depends on what you want to find, viewpoint invariance, additional clutter, etc.
Doug at Signal Processing Visit the source
Other answers
You got all the key words right, I'm surprised that you really didn't find any related articles while looking for material. Fortunately, I have access to IEEE Xplore digital library. I din't need any of these particular algorithms before, but it looks very interesting so here are some results from a quick search that I think might be relevant (don't judge them by their titles, look at their abstracts): http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6130300&contentType=Conference+Publications&searchField%3DSearch_All%26queryText%3Dkinect+features http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6095119&contentType=Conference+Publications&searchField%3DSearch_All%26queryText%3Dkinect+features http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=4379404&contentType=Conference+Publications&searchField%3DSearch_All%26queryText%3Ddepth+image+processing http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5463157&contentType=Conference+Publications&searchField%3DSearch_All%26queryText%3Ddepth+image http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=4803479&contentType=Conference+Publications&searchField%3DSearch_All%26queryText%3D3d+images http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=5639645&contentType=Conference+Publications&searchField%3DSearch_All%26queryText%3D3d+images Unfortunately, I don't think you can access any of these papers for free, at least not via the IEEE Xplore library. If you don't have access, you can probably get by with Google scholar, and there are some free paper databases out there (I used http://www.mendeley.com/ back when I didn't have IEEE access yet). Also, just Googling parts of the abstract or random parts of the paper sometimes yields some results (you might stumble across a almost finished pre-published versions of the article). The search queries I used to find the mentioned papers were: 3D image, depth image, kinect. You might also want to throw in processing when looking up the first two queries. Hope this helps some! I feel sorry I can not get in to the subject more, sounds really interesting.
penelope
Related Q & A:
- Is there a maximal finite depth infinite index irreducible subfactor?Best solution by Mathoverflow
- How do I get Sony Handycam Vision CCD TRV68 Hi8 Camcorder to connect to the computer to burn dvds?Best solution by Yahoo! Answers
- Why can't my computer see the images?Best solution by Stack Overflow
- Which are the google algorithms?Best solution by google.com
- Why does the earthquake depth change?Best solution by Yahoo! Answers
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.