PDA

View Full Version : question stereo with augmented reality


Darkmax
04-06-2011, 11:48 PM
im just wondering if i have two cameras on my hmd what is the best way to do a AR application with stereo vision.(the wrap920AR from vuzix with resolution 1024,768)
For example i want that the left camera show on the left eye and the right camera on the right eye, and of course show the 3d model if is seeing a mark of AR and also i want a GUI on the screen where i show text of what is seeing.

So i dont know if i create two windows and on each windows create a viewpoint to link it with each webcam, but i have two make a copy on each model to display on each window (well i think so) or is there a way that viz can handle in another way?

Gladsomebeast
04-07-2011, 11:54 AM
Once you have the camera feed in Vizard as a texture, use the VideoVision module.

import VideoVision
VideoVision.add(leftCam=leftTexture, rightCam=rightTexture)

What is the manufacturer of the cameras on the HMD? If the cameras support "DirectShow" and are seen by Vizards "VideoCamera" plugin, then use that to get the camera feeds.

If VideoCamera does not do it, then you'll have to write a plugin to connect to the camera's SDK and update a OSG texture object. Checkout the Vizard SDK imagegen plugin example. You can get the SDK on the Vizard downloads page.

Darkmax
04-08-2011, 08:30 PM
vuzix, i'm trying the wrap 920AR, and it has two cameras built in.

http://www.vuzix.com/consumer/products_wrap920ar.html

also i tried the code you tell and it show a white screen.

this what i tried:

import viz
import VideoVision
viz.go()

#Add ARToolkit extension
ar = viz.add('artoolkit.dle')

#Create camera using first available webcam
leftTexture = ar.addWebCamera()
rightTexture = ar.addWebCamera()
VideoVision.add(leftCam=leftTexture, rightCam=rightTexture)

Jeff
04-14-2011, 04:04 PM
For the second camera you can create a second window using a different scene. Does the following work for you?
import viz
viz.go()

left_window = viz.MainWindow
left_window.setSize(0.5,1)

right_scene = viz.addScene()
right_view = viz.addView(scene=right_scene)
right_window = viz.addWindow(view=right_view,size=[.5,1],pos=[0.5,1])

#Add ARToolkit extension
ar = viz.add('artoolkit.dle')

#Create left camera
left_cam = ar.addWebCamera(window=left_window)

#Create right camera
right_cam = ar.addWebCamera(window=right_window)

avatar = viz.addAvatar('vcc_male.cfg')
avatar.duplicate(scene=right_scene)

#Create marker from pattern file
marker1 = left_cam.addMarker('ar/patt.worldviz',width=1000)
viz.link(marker1, avatar)
marker2 = right_cam.addMarker('ar/patt.worldviz',width=1000)
viz.link(marker2, avatar)

Darkmax
05-11-2011, 11:13 AM
thx it works with two individual cameras, but when i tried with the glasses it only has one usb cable for the two cameras and it shows only the first added camera but the program detects both cameras because on the interactive window show this:


artoolkit.dle ARToolkit Extension
VideoCamera.dle Video Camera Extension
** NOTIFY: Connected to 'Vimicro USB2.0 UVC PC Camera' (640 x 480 , 30.00 fps)
** NOTIFY: Connected to 'Vimicro USB2.0 UVC PC Camera' (640 x 480 , 30.00 fps)
Loading File: vcc_male.cfg
** Load Time: 1.01 seconds


And on my left eye i can see the image but on the right i see only black

I don't know if there is a way to resolve this.