Do you want the objects to move when the viewpoint collides with them? If not, it sounds like you just need to enable viewpoint collision and not physics. You can turn off gravity on the viewpoint:
http://docs.worldviz.com/vizard/#Vie...nd_gravity.htm