Rob Spence, had his eye replaced with a video camera after a shotgun accident. He then set out to make this incredible documentary about visual and limb prostheses. The concept of direct imaging to the brain and the incorporation of augmented reality has been much flailed over the past 30 years. Spence introduces us to several people who’ve actually had it done. He also engages the viewer in the ethical considerations; whether people will eventually choose to have their eyes and limbs removed and replaced with cyborg parts. Could certainly change the odds in your office NFL betting pool!
Harvey Newquist tires of waiting for the New York Post headline to scream: “Wife Dumps Husband For Cybersex Lover” or “Computer Casanova Seduces Virtual Valerie.”
Does the average person get to see or use any of this stuff? Can you go any place just experience the joys of VR? Is Ronald Reagan in full control of his senses? The answer to all these questions is an emphatic “no.” … Try asking your next-door neighbor about VR. Ask him or her about their most recent VR experience.
Has anything changed in the 15 years since this 1996 article was published in the Virtual Reality Special Report?
From 1993: “Now you can go to Radio Shack, buy what you need, and build it yourself.” Robert Suding and the Virtual Reality Special Report provide specific instructions for building a stereoscopic HMD for $435. Interestingly the optics and prisms are quite similar to the V-Rtifacts “Leep On The Cheap” design.
From the 1995 made for TV B movie Evolver, check out their head mounted display of choice.
Recently I got my hands on brand new Vuzix video-see-through augmented reality HMD – Wrap 920 AR. It’s not quite a consumer product, it’s more focused on R&D in Augmented Reality field, there are small amount of information about it on the net and few people asked me for a review. Besides, I hope it will be interesting to many VR geeks on the planet, so here it comes. I want to give as much info as I can, but will try to keep this article short and don’t miss anything valuable.
Editor’s note: Thanks go out to Mnemonic who put together this excellent review. While not strictly a VRtifact, future posts will draw the connection between the earliest augmented reality systems from the 80’s and 90’s and the Wrap 920 AR. Stay tuned…
Wrap 920 AR comes in really big box in comparison to compact package of VR920. Honestly, I didn’t expect it to be so big, but it’s because of bunch of different stuff inside, all packed in different sockets cut in safety foam. You can see list of included stuff on the sign, on top of the box. I liked that each part of the package is wrapped in some packet; head-tracking module comes in small acrylic box for example. Two AR markers on plastic-base included, which is nice to check Vuzix AR demos right away.
Drivers for the HMD are digitally distributed by Vuzix via Internet, so no installation disk is included.
There is also solid travel casing included in the package, HMD with cables and VGA adapter fits there nicely:
Adapters & cables
Wrap 920AR based on Wrap series of Vuzix HMD’s, and as any other Wrap HMD it supports various video sources for input. It’s includes composite video, iPod / iPhone connection and what we interested in – regular VGA for PC connection. To use VGA or composite video source you need to choose proper “adapter”, which are actually a control boxes. All currently available adapters (VGA, composite / iPod) included in the package of Wrap AR. Vuzix recently announced Wrap HDMI adapter, so I’m pretty sure it will be compatible. There’s also DVI to VGA adapter in the package for DVI-I connection.
Wrap AR HMD have two cables, one from visor system (HMD itself) with some small specific connector which goes into control box, and another one from stereoscopic camera system – regular USB. VGA control box have VGA and USB connectors. USB needed to power up screens, provide audio and head-tracking.
Before start to work with Wrap 920AR in its full capacity we need to attach head-tracker, VGA adapter and optionally headphones. From the inside HMD have two small jack connectors for ear-plug style headphones and micro connector on the right brow for head-tracker module.
Tracker connector and HMD-to-control-box connectors are very small, and looks fragile, so I would recommend assembling these with care, because they do need to put some force to plug in. But once connected, tracker (and control-box connector) securely stays in place, and don’t bother you.
Wrap AR had straight-forward connection to my netbook and laptop, just plug in VGA and both USB cables and it’s ready. But first thing I noticed when tried to connect them to my (most powerful) stationery computer that cables are way to short!
Cables are much shorter than what was in VR920. I suppose Vuzix designed glasses to be connected to laptops, which sounds reasonable for Augmented Reality usage. Besides, in the full PDF manual (more than 100 pages!) I found mention that for stationery computers additional extension cables are need to be used.
In short – I used 3 meters VGA extension cable and two 2 meters USB cables to connect Wrap AR to my stationery PC, and in this configuration device work without any issues.
After connecting HMD, drivers were installed fluently on both systems: Windows XP 32 bit and Windows 7 64 bit, I also tried them on Windows Vista 32 bit, without any problems. HMD supports input video signal with resolution up to 1024 x 768 with 60 Hz refresh rate. It can be used both in clone and extend monitors modes like any external monitor.
Adjustments and ergonomics
Once connected to PC (and drivers are installed), buttons on the control box (adapter) provide control to the HMD adjustments menu. In the menu you can switch between few brightness and contrast presets, set your own preset, switch between stereoscopic and monoscopic modes, switch between different stereoscopic modes (side-by-side stereo pair, or various anaglyphs), swap left and right eyes in stereo mode, and adjust headphones volume.
On the back of the adapter you can find a little screw-driver, which is needed to adjust focus. Two knobs for focus adjustments you can find under rubber cover on top of the HMD. Knobs allow you to adjust between +2 to -5 diopters independently for each eye.
My Wrap AR when first unpacked and connected to PC, had both knobs set to the very left position, I believe it was -5. I have perfect vision and was completely unable to focus screens this way. But with step-by-step slight adjustments, independently for each eye I was able to set glasses to very comfortable focus, and both “eyes” give me a sharp and clean image.
Also nose-piece can be adjusted for particular nose, and all nose-piece construction can slide inwards (or backwards) into HMD. Additional (spare) nose-piece and ear-plug nozzles of different sizes also included in the package.
It is possible to adjust optics between -5 and +2 diopters, but if you happen to have worse vision, you can find that it’s hard to use HMD with glasses while head-tracker attached, so probably you will need to use contact lenses.
Personally I found Wrap AR to be pretty comfortable, HMD is easy to wear and lightweight enough.
Screens, optics and visual quality
Wrap 920 AR have two true 752 x 480 LCD color screens which are located inside visual module casings and project image down into lens/prism system. In Wrap predecessor – iWear VR920 screens were located in front of the eyes, here Vuzix decided to go with another optical design. Optics has narrow 31 degree diagonal FOV with 100% stereo overlap, pretty much the same as with VR920 (32 degree), personally I didn’t feel the difference in the image size, but of course I would prefer if FOV was bigger, at least like in old VFX-1 with 45 degree.
All surroundings from the sides and from the bottom of the screen can be clearly seen, so it doesn’t block your view. This is bad in case of Virtual Reality use, but can be good when it comes to Augmented Reality applications, because you still see and aware of your surroundings outside of the screens, and on the screens, and in the same time inside screens you can see all AR “magic”.
In comparison with VR920, picture quality inside Wrap 920 is much better! Picture is perfectly clear and sharp, and looks the same in both eyes; also color reproduction is much better.
As many of you know, iWear VR920 had “child problems” with screens system – image in left eye looked a little grainier (less colors) then from the right eye. When used for long periods of time – VR920 was able to overheat, and when that happened – image quality degraded, user begin to notice “scan lines” and even in case of extreme overheat, many users noted “black dot” which appeared in corner of the screen. Those artifacts thankfully weren’t permanent, and after cooling down HMD by unplugging USB chord image became normal again.
Wrap 920 AR don’t have any of these “child problems”. Glasses stayed almost all working day plugged into my laptop and just became normally warm. Image quality doesn’t change, so it’s really good that Vuzix solved such issues! This HMD can be plugged and powered on as regular monitor as long as you wish.
Also, from the first try I thought that my Wrap AR have bigger resolution screens. What I mean is when desktop is set to 1024×768 mode normally in VR920 I wasn’t able to read any standard-sized text in Windows, in Wrap AR I can operate Windows almost normally, text isn’t perfect but it’s readable in all the menus. Perhaps its benefit of better optics, higher quality screens, and better image scaling algorithm, but fact that picture is pretty readable even in 1024 x 768.
Main stereoscopic mode of Wrap 920 AR is side-by-side stereo-pair (it can be parallel or cross-eyed, both modes supported), which is very good from developers point of view, because it’s fairly easy to implement. But, in fact, gives less resolution per-eye. So if Wrap 920 AR is working in 1024 x 768, effective pixels will be 512 x 768 per eye, each scaled to 752 x 480 screens.
Crysis 2 in native stereo-pair mode
What is good that both eyes will be perfectly synchronized, and you can give full 60 frames per second for each eye! Stereo-pair support make glasses perfectly compatible with iZ3D and TriDef Ignition stereo-drivers, besides some new games like Crysis 2, and Avatar can output stereo-pair natively.
For those who compare characteristics to VR920, it had limitation of 30 FPS per eye in stereo, because of page-flipping stereoscopy; Wrap series don’t have such limitation.
Wrap 920 AR have two high-speed micro-cameras with 640 x 480 native resolution, which are actually capable of 60 frames per second (if your computer can handle). 60 Herz refresh rate gives really nicely smooth and almost perfect picture of the surroundings, which looks really good in stereoscopy! In Windows Wrap AR camera system recognized as two independent USB cameras.
I’ve compiled small example from Vuzix SDK to check stereo cameras, and tried to make a photo to give you some impression of how it looks like. In reality picture in glasses looks really nice, and it blends good with surroundings. FOV of the cameras and screens optics FOV fit close to each other (not ideally, but close enough to give you proper illusion), which is good point for AR.
Picture quality of Wrap AR cameras not as nice as in new top-line Logitech webcam’s for example, but far better than most regular webcams can provide, and they work very fast when PC can handle it. Besides, exposition, white-balance and other stuff manually controllable from the camera drivers. They are also can be controllable from the inside of self-made software using Vuzix SDK.
New Wrap 6TC head tracker besides 3 accelerometers and 3 magnetometers also includes 3 gyroscopes, which greatly improved orientation tracking when comparing it to VR920 head-tracker. It’s much less dependent on external magnetic influences, and do not require frequent re-calibrations. In fact I’ve calibrated them only once, and tracker work fine even week after, without any recalibration.
Using SDK we can receive full 6DOF information from the tracking. In this mode absolute 3DOF orientation information provided (Yaw, Pitch, Roll), along with relative 3DOF position (X, Y, Z). However Vuzix notes in current SDK that position info is in early beta and can’t be used for anything serious besides just “movement” detection. True I didn’t figured out how to use those X, Y, Z values with current driver and SDK, they seems pretty chaotic, but hopefully they will be useful in future with next drivers release.
Wrap 920 AR drivers supports Windows XP, Vista and Windows 7 both in 32 and 64 bit versions.
Wrap 920 AR shipped with “maxReality” license, which is an AR plugin for 3D Studio Max (2010 and 2011). I didn’t use this software so far, because I plan to use these glasses with my own software, but maxReality have few nice demos, which can be used to check all functions of Wrap 920 AR.
I’ve captured movie examples of Vuzix “Dragon” demo, these movies are stereoscopic, so you could take a look how it actually looks like in HMD on your stereo-setup (please watch in HD).
Also Wrap AR is fully supported by Vuzix VR manager software, which provides stereoscopy and head-tracking for more than hundred of gaming titles. Even if it’s isn’t gaming HMD, nice to have this feature.
Free to use SDK with C++ examples available from Vuzix website to give programmers ability to use any feature of this HMD including head-tracker, stereoscopy, cameras, and also optical marker tracking example based on ALVAR library. SDK is well documented and examples are good to use.
Some of the statements in this review can be fair for other HMD’s from Wrap series (like Wrap 920) its goes to stereoscopic support and head-tracking module. Some other statements can be close too, but I can’t 100% guarantee that, because I’ve used only AR version, which is a little different even externally from other Wrap HMD’s, and also can be a little different in electronic components which used in it.
If you happen to build your own Augmented Reality software, or you make research and development in this field, and you have a budget on Wrap 920 AR, I would say go for it! It’s nice lightweight HMD which provide true stereoscopic video-see-through. It is ready to use hardware solution. I happy I bought it for my projects.
Based on a mix of US and Japanese technology, this brief news segment shows a vibrant VR c0mmunity in 1990 Japan. There’s gloves and HMDs from VPL, although the LCD displays inside the helmet are from Sony Japan. There’s also a nice augmented reality helmet (built on an actual construction helmet), and a force/tactile feedback system to boot. More than 20 years ago, all the pieces of the VR puzzle were all in place.
Size matters! If you ask the manufacturers of Head Mounted Displays over the past 15 years, they would echo that mantra, but it’s SMALL size that they’re boasting. Indeed, those tiny little eye glasses size VR displays look cool (from the outside), but from the inside you’re looking through a distant window. It’s hardly immersive. Read on for an explanation why bigger is better when it comes to immersion.
This illustration demonstrates why you need large lenses and therefore large displays in order to achieve very wide field of view. You’re looking at a top view cross-section of the eyeball, lens, and display. The blue lines show the extreme periphery of an unmoving eyeball’s horizontal field of view. The dim red lines demonstrate what happens when the eyeball turns to the left.
So… getting back to the unmoving eyeball. The lens (or multi-lens optics) is fairly close to the front of the eye, certainly as close as your sunglasses would be. The lens needs to have a diameter that is large enough to intersect the blue lines in order to allow us to see the display at that field of view. You must look through the lens for all possible angles, not around it!
Human anatomy permits extremely wide field of view because the eyeball can rotate around its center. The dim red lines show the maximum field of view with the eyeball turned to the left. Another problem is encountered: the lens must be bigger because the eye rotates around it’s center, not around its own biological lens.
Perhaps the lens could be made smaller and moved closer to the eye? More problems occur. The turning eye issue becomes magnified. Also, the lens must be aligned much more precisely with the eyeball.
We could potentially solve the turning eye problem by fabricating the lens as a contact lens, but this would require a very high diopter lens to work properly with a small display; unfortunately beyond what is possible with current contact lens technology. Furthermore, since the display is not physically coupled to the contact lens nor the eyeball rotation, the display must still be large enough to encompass all the possible rotations of the eyeball. Finally, the contact lens approach makes it difficult to transition between the virtual world and the real world, as the contact lenses must be removed and applied each time.
Now here’s the gotcha. For a display panel of any given resolution, when it is displayed at a wider field of view, it will look grainier than if displayed with a narrow field of view. You can test this one in the comfort of your own living room. Watch your beautiful 50 inch 1080p TV set from 10 feet away. Looks pretty good, huh? OK, the picture doesn’t exactly fill your visual world, in fact, most of your vision encompasses those left over pizza boxes and the other trash that you forgot to clean up last night.
Now park your nose about one foot away from the same TV set. Wow! That’s immersive! You’re getting something like 110 deg. FOV. Uh oh! What are all those dots on the screen? Sure looks fuzzy. Same 1080p resolution that looked great a moment ago at 10 feet now looks low res and grainy.
Why do you think Head Mounted Display manufacturers love narrow field of view?
Several months ago I shipped off an MRG2.2 to Mnemonic in the Ukraine. He said he wanted to do a few mods and some experimenting. Little did I know that he would put together a totally sweet augmented reality system, where the view inside the VR helmet combined the real world outside the helmet with computer generated interactive 3D objects. Interaction comes through a gyroscopic head tracker AND a Microsoft Kinect. I’ll let the video and the photos explain further:
and here’s what the modified MRG2.2 looks like from the inside and outside:
The Kinect is enabled through FAAST software from the University of Southern California MxR.