V-Rtifacts

Tag Archive: 3D

Seeing the Eye in a New Light

There’s been an enormous resurgence of DIY HMDs in the VR hacker community recently, some quite impressive. Understanding how the eye works is the key to these inventions. I found a really instructive 70 year old nugget which gives HMD designers the real lowdown. All the way from 1941 to you….

If you find this video a little advanced (it really isn’t), check out part 1 of the same series:

3-Dimensions… For the First Time… 3-D FEELIES!!

MAD Magazine, June 1954:

DDD (3D) COMICS DEPT: By now you are familiar with 3-D Comic Books! You Know that some 3-D books enclose One set of 3-D glasses… You know some 3-D Books enclose Two sets of 3-D glasses! We are proud to announce that we of Mad are enclosing No sets of 3-D glasses for this, our first Mad story in… 3-DIMENSIONS!

Mad 3D

(click on Super-Mickey to view original article)

 

Vuzix Wrap 920 Augmented Reality Hands On

Recently I got my hands on brand new Vuzix video-see-through augmented reality HMD – Wrap 920 AR. It’s not quite a consumer product, it’s more focused on R&D in Augmented Reality field, there are small amount of information about it on the net and few people asked me for a review. Besides, I hope it will be interesting to many VR geeks on the planet, so here it comes. I want to give as much info as I can, but will try to keep this article short and don’t miss anything valuable.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
01_wrap_ar_500x375
02_wrap_ar_500x375

Editor’s note: Thanks go out to Mnemonic who put together this excellent review. While not strictly a VRtifact, future posts will draw the connection between the earliest augmented reality systems from the 80’s and 90’s and the Wrap 920 AR. Stay tuned…

Virtual Research VR-4 Adapted For Stereoscopic Augmented Reality

Virtual Research VR-4 Adapted For Stereoscopic Augmented Reality – circa 1993

Packaging

Wrap 920 AR comes in really big box in comparison to compact package of VR920. Honestly, I didn’t expect it to be so big, but it’s because of bunch of different stuff inside, all packed in different sockets cut in safety foam. You can see list of included stuff on the sign, on top of the box. I liked that each part of the package is wrapped in some packet; head-tracking module comes in small acrylic box for example. Two AR markers on plastic-base included, which is nice to check Vuzix AR demos right away.

Drivers for the HMD are digitally distributed by Vuzix via Internet, so no installation disk is included.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
03_boxes_compare_500x375
04_box_contents_500x375
05_inside_box_500x375
06_tracker_box_500x375

There is also solid travel casing included in the package, HMD with cables and VGA adapter fits there nicely:

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
07_case_1_500x375
08_case_2_500x375
09_case_3_500x375

Adapters & cables

Wrap 920AR based on Wrap series of Vuzix HMD’s, and as any other Wrap HMD it supports various video sources for input. It’s includes composite video, iPod / iPhone connection and what we interested in – regular VGA for PC connection. To use VGA or composite video source you need to choose proper “adapter”, which are actually a control boxes. All currently available adapters (VGA, composite / iPod) included in the package of Wrap AR. Vuzix recently announced Wrap HDMI adapter, so I’m pretty sure it will be compatible. There’s also DVI to VGA adapter in the package for DVI-I connection.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
10_remote_01_500x375
11_remote_02_500x375
12_remote_logo_500x375

Wrap AR HMD have two cables, one from visor system (HMD itself) with some small specific connector which goes into control box, and another one from stereoscopic camera system – regular USB. VGA control box have VGA and USB connectors. USB needed to power up screens, provide audio and head-tracking.

Assembling

Before start to work with Wrap 920AR in its full capacity we need to attach head-tracker, VGA adapter and optionally headphones. From the inside HMD have two small jack connectors for ear-plug style headphones and micro connector on the right brow for head-tracker module.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
13_wrap_ar_500x375
14_wrap_ar_500x375

Tracker connector and HMD-to-control-box connectors are very small, and looks fragile, so I would recommend assembling these with care, because they do need to put some force to plug in. But once connected, tracker (and control-box connector) securely stays in place, and don’t bother you.

Computer connection

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
15_netbook_500x375
16_to_pc_500x375

Wrap AR had straight-forward connection to my netbook and laptop, just plug in VGA and both USB cables and it’s ready. But first thing I noticed when tried to connect them to my (most powerful) stationery computer that cables are way to short!

Cables are much shorter than what was in VR920. I suppose Vuzix designed glasses to be connected to laptops, which sounds reasonable for Augmented Reality usage. Besides, in the full PDF manual (more than 100 pages!) I found mention that for stationery computers additional extension cables are need to be used.
In short – I used 3 meters VGA extension cable and two 2 meters USB cables to connect Wrap AR to my stationery PC, and in this configuration device work without any issues.

After connecting HMD, drivers were installed fluently on both systems: Windows XP 32 bit and Windows 7 64 bit, I also tried them on Windows Vista 32 bit, without any problems. HMD supports input video signal with resolution up to 1024 x 768 with 60 Hz refresh rate. It can be used both in clone and extend monitors modes like any external monitor.

Adjustments and ergonomics

Once connected to PC (and drivers are installed), buttons on the control box (adapter) provide control to the HMD adjustments menu. In the menu you can switch between few brightness and contrast presets, set your own preset, switch between stereoscopic and monoscopic modes, switch between different stereoscopic modes (side-by-side stereo pair, or various anaglyphs), swap left and right eyes in stereo mode, and adjust headphones volume.

On the back of the adapter you can find a little screw-driver, which is needed to adjust focus. Two knobs for focus adjustments you can find under rubber cover on top of the HMD. Knobs allow you to adjust between +2 to -5 diopters independently for each eye.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
17_wrap_ar_500x375
18_focus_adjustments_500x375

My Wrap AR when first unpacked and connected to PC, had both knobs set to the very left position, I believe it was -5. I have perfect vision and was completely unable to focus screens this way. But with step-by-step slight adjustments, independently for each eye I was able to set glasses to very comfortable focus, and both “eyes” give me a sharp and clean image.

Also nose-piece can be adjusted for particular nose, and all nose-piece construction can slide inwards (or backwards) into HMD. Additional (spare) nose-piece and ear-plug nozzles of different sizes also included in the package.

It is possible to adjust optics between -5 and +2 diopters, but if you happen to have worse vision, you can find that it’s hard to use HMD with glasses while head-tracker attached, so probably you will need to use contact lenses.

Personally I found Wrap AR to be pretty comfortable, HMD is easy to wear and lightweight enough.

Screens, optics and visual quality

Wrap 920 AR have two true 752 x 480 LCD color screens which are located inside visual module casings and project image down into lens/prism system. In Wrap predecessor – iWear VR920 screens were located in front of the eyes, here Vuzix decided to go with another optical design. Optics has narrow 31 degree diagonal FOV with 100% stereo overlap, pretty much the same as with VR920 (32 degree), personally I didn’t feel the difference in the image size, but of course I would prefer if FOV was bigger, at least like in old VFX-1 with 45 degree.

All surroundings from the sides and from the bottom of the screen can be clearly seen, so it doesn’t block your view. This is bad in case of Virtual Reality use, but can be good when it comes to Augmented Reality applications, because you still see and aware of your surroundings outside of the screens, and on the screens, and in the same time inside screens you can see all AR “magic”.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
19_inside_1_500x375
20_inside_2_500x375

In comparison with VR920, picture quality inside Wrap 920 is much better! Picture is perfectly clear and sharp, and looks the same in both eyes; also color reproduction is much better.

As many of you know, iWear VR920 had “child problems” with screens system – image in left eye looked a little grainier (less colors) then from the right eye. When used for long periods of time – VR920 was able to overheat, and when that happened – image quality degraded, user begin to notice “scan lines” and even in case of extreme overheat, many users noted “black dot” which appeared in corner of the screen. Those artifacts thankfully weren’t permanent, and after cooling down HMD by unplugging USB chord image became normal again.

Wrap 920 AR don’t have any of these “child problems”. Glasses stayed almost all working day plugged into my laptop and just became normally warm. Image quality doesn’t change, so it’s really good that Vuzix solved such issues! This HMD can be plugged and powered on as regular monitor as long as you wish.

Also, from the first try I thought that my Wrap AR have bigger resolution screens. What I mean is when desktop is set to 1024×768 mode normally in VR920 I wasn’t able to read any standard-sized text in Windows, in Wrap AR I can operate Windows almost normally, text isn’t perfect but it’s readable in all the menus. Perhaps its benefit of better optics, higher quality screens, and better image scaling algorithm, but fact that picture is pretty readable even in 1024 x 768.

Stereoscopy

Main stereoscopic mode of Wrap 920 AR is side-by-side stereo-pair (it can be parallel or cross-eyed, both modes supported), which is very good from developers point of view, because it’s fairly easy to implement. But, in fact, gives less resolution per-eye. So if Wrap 920 AR is working in 1024 x 768, effective pixels will be 512 x 768 per eye, each scaled to 752 x 480 screens.

Crysis2 Stereo Side By Side

Crysis2 Stereo Side By Side

Crysis 2 in native stereo-pair mode

What is good that both eyes will be perfectly synchronized, and you can give full 60 frames per second for each eye! Stereo-pair support make glasses perfectly compatible with iZ3D and TriDef Ignition stereo-drivers, besides some new games like Crysis 2, and Avatar can output stereo-pair natively.

For those who compare characteristics to VR920, it had limitation of 30 FPS per eye in stereo, because of page-flipping stereoscopy; Wrap series don’t have such limitation.

Cameras

Wrap 920 AR have two high-speed micro-cameras with 640 x 480 native resolution, which are actually capable of 60 frames per second (if your computer can handle). 60 Herz refresh rate gives really nicely smooth and almost perfect picture of the surroundings, which looks really good in stereoscopy! In Windows Wrap AR camera system recognized as two independent USB cameras.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
22_inside_3_500x375
23_photo_through_glasses_500x375

I’ve compiled small example from Vuzix SDK to check stereo cameras, and tried to make a photo to give you some impression of how it looks like. In reality picture in glasses looks really nice, and it blends good with surroundings. FOV of the cameras and screens optics FOV fit close to each other (not ideally, but close enough to give you proper illusion), which is good point for AR.

Picture quality of Wrap AR cameras not as nice as in new top-line Logitech webcam’s for example, but far better than most regular webcams can provide, and they work very fast when PC can handle it. Besides, exposition, white-balance and other stuff manually controllable from the camera drivers. They are also can be controllable from the inside of self-made software using Vuzix SDK.

Head Tracker

New Wrap 6TC head tracker besides 3 accelerometers and 3 magnetometers also includes 3 gyroscopes, which greatly improved orientation tracking when comparing it to VR920 head-tracker. It’s much less dependent on external magnetic influences, and do not require frequent re-calibrations. In fact I’ve calibrated them only once, and tracker work fine even week after, without any recalibration.

Head Tracker

VR920 AR Head Tracker

Using SDK we can receive full 6DOF information from the tracking. In this mode absolute 3DOF orientation information provided (Yaw, Pitch, Roll), along with relative 3DOF position (X, Y, Z). However Vuzix notes in current SDK that position info is in early beta and can’t be used for anything serious besides just “movement” detection. True I didn’t figured out how to use those X, Y, Z values with current driver and SDK, they seems pretty chaotic, but hopefully they will be useful in future with next drivers release.

Software

Wrap 920 AR drivers supports Windows XP, Vista and Windows 7 both in 32 and 64 bit versions.

Wrap 920 AR shipped with “maxReality” license, which is an AR plugin for 3D Studio Max (2010 and 2011). I didn’t use this software so far, because I plan to use these glasses with my own software, but maxReality have few nice demos, which can be used to check all functions of Wrap 920 AR.

I’ve captured movie examples of Vuzix “Dragon” demo, these movies are stereoscopic, so you could take a look how it actually looks like in HMD on your stereo-setup (please watch in HD).

Also Wrap AR is fully supported by Vuzix VR manager software, which provides stereoscopy and head-tracking for more than hundred of gaming titles. Even if it’s isn’t gaming HMD, nice to have this feature.

SDK

Free to use SDK with C++ examples available from Vuzix website to give programmers ability to use any feature of this HMD including head-tracker, stereoscopy, cameras, and also optical marker tracking example based on ALVAR library. SDK is well documented and examples are good to use.

Conclusion

Some of the statements in this review can be fair for other HMD’s from Wrap series (like Wrap 920) its goes to stereoscopic support and head-tracking module. Some other statements can be close too, but I can’t 100% guarantee that, because I’ve used only AR version, which is a little different even externally from other Wrap HMD’s, and also can be a little different in electronic components which used in it.

If you happen to build your own Augmented Reality software, or you make research and development in this field, and you have a budget on Wrap 920 AR, I would say go for it! It’s nice lightweight HMD which provide true stereoscopic video-see-through. It is ready to use hardware solution. I happy I bought it for my projects.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
25_comparison1_500x375
26_comparison2_500x375
Wrap 920AR besides VR920 modded with Logitech HD C310 webcam into AR glasses.

Flashback To The ’40s

We all know that the 1950’s were the golden age of 3D movies, Hollywood’s attempt to fend off the rapidly growing television audience. Their 3D thrust was short lived, and with a few exceptions, we enjoyed almost 50 years of 2D bliss. This time around 3D is harder to avoid… TV has it too! For those of you who want to preserve your 2D way of life, liberty, and the pursuit of happiness, Amazon now offers 2D Glasses, a simple way to revert passive 3D systems for 2D viewing. And who says the world isn’t flat?

2D Glasses

2D Glasses

Night vision goggles of Red Army!

Suddenly, I found the information that USSR army, just before World War 2 developed electronic head-mounted infra-red night-vision goggles for tank crew! It is not exactly a virtual reality subject, but nevertheless it’s early days of electronic HMD’s in Soviet Union.

In 1993-1940 years infra-red goggles “Ship” and “Dudka” were tested by crews of BT-7 light tanks. “Ship” was developed by national optics institute and Moscow institute of glass. Device included: infra-red periscope goggles, and additional accessories for driving machinery during night.

Ship

Ship - Infra Red Night Vision Goggles

Upgraded version “Dudka” had field tests during June 1940, and after in January – February 1941. Device included: infra-red periscope goggles for tank driver, and crew commander, two infra-red beamers (by 1 Kilowatt each, 140 millimeters diameter each), control unit, separate IR signal beamer, cables and accessories for goggles.

Dudka

Dudka - Another Infra Red Night Vision System From Pre-War USSR

BT-7, light tank

BT-7, light tank

Goggles weight (without helmet-mounting) 750 gram, FOV – 24 degree, seeing distance at night – 50 meters. These devices approved all specifications of Red Army, but because of bulky construction design, usability issues, especially during winter-time, goggle construction needed additional development, which wasn’t made because of World War 2.

Tank Driver Wearing Dudka

Tank Driver Wearing Dudka

Research and development continued after WWII.

 

IR_Goggles
Upgraded, early after-war version of IR goggles (IKN-8) for T-34 tank crew

Read the whole story in English or the original Russian.

 

3D Photo Tools

If you’ve been into 3D still photos for a while, no doubt you’ve come to love StereoPhoto Maker, a great (free) Windows based tool for aligning, cropping, correcting and adjusting 3D digital pictures. But when you’re done fooling with the pixels, how can you share them with the world? Everybody seems to have a different 3D viewing system.

Not long ago, I ran across Phereo.com, a new (free) 3D photo sharing site (think Flickr, but for stereoscopic images.) You can upload stereoscopic photos in a variety of formats, and then anyone can view them in a wide selection (their selection) of formats and sizes.

Phereo is still in public beta testing, but they’ve said that it comes out of beta on Nov. 1. Looks like it’s hosted on Amazon EC2, so I assume there’s plenty of storage and horsepower to back it up.

Phereo 3D images can be embedded in your own web pages. That alone got me wound up enough to write and publish 3D Pix, a WordPress plugin which handles all the embedding work and upgrades the WordPress post editor with an “Insert 3D Pix” button to make posting super simple.

All these photos were shot with my Fuji W3 at 10 megapixels per eye, but the W3 is the subject of another (forthcoming) post. Until then….

Build Your Own 3D Shutter Glasses Controller for Field Interlaced Stereoscopic

There are tons of stereoscopic DVDs and VHS tapes on the market encoded as field interlaced stereo. Also, one of the easiest ways to make 3D video is with a camcorder (NTSC or PAL) and a NuView 3D adaptor (often selling on Ebay for less than $100.) For those of you who want to watch on a good old fashioned television, shutter glasses offer excellent 3D (but with some flicker.) Another use for NTSC/PAL shutter glasses is to preview on a field monitor when shooting 3D video.

3D glasses (wired) are a dime a dozen these days, but how do you synchronize them with the video fields of an NTSC or PAL TV signal. Today’s project shows you how to build and package a control circuit to do just that. It is simple and cheap, and the packaging is mighty rugged.

This fine example (pictured above) has endured about 7 years in the field shooting under all sorts of uncomfortable conditions. Its been to India, Thailand, Honduras, Mexico, Dominican Republic, and North St. Louis, to name a few.

Looking at the connectors and controls from left to right:

  • There’s 2 BNC connectors for video. They’re just a loop through. Plug your NTSC or PAL video source into either connector and your monitor into the other. The shutter control box will sense the video sync without altering the signal on the way to a color monitor.
  • The first toggle switch lets us reverse which image goes to which eye. Sadly, there seems to be no standardization of field interleaved stereoscopic video with respect to which video field gets which eye’s view. This switch lets us put either field to either eye.
  • The second switch turns the power on and off. In addition to an internal 9V battery, the control box can run off a 9-12 VDC wall wart or even a Anton-Bauer power pack.
  • The jack on the right is for external DC power. There’s a small green LED above it to let us know when the control box is turned on.

The control box will work with any brand of shutter glasses with a 3.5mm stereo mini plug such as the glasses shown below.

So… let’s get to the actual circuit. Fortunately it is quite simple; just 2 chips and a few other components. The metal case and toggle switches are the most expensive part of this project, but don’t worry, it isn’t much.

Shutter-Schematic

A quick description: Video comes in on the left through a coupling capacitor (C4) into an LM1881 sync separator chip. One of the outputs of this IC is an ODD/EVEN signal – binary logic for video field 1 or video field 2. Toward the right a CMOS 4030 quad exclusive-or chip is configured as a fast square wave generator. The frequency isn’t overly important, 500 hz to 1 khz is fine. The shutters on the glasses are made opaque by this square wave. The ODD/EVEN signal modulates this square wave flipping the shutters on and off. Opposing signals are generated for left and right eyes. A DPDT switch reverses the connections to the 2 shutters in the glasses.

The first few of these that I built were hand wired on perf board, but eventually I moved over to a printed circuit board. You can download the layout as a PDF. For short runs you can use Press n’ Peel Blue to make the board. In order to keep this a one-sided PCB, there’s 2 jumpers: J1 and J2. Don’t forget to install them.

The hardest part of the project is manufacturing the enclosure, mounting the parts and wiring everything up. Its just time consuming. I used a Hammond 1590B metal box which is virtually indestructible. You’ll need to drill holes for all the jacks and connectors. Measure each connector carefully. Aluminum is soft and you can drill all the holes with a small hand drill. Drill everything before starting to mount and wire things. Brush out all the metal shavings before starting with the components.

The PCB is just tacked down with double sticky-sided tape (the thick foamy type.)

You MUST keep the sleeve of the 3.5 mm shutter jacks insulated from the metal case. If you’re using a plastic case, you can use any old stereo jack, but with a metal case you’ll need special ones like these (above.)

Wiring up the switches, BNC connectors, and power jack is straightforward. Just follow the schematic. You can substitute panel mounted RCA jacks if you don’t like BNC.

I used kynar (wire-wrap wire) for all the signals and 24 gauge stranded for all the power.

The battery holder clip is held in with a 4/40 screw, nut, and lockwasher.

Parts Sources