V-Rtifacts

Around the World

Mnemonic’s MRG2.2 Upgrade – Augmented Reality + Kinect

Several months ago I shipped off an MRG2.2 to Mnemonic in the Ukraine. He said he wanted to do a few mods and some experimenting. Little did I know that he would put together a totally sweet augmented reality system, where the view inside the VR helmet combined the real world outside the helmet with computer generated interactive 3D objects. Interaction comes through a gyroscopic head tracker AND a Microsoft Kinect. I’ll let the video and the photos explain further:

and here’s what the modified MRG2.2 looks like from the inside and outside:

The Kinect is enabled through FAAST software from the University of Southern California MxR.

WOW!

And I’m Never Going Back To My Old School

Two snippets from the old, old school of VR, circa 1991, pitching a reputable UK firm – Division (acquired by PTC in 1999.) Featured are a couple of helmets from VPL Research using LEEP optics and cloth/velcro enclosures. One HMD appears to have been modeled after a gask mask from the trenches of the Great War. Also featured is the VPL CyberGlove.

The killer app? Kitchen lighting! Benefits: prevent the dropping of crockery in the home. Kewl!


A tip of the hat to Mnemonic for tracking down these gems!

Siggraph ’95 – Upon Further Observation

Who can remember doing all their 3D animation in MS-DOS? Back in the day, there was Gary Yost’s 3D-Studio (not Max!) licensed to and supported by AutoDesk. Now, who remembers creating stereoscopic animation with 3D Studio? VREX had a great little plugin that setup linked stereo cameras and let you render twice, once for left and again for right. Much fun on a 386!

In sorting through a carton of old BetaCam-SP tapes from the mid ’90s, I came across a non-so-cute animation I produced with the ever imaginative (and twisted) Steve Speer for Siggraph ’95. “UFO” (Upon Further Observation) defies categorization… so get out your red/cyan glasses and watch out for the a**l probe!

At Siggraph, UFO was shown in a bank of a dozen Virtual Research VR-4 helmets with shaker seats.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
ufoposter
ufotheater1
ufotheater2

And for those of you nostalgic for the days of animating in MS-DOS….

Retrospective photo review of Forte VFX1 Virtual Reality system

Forte VFX1 was the most advanced, complex and expensive consumer VR system that appeared on the market during VR craze in mid-nineties. Introduced in 1995, VFX1 was in the shops all around the world in 1996.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
red_blue
vfx1logo
intro1

Hardware overview

System consisted of:

  • Stereoscopic HMD “VFX1 headgear” with built-in 3DOF head-tracker from Honeywell, 45 degree diagonal FOV optics with plastic lenses, 180k resolution LCD screens from Kopin, integrated high-quality stereo headphones from AKG, and microphone;
  • Rugged gyro-joystick “Cyberpuck” with built-in 2DOF tracker and 3 programmable buttons (there was reported that not all VFX1 systems were sold with Cyberpuck);
  • To make this all stuff work – system’s “VIP” card need to be installed into ISA slot of the host PC. VIP card worked in pair with PC’s video-card connected via VESA bus to provide stereoscopic imagery on both screens of the HMD. VIP card also processed all the tracking data, and redirect sound to headphones. It also introduces Access Bus hub.

VFX1 was one on the first VR systems that were sold in former USSR countries. It was very pricy for common consumers here (with starting price in Moscow – 1495 USD), but nevertheless exported VFX1 systems were sold in big quantities. Many years after I was lucky enough to get my hands on such complete exported package, originally sold in Moscow, it have additional Russian manual not included in traditional US version.

Packaging

Let’s take a close look on VFX1 packaging arrangement. VFX1 was packaged in relatively small box (38x33x34 centimeters), with bunch of colorful pictures and a lot of self-advertisement, but its Virtual Reality isn’t it? Here, take a look.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
package_backward
free_cdrom
package_forward
package_inside
package_right
package_top

My box was damaged a little – plastic handle was broken, so for transportation purposes box were glued with scotch tape.

Buy a VR system and get free CD-ROM! Hell yeah, funny today but in 1995 this message had sense.

Package included:

  • VFX1 helmet
  • Detachable strap to helmet adjustments for smaller head sizes
  • Helmet data-cable
  • Cyberpuck (gyroscopic game controller) with Access Bus connector
  • VIP ISA board
  • VESA cable (for video-card attachment)
  • Audio cables with simple jack’s for headphones and microphone
  • Floppy disc with drivers
  • “Free CD-ROM!” with game demos
  • User manuals English and Russian versions

Helmet

VFX1 helmet was somehow bulky but well designed and well balanced; nowadays many VR enthusiasts put modern HMD internals in VFX1 shell for comfortable fit. Personally I prefer modern glasses-like design, but I admit – VFX1 sit’s pretty comfortable on my head.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
helmet_3
helmet_2
helmet_1
helmet_4
helmet_5
helmet_6

VFX1 helmet had “smart visor” that can be opened to allow user to look at the outside world, while not taking off whole helmet. This visor working pretty similar to VPL EyePhone visor which were used in “Lawnmower man” movie.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
helmet_open_1
helmet_open_2
helmet_inside

Visors optics are adjustable, you can change IPD and focal distance for each eye independently. There are no knobs or something to change IPD, you need to gently move oculars along the internal rails manually. Also rubber eyepieces on the oculars are easily detachable.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
ipd_3
focus_1
ipd_2
rubber_eyepiece

Glass optics upgrade was available for additional price, unfortunately nearly impossible to found improved VFX1 oculars today. Insides of the helmet covered with detachable soft foam glued-over with fabric.

Cyberpuck

Is gyroscopic joystick, hold in mid-air, designed to play VR games while standing on foot, absolutely great with Quake. It have 2DOF tracker (Pitch and Roll), and 3 programmable buttons. Pretty neat accessory, too bad it utilizes Access Bus connector and it’s impossible to use it on modern PC’s without being re-wired.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
cyberpuck1
cyberpuck2
cyberpuck3

Other accessories

Among other accessories that can be found in package – is helmet head-strap, 2.5 meters VFX1 data cable, original Forte floppy disk with drivers, and user manuals. VFX1 data cable is actually standard RS-232 26 pin Male-Female cable, which is very flexible. Nowadays it’s very hard to find such cables as spare part, even in specialized cable shops.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
cable
manuals
software

This particular cable marked with Forte logo, and had two warning flags:

“Do not use the VFX1 for more than for 15 minutes at a time (take frequent breaks) make sure the volume is turned down before putting on the VFX1 refer to manual for additional information”

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
flags
jack
jack_logo

Pretty good ad for a 1500 bucks device isn’t it? I suppose this was one of the show stoppers for VFX1, who will spare so much money on the gaming device that you can’t use more than 15 minutes at a time? But, it was good and pretty functional limitation for gaming arcades, where people play for short periods of time.

VIP board and cable connections

As mentioned earlier VIP board need to be connected to ISA slot, provides Access Bus hub, processes tracking data from head tracker and from cyberpuck. Through VESA connector it provides video signal to helmet. Access Bus was actually a predecessor to more useful standard – USB, it also provided possibility to connect many devices through the hubs (and through each-others), make hot connections on already working system (yep, that was a big step forward in RS232 COM era). However Access Bus didn’t stayed long, and I know only one device that uses it – it’s Cyberpuck.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
vip_1
vip_2
vip_3

In my system VIP card is connected via VESA to S3 Trio, it’s the most powerful video-card that provided proper VESA signal, compatible with VFX1. I found mentions from VFX1 users that proper VESA was also on Voodoo Banshee 3D accelerators, but I didn’t have this card and can’t test this.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
vip_4
vip_5
vip_6

Cyberpuck can be connected to VFX1 helmet or directly to VIP card. I prefer HMD connector because it allows playing on foot.

Turning the system on

We examined particular components of VFX1 system, and now let’s connect them together and take a look on the visor’s imagery.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
assembly_1
assembly_2
system

VFX1 works in Windows only in 640 x 480 x 256 colors mode. Actual LCD’s (789×230 color elements) can provide wider range of colors, but utilizing VESA for transferring image to HMD – limit’s it to 256 color palette. But, this palette isn’t fixed, it’s optimized, this means that it holds any color from true-color palette, as long as palette length itself no longer than 256 colors. My VFX1 unit was used frequently in the past, but LCD’s are still bright and colors are vivid.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
desktop
quake1
quake2

I’ve tried to take a few shot’s of what can be seen through VFX1 optics, it is much sharper and with fewer distortions in reality than on these photos. But anyway take a look on the desktop and on a few game-shots from Quake, Descent, and Heretic. These games are my favorites for VFX1, especially Quake1 which gives great immersive feeling even today. By the way VFX1 do not utilize depixelation filters (in contra verse to many professional HMD’s at the time), so black-spacers between pixels are clearly seen.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
descent1
descent2
descent3
heretic1
heretic2
heretic3

For stereoscopy, VFX1 supported two formats of input video – line sequential, and horizontal stereo-pair. While for running VFX1 in stereo-pair mode you need to use proper software, you can set VFX1 to force line sequential mode in windows configuration software, or use command line “VFX1.COM +t” to turn it on in DOS.

NextGen ScrollGallery thumbnail
crysis

Crysis stereoscopic screenshot in line-sequential mode, suitable for viewing through VFX1

Software

VFX1 have drivers compatible with DOS, Windows 95 and Windows 98. I’ve installed VFX1 in Windows 98 SE system, and it works there without issues. After hardware installation, you need to properly configure VFX1 software to make it work. When installing software, you’ve instructed to set IRQ settings according to DIP switches positions on VIP board. You can also check tracking for HMD and Cyberpuck. Personally I’ve liked VFX1 DOS software more for its fancy graphical 3D look, but Windows version of VFX1 configurator work pretty the same.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
software1
software2
software3
software4

One of the features that I liked in VFX1 better than in its “grandson” –VR920, that tracking need to be calibrated only once, software calibrate magnetometers automatically you only need to  choose your geographical region. After calibration – VFX1 tracking worked perfectly for me, and there’s no need in further recalibration.

To make game to support all VFX1 features you need to have proper game patch, in rare cases game have built-in VFX1 support (like Descent, System Shock or ZAR). In all other cases you can use VRMouse – native VFX1 mouse emulator, which emulates mouse and key presses for trackers and buttons of Cyberpuck.

Design benefits

VFX1 had many benefits in its release time. Other consumer VR systems at that time provide fewer features; all of them were without any sort of game-controller that allow you to play standing on foot, sometimes with lack of good head-tracking (like “CyberMaxx”) and stereoscopy support (like “Philips Scuba”). Only “I/O Glasses” had both 2DOF tracker and stereoscopy, but it lacked in game support at the moment of release and had inferior picture quality. Besides VFX1 had biggest FOV among other consumer HMD’s.

Overall VFX1 offered immersive experience and wide support of currently available games at the time. Stylish, comfortable and well balanced HMD design received positive critics and very soon in many countries VFX1 helmet was associated to Virtual Reality itself.

Design flaws

However, VFX1 had list of fatal design flaws caused by its early production – this includes ISA interface VIP board, utilization of VESA which limited it to 256 colors palette, and Access Bus which pretty soon was out of the game in favor to USB.

To overcome some of the flaws, Forte released “Linkbox”, which allow VFX1 connection to regular VGA outputs, but linkboxes were made in very small quantities, and nearly impossible to find nowadays. Also linkbox provided to VFX1 only video signal, without tracking, which make it pretty useless. Rumored full-feature linkbox were never created.

NextGen ScrollGallery thumbnail
linkbox

Linkbox photo by Kevin Mellot

As possible schema to run VFX1 on modern systems – is to use old host PC with VIP card installed, provide video signal to it through video capture card (some old TV tuner), and using Forte VFX1 SDK (which is available) to program VRPN drivers to get tracking info via network.

Instead of conclusion – followers VFX-3D, VR920, and…

After releasing VFX1, Forte was renamed to IIS, and in 1998 they released VFX3D – successor to VFX1. Fully copied external helmet design, VFX3D get rid of ISA VIP card, instead it had control box, with regular VGA connection to PC. Instead of using Access Bus to carry tracking data – VFX3D sent tracking data via COM port, which became obsolete nowadays too. VFX3D doubled the resolution of VFX1 (360k subpixels instead of 180k), had better color reproduction, but had much lesser FOV (35 degree instead of 45 in VFX1) and fixed optics. VFX3D also lacked Cyberpuck, which is on my opinion – a step back. Even with overall better characteristics and compatibility, VFX3D were sold in lesser quantities.

NextGen ScrollGallery thumbnailNextGen ScrollGallery thumbnail
vfx3d
vr920

Years later IIS changed name to Icuiti, and focused on manufacturing compact video-glasses. However they designed a new gaming HMD, which working title was X-Viewer, afterwards changed to VR920. Before releasing VR920 in 2007 company changed its name again to Vuzix.

Vuzix VR920 – almost tripled resolution of VFX3D (now it’s 920k subpixels, which is true 640×480 resolution), and completely changed its visual design to look like slim futuristic glasses which you can put in a pocket. VR920 have built-in 3DOF head-tracker, and can be connected to VGA or DVI with included adaptor. It supports input resolutions up to 1024 x 768, and drives power, audio, microphone, tracker, and stereo sync-signal via USB. VR920 have no control box, which make it pretty possible to use as mobile HMD for small PC’s or Netbooks. Latest software update for VR920 enables all its functions on Windows7 64bit OS.

Currently Vuzix focused on multi-purpose Wrap series of portable video-glasses which lacks head-tracking for VR gaming. Wrap 6DOF head-tracking module is announced but yet not produced by company.

Build Your Own Fluid-based Prismatic Stereoscopic Goggles

For 150 years people have been free-viewing stereoscopic photos (and more recently videos) in a side by side cross-eyed format, where the left view is positioned to the right of the right view. You’re force to cross your eyes like an optical contortionist. For eyeballs with less agility, this can become painful. By using prisms in front of each eye, the eye strain is eliminated. Here’s a truly unique DIY method for building such a viewer on the cheap.

Editor’s note: This article was originally published in Russian by Sergey Velichkin in “Science and Life”, a Russian magazine, and on his webpage. It was updated and translated, with the author’s permission, into English by V-Rtifacts contributor Mnemonic. Many thanks!

Introduction

Fluid-based prismatic stereoscopic goggles it’s full-color no-ghosting stereoscopic goggles tech, that everyone can make in a matter of several hours with use of materials for total cost about $1. No anaglyph or similar principles that can ruin colors, those prismatic goggles are working in other way.

The idea is simple – you know about cross-eyed method of viewing stereo-pictures; the idea of these goggles is to make optical device to view cross-eyed content from monitor, with which you don’t need to strain your eyes, bingo!

It’s working flawlessly on any monitor, even on printed-out pictures.

Construction

To make fluid-based prismatic stereoscopic goggles you will need following materials:

  • Transparent CD box
  • Plastic glue
  • 50g of Glycerol (can be found in drugstore) [we used 85% consistency and no flavor]

If you can’t find glycerol you can use distilled water, but glycerol has a bigger IOR rate and will give better characteristic to goggles.

You will also require following tools:

  • centimeter line (metal one is preferable)
  • knife (to cut plastic, office knife for example)
  • file or emery board (will be used to smoothen corners)
  • syringe (to fill prism with liquid)

Let’s Start!

From bottom-part of CD-box cut detail “A” (you will have needed size for detail automatically if  you will cut from side-to-side), you can cut only a few times, after that plastic can be broken by cut-lines.

Details: “B”, “C”, ‘D” must be made from black plastic of CD-box. Cut two notches in “C” membrane (on the top, and on the bottom) – this must be made to allow liquid and air move from one part of prism to another. Rub glance side of membrane “C” with emery, to make it matt. You will need to glue-in “B” & “D” details by matt side inside prism to minimize mirroring effect.

After you cut all the details – to fit ideally trim them, if needed. You can trim with a file or use your emery board.

When all details are ready, we can glue them together, lets start by glue part “C” to the middle of part “A”, then glue parts “E” & “F”, after this while glue is not dry yet you can fit these details together ideally and glue detail “B” to the bottom.

Give it to dry out totally, don’t let any holes appear, you can mix plastic-chips with glue, to make it denser, and fill all contours with such mix to exclude holes.

When construction dries, you can test it by filling it with cold boiled water. If you see fluid leakage – dry prism, and glue that holes again. After you will be sure that your construction is safe to fill with liquid – glue box top (detail “D”). Be sure to make small holes 3-4 mm diameter in “D” as it shown on picture, before glue it. After glue dry we can fill prism with liquid.

As a liquid for our prism, it’s better to use glycerol (it has better refraction capabilities than water), but if you don’t have glycerol you can use distilled water. To properly fill your prism with glycerol – use syringe, it’s very careful and slow process because glycerol is very dense, but little by little you can fill the prism, try not to make air bubbles, and fill your prism to maximum (some bubbles of air is ok). After you filled the prism, dry out holes and close them with sticky tape, or glue them with another plastic part.

Shutters & Mounting

To improve stereo-image quality, remove left and right mirror images (so only stereoscopic picture will remain visible), you can make shutters (from paper, or not-transparent tape), and fix them on prism with sticky tape as it shown on picture. By the way you can look on this prism from both sides. Size of shutters depends of your monitor, generally – 31 x 35 mm is ok.

How To Use

Just bring prism to your eyes and look at some cross-eyed format stereoscopic content, try to vary different distances to your monitor and choose the best that suited for you.

Other Materials

These goggles also can be made from organic glass (make certain it is shatter-proof), but it will require more sophisticated instruments and techniques! You can vary the size of prisms, but be sure to make 18 degree angle between its front and back surfaces.

Content

Any  cross-eyed stereo pair can be viewed with these goggles.

Here’s some interesting links for pictures:

Good collection of stereoscopic cross-eyed pairs can be found here: http://www.mtbs3d.com/gallery/

Movies:

Various short movies in side-by-side format can be found here:http://www.3dtv.at/Movies/Index_en.aspx

Many stereoscopic movies can be found on Youtube, search “stereo pair” or view this link:http://www.youtube.com/results?search_query=stereo+pair&search_type=&aq=f
Don’t forget to select cross-eyed mode in Youtube options.

Games:

If you have Queke3 by ID Software, you can download this stereoscopic mod to play with stereo-prism: http://games.mirrors.tds.net/pub/planetquake3/modifications/stereoquake.zip
Just unpack it into “baseq3” directory of Quake3 and run the game!
Example of how it looked can be found here: http://www.youtube.com/watch?v=tXvirxRK-Ww

Avatar game can output picture in cross-eyed stereo-pair, to make this: turn on stereo and select “side-by-side” output, also turn on “swap-eyes” option. You can download Avatar game demo here:http://www.gamershell.com/download_53202.shtml

Stereoscopic drivers:

There are two stereoscopic drivers on the market that can output cross-eyed stereo-pairs from DirectX games, they both payware, work in different ways, but both have trial versions, so you can try and choose which driver you liked most.

IZ3D driver: http://www.iz3d.com/driver
DDD TriDef Ignition driver: http://www.tridef.com/ignition/

Back In The USSR

VFX-3D Head Mounted Display

USA and other western world faced consumer-focused Virtual Reality boom in late 80s and early 90s, accurately when USSR is fall apart. VR came to big industrial cities of post USSR later in 1995 – 1998, when VR hype slowly begin to fall down in USA. That was in a few years after IBM-compatible PC’s settled down in Russia, Ukraine and other countries. PC’s are finally moved aside ZX Spectrum platform which was most popular home computer in late eighties and early nineties here.

ELSA Revelator shutter-glasses

Consumer VR started with ELSA Revelator shutter glasses, Forte VFX-1, and i-Glasses HMD’s (which are still can be found from time to time in private geek collections).

These devices had much higher price here than in USA (with more than two-times higher cost), multiply this with poor level of life in after-perestroyka times, and it’s became obvious that only reach geeks were able to buy such stuff for home use, other soviet-born hackers and cyberpunks only dreamed about VR, not to mention other peoples. (more…)