Books, e-books and the e-paper chase

Last November Amazon opened its first retail book store in Seattle near the campus of the University of Washington. More than two decades after it pioneered online book sales—and initiated the e-commerce disruption of the retail industry—the $550 billion company seemed to be taking a step backward with its “brick and mortar” Amazon Books.

Amazon Books opened in Seattle on November 3, 2015
Amazon opened its first retail book store in Seattle on November 3, 2015

However, Amazon launched its store concept with a nod to traditional consumer shopping habits, i.e. the ability to “kick the tires.” Amazon knows very well that many customers like to browse the shelves in bookstores and fiddle with electronic gadgets like the Kindle, Fire TV and Echo before they make buying decisions.

So far, the Seattle book store has been successful and Amazon has plans to open more locations. Some unique features of the Amazon.com buying experience have been extended to the book store. Customer star ratings and reviews are posted near book displays; shoppers are encouraged to use the Amazon app and scan bar codes to check prices.

Amazon’s book store initiative was also possibly motivated by the persistence and strength of the print book market. Despite the rapid rise of e-books, print books have shown a resurgence of late. Following a sales decline of 15 million print books in 2013 to just above 500 million units, the past two years have seen an increase to 560 million in 2014 and 570 million in 2015. Meanwhile, the American Booksellers Association reported a substantial increase in independent bookstores over the past five years (1,712 member stores in 2,227 locations in 2015, up from 1,410 in 1,660 locations in 2010).

Print books and e-books

After rising rapidly since 2008, e-book sales have stabilized at between 25% and 30% of total book sales
After rising rapidly since 2008, e-book sales have stabilized at between 25% and 30% of total book sales

The ratio of e-book to print book sales appears to have leveled off at around 1 to 3. This relationship supports recent public perception surveys and learning studies that show the reading experience and information retention properties of print books are superior to that of e-books.

The reasons for the recent uptick in print sales and the slowing of e-book expansion are complex. Changes in the overall economy, adjustments to bookstore inventory from digital print technologies and the acclimation of consumers to the differences between the two media platforms have created a dynamic and rapidly shifting landscape.

As many analysts have insisted, it is difficult to make any hard and fast predictions about future trends of either segment of the book market. However, two things are clear: (1) the printed book will undergo little further evolution and (2) the e-book is headed for rapid and dramatic innovation.

Amazon launched the e-book revolution in 2007 with the first Kindle device. Although digital books were previously available in various computer file formats and media types like CD-ROMs for decades, e-books connected with Amazon’s Kindle took off in popularity beginning in 2008. The most important technical innovation of the Kindle—and a major factor in its success—was the implementation of the e-paper display.

Distinct from backlit LCD displays on most mobile devices and personal computers, e-paper displays are designed to mimic the appearance of ink on paper. Another important difference is that the energy requirements of e-paper devices are significantly lower than LCD-based systems. Even in later models that offer automatic back lighting for low-light reading conditions, e-paper devices will run for weeks on a single charge while most LCD systems require a recharge in less than 24-hours.

Nick Sheridon and Gyricon

The theory behind the Kindle’s ink-on-paper emulation was originated in the 1970s at the Xerox Palo Alto Research Center in California by Nick Sheridon. Sheridon developed his concepts while working to overcome limitations with the displays of the Xerox Alto, the first desktop computer. The early monitors could only be viewed in darkened office environments because of insufficient brightness and contrast.

Nick Sheridon and his team at Xerox PARC invented Gyricon in 1974, a thin layer of transparent plastic composed of bichromal beads that rotate to create an image
Nick Sheridon and his team at Xerox PARC invented Gyricon in 1974, a thin layer of transparent plastic composed of bichromal beads that rotate with changes in voltage to create an image on the surface

Sheridon sought to develop a display that could match the contrast and readability of black ink on white paper. Along with his team of engineers at Xerox, Sheridon developed Gyricon, a substrate with thousands of microscopic plastic beads—each of which were half black and half white—suspended in a thin and transparent silicon sheet. Changes in voltage polarity caused either the white or black side of the beads to rotate up and display images and text without backlighting or special ambient light conditions.

After Xerox cancelled the Alto project in the early 1980s, Sheridon took his Gyricon technology in a new direction. By the late 1980s, he was working on methods to manufacture a new digital display system as part of the “paperless office.” As Sheridon explained later, “There was a need for a paper-like electronic display—e-paper! It needed to have as many paper properties as possible, because ink on paper is the ‘perfect display.’”

In 2000, Gyricon LLC was founded as a subsidiary of Xerox to develop commercially viable e-paper products. The startup opened manufacturing facilities in Ann Arbor, Michigan and developed several products including e-signage that utilized Wi-Fi networking to remotely update messaging. Unfortunately, Xerox shut down the entity in 2005 due to financial problems.

Pioneer of e-paper Nick Sheridon
Pioneer of e-paper, Nicholas Sheridan

Among the challenges Gyricon faced were making a truly paper-like material that had sufficient contrast and resolution while keeping manufacturing costs low. Sheridan maintained that e-paper displays would only be viable economically if units were sold for less than $100 so that “nearly everyone could have one.”

As Sheridon explained in a 2009 interview: “The holy grail of e-paper will be embodied as a cylindrical tube, about 1 centimeter in diameter and 15 to 20 centimeters long, that a person can comfortably carry in his or her pocket. The tube will contain a tightly rolled sheet of e-paper that can be spooled out of a slit in the tube as a flat sheet, for reading, and stored again at the touch of a button. Information will be downloaded—there will be simple user interface—from an overhead satellite, a cell phone network, or an internal memory chip.”

E Ink

By the 1990s competitors began entering the e-paper market. E Ink, founded in 1998 by a group of scientists and engineers from MIT’s Media Lab including Russ Wilcox, developed a concept similar to Sheridon’s. Instead of using rotating beads with white and black hemispheres, E Ink introduced a method of suspending microencapsulated cells filled with both black and white particles in a thin transparent film. Electrical charges to the film caused the black or white particles to rise to the top of the microcapsules and create the appearance of a printed page.

E Ink cofounder Russ Wilcox
E Ink cofounder Russ Wilcox

E Ink’s e-paper technology was initially implemented by Sony in 2004 in the first commercially available e-reader called LIBRIe. In 2006, Motorola integrated an E Ink display in its F3 cellular phone. A year later, Amazon included E Ink’s 6-inch display in the first Amazon Kindle which became by far the most popular device of its kind.

Kindle Voyage (2014) and Kindle Paperwhite (2015) with the latest e-paper displays (Carta) from E ink
Kindle Voyage (2014) and Kindle Paperwhite (2015) with the latest e-paper displays (Carta) from E ink

Subsequent generations of Kindle devices have integrated E Ink displays with progressively improved contrast, resolution and energy consumption. By 2011, the third generation Kindle included touch screen capability (the original Kindle had an integrated hardware keyboard for input).

The current edition of the Kindle Paperwhite (3rd Generation) combines back lighting and a touch interface with E Ink Carta technology and a resolution of 300 pixels per inch. Many other e-readers such as the Barnes & Noble Nook, the Kobo, the Onyx Boox and the PocketBook also use E Ink products for their displays.

Historical parallel

The quest to replicate, as closely as possible in electronic form, the appearance of ink on paper is logical enough. In the absence of a practical and culturally established form, the new media naturally strives to emulate that which came before it. This process is reminiscent of the evolution of the first printed books. For many decades, print carried over the characteristics of the books that were hand-copied by scribes.

It is well known that Gutenberg’s “mechanized handwriting” invention (1440-50) sought to imitate the best works of the Medieval monks. The Gutenberg Bible, for instance, has two columns of print text while everything else about the volume—paper, size, ornamental drop caps, illustrations, gold leaf accents, binding, etc.—required techniques that preceded the invention of printing. Thus, the initial impact of Gutenberg’s system was an increase in the productivity of book duplication and the displacement of scribes; it would take some time for the implications of the new process to work its way through the function, form and content of books.

Ornamented title page of the Gutenberg Bible printed in 1451
Ornamented title page of the Gutenberg Bible printed in 1451

More than a half century later—following the spread of Gutenberg’s invention to the rest of Europe—the book began to evolve dramatically and take on attributes specific to printing and other changes taking place in society. For example, by the first decade of the 1500s, books were no longer stationary objects to be read in exclusive libraries and reading rooms of the privileged few. As their cost dropped, editions became more plentiful and literacy expanded, books were being read everywhere and by everybody.

By the middle 1500s, both the form and content of books became transformed. To facilitate their newfound portability, the size of books fell from the folio (14.5” x 20”) to the octavo dimension (7” x 10.5”). By the beginning of the next century, popular literature—the first European novel is widely recognized as Cervantes’ Don Quixote of 1605—supplanted verse and classic texts. New forms of print media developed such as chapbooks, broadsheets and newspapers.

Next generation e-paper

It seems clear that the dominance of LCD displays on computers, mobile and handheld devices is a factor in the persistent affinity of the public for print books. Much of the technology investment and advancement of the past decade—coming from companies such as Apple Computer—has been been committed to computer miniaturization, touch interface and mobility, not the transition from print to electronic media. While first decade e-readers have made important strides, most e-books are still being read on devices that are visually distant from print books, impeding a more substantial migration to the new media.

Additionally, most current e-paper devices have many unpaper-like characteristics such as relatively small size, inflexibility, limited bit-depth and the inability to write ton them. All current model e-paper Kindles, for example, are limited to 6-inch displays with 16 grey levels beneath a heavy and fragile layer of glass and no support for handwriting.

The Sony Digital Paper System (DPT-S1) is based on E Ink’s Mobius e-paper display technology: 13.3” format, flexible and supports stylus handwriting
The Sony Digital Paper System (DPT-S1) is based on E Ink’s Mobius e-paper display technology: 13.3” format, flexible and supports stylus handwriting

A new generation of e-paper systems is now being developed that overcome many of these limitations. In 2014, Sony released its Digital Paper System (DPT-S1) that is a letter-size e-reader and e-notebook (for $1,100 at launch and currently selling for $799). The DPT-S1 is based on E Ink’s Mobius display, a 13.3” thin film transistor (TFT) platform that is flexible and can accept handwriting from a stylus.

Since it does not have any glass, the new Sony device weighs 12.6 oz or about half of a similar LCD-based tablet. With the addition of stylus-based handwriting capability, the device functions like an electronic notepad and, meanwhile, notes can be written in the margins of e-books and other electronic documents.

These advancements and others show that e-paper is positioned for a renewed surge into things that have yet to be conceived. Once a flat surface can be curved or even folded and then made to transform itself into any image—including a color image—at any time and at very low cost and very low energy consumption, then many things are possible like e-wall paper, e-wrapping paper, e-milk cartons and e-price tags. The possibilities are enormous.

Streaming and the era of on-demand media

On January 6, Netflix went live with its video-streaming service in 130 new countries across the globe. The expansion—covering most of the world except for China—was announced by Netflix cofounder and CEO Reed Hastings during a keynote speech at the International Consumer Electronics Show in Las Vegas. Hastings said, “Today, right now, you are witnessing the birth of a global TV network.”

Reed Hastings, CEO of Netflix announcing the global expansion of the streaming video service on January 6
Reed Hastings, CEO of Netflix announcing the global expansion of the streaming video service on January 6

Prior to this latest announcement, Netflix had 40 million subscribers in the US and 20 million subscribers internationally in a total of 60 countries and available in 17 languages. According to Hastings, the company’s goal is to reach 200 countries by the end of 2016 and sign up 90 million US and 450 million worldwide subscribers.

The rapid expansion of Netflix is part of the transformation of TV program and movie viewing that has been underway for a decade or more. While “linear TV”— programming that is presented at specific times and on non-portable screens—is still popular, it is being rapidly overtaken by the new personalized, on-demand and mobile subscription services like Netflix.

According to Netflix, the growth of Internet TV is driven by (1) advancements in Internet reliability and performance, (2) time and place flexibility of on-demand viewing and (3) accelerating innovation of streaming video technology. A possible fourth driver of Netflix’s success is its subscription-based user model. Unlike previous on-demand solutions that often required consumers to purchase one at a time—or rent for a specified period of time—their own copies of movies and music, streaming media solutions like Netflix offer subscribers access to the entire content library without limitations for a monthly fee.

Streaming media

Popular video and music streaming services
Popular video and music streaming services

Streaming media refers to video or audio content that is transmitted in a compressed digital form over the Internet and played immediately, rather than being downloaded onto a computer hard drive or other storage media for later playback. Therefore, users do not need to wait for the entire media file to be sent before playing it; the media file is delivered in a continuous stream and can be watched or listened to as soon as the playing process is able to begin.

Media streaming originated with “elevator music” known as Muzak in the early 1950s. It was a service that transmitted music over electrical lines in retail stores and building lobbies. The first efforts to stream music and video on computers and digital networks ran up against the limitations of CPU performance, network bandwidth and data stream interruptions associated with “buffering.”

Attempts in the 1990s by Microsoft (Windows Media Player), Apple (QuickTime) and RealNetworks (RealPlayer) to develop streaming technologies on desktop computers made important breakthroughs. However, each of these solutions required proprietary file formats and media players that resulted in an unworkable system for users.

By the early 2000s, the adoption of broadband internet and improvements in CPU and data throughput along with efforts to create a single, unified format led to the adoption of Adobe Flash as a de facto standard for streaming media. By 2005, when the social media and video sharing service YouTube was established, Flash became the dominant streaming technology on the Internet. More recently—especially since 2011—HTML5 has advanced as an international standard on computers and mobile devices and it will eventually supplant Flash.

Music industry streaming revenue is growing fast and download revenue is falling
Music industry streaming revenue is growing fast and download revenue is falling

Streaming media has been transforming the music industry along side of TV and movies. While digital downloads still represent the largest percentage of music sales in the US, they are falling. Meanwhile, streaming music services like Pandora, Spotify and Apple Music have already overtaken physical CD sales and represent about one third of the industry’s income. Some analysts expect revenue from music streaming to surpass that of digital downloads in the near future.

Consumers and content

Streaming media has fundamentally shifted the relationship between consumers and entertainment content. During the era of broadcast radio (1920s) and television (1950s), consumers needed a “set” to receive the analog programs of radio stations and TV channels. Meanwhile, audience members had to be on front of their radio or TV—with “rabbit ears” antenna adjusted optimally—on a schedule set by the broadcasters. The cost of programming was paid for by commercial advertising and corporate sponsors.

In the cable and satellite era (1970s), consumers began paying for content with subscription fees and programming was “commercial free.” Along with home recording devices—at first analog magnetic tape systems like VCRs (1970s) and digital recording devices like DVRs (late 1990s)—came an important shift in viewing behavior. Consumers could do what is now called “time shifted viewing,” i.e. they could choose when they wanted to experience the recorded content. 

Vinyl records, magnetic tapes and optical recording formats preceded downloading and streaming
Vinyl records, magnetic tapes and optical recording formats preceded downloading and streaming

At first, music publishers mass produced and marketed analog audio recordings—records (1950s) and then audio tapes (1970s)—and consumers purchased and owned a library of recordings. These records and tapes could be enjoyed at any time and place as long as there was an audio system with a stereo turntable or cassette player available.

The same was true of mass produced CD audio (1980s) and DVD video (2000s) optical discs. While these digital formats improved portability and their quality did not deteriorate from repeated play—the way that analog magnetic and vinyl did—they required a new generation of optical devices. Portable CD (1980s) and DVD players (late 1990s) addressed this issue, but consumers still had to maintain a library of purchased titles.

With digital downloading of music and video over the Internet, content could finally be played anywhere and at anytime on portable digital players like iPods (2001) and notebook PCs. However, consumers were still required to purchase the titles they wanted to enjoy. Instead of owning bookshelves and cabinets full of CD and DVD jewel cases, downloaded electronic files had to be maintained on MP3 players, computer hard drives and digital media servers.

When Internet-based media streaming arrived alongside of mobile and wireless computing the real potential of time and place independent content viewing became a reality. Add to these the subscription model—with (potentially) the entire back catalog of recorded music, TV shows and movies available for a relatively small monthly fee—and consumers began flocking in large numbers to services like Netflix and Spotify.

Streaming media trends to watch 2016

Media industry analysts have been following the impact of these streaming content and technologies and some of their recent insights and trend analyses are below:

Streaming media device adoption in US households
Streaming media device adoption in US households with broadband Internet
  • Streaming devices:
    • Linear TV content still dominates US households. However, there are signs that streaming media devices such as Roku, Apple TV, Chromecast and Amazon Fire are rapidly shifting things. The adoption of these devices went from about 17% in 2014 to about 28% of US households with broadband internet in 2015 [Park Associates]
Nielsen on demand music streams
On-demand music streaming includes music videos
  • Streaming vs. downloading:
    • Online music streams doubled from 164.5 billion to 317 billions songs
    • Digital song sales dropped 12.5% from 1.1 billion to 964.8 million downloads
    • Digital album sales dropped 2.9% from 106.5 million to 103.3 million downloads [Nielsen 2015 Music Report]
Cable TV subscriptions have been declining with the rise of "cord cutting" and streaming media
Cable TV subscriptions have been declining with the rise of “cord cutting” and streaming media
  • Cable TV:
    • The cord-cutting trend—households that are ending their cable TV service—is accelerating. Total households with cable subscriptions fell from 83% in 2014 to under 80% in 2015 [Pacific Crest].
    • Scheduled “linear” TV fell and recorded “linear” TV was flat (or even increased slightly) from 2014 to 2015, while streamed on-demand video increased [Ericsson ConsumerLab].

While streaming audio and video are growing rapidly, traditional radio and TV still represent by far the largest percentages of consumer activity. Obviously, some of the cultural and behavior changes involved in streaming media run up against audience demographics: some older consumers are less likely to shift their habits while some younger consumers have had fewer or no “linear” experiences.

As the Ericsson ConsumerLab study shows, teenagers spend less than 20% of their TV viewing time watching a TV screen; the other 80% is spent in front of desktop and laptop computers, tablets and smartphones. Despite these differences, streaming content use is soaring and the era of “linear” media is rapidly coming to an end. Just like the relationship between eBooks and print books, the electronic alternative is expanding rapidly while the analog form persists and, in some ways, is stronger than ever. Nonetheless, the new era of time and place independent on-demand media is fast approaching.

Where is VR going and why you should follow it

Promotional image for Oculus Rift VR headset
Promotional image for Oculus Rift VR headset

On November 2, video game maker Activision Blizzard Entertainment announced a $5.9 billion purchase of King Digital Entertainment, maker of the mobile app game Candy Crush Saga. Activision Blizzard owns popular titles like Call of Duty, World of Warcraft and Guitar Hero—with tens of millions sold—for play on game consoles and PCs. By comparison, King has more than 500 million worldwide users playing Candy Crush on TVs, computers and (mostly) mobile devices.

While it is not the largest-ever acquisition of a game company—Activision bought Blizzard in 2008 for $19 billion—the purchase shows how much the traditional gaming industry believes that future success will be tied to mobile and social media. Other recent acquisitions indicate how the latest in gaming hardware and software have become strategically important for the largest tech companies:

Major acquisitions of gaming companies by Microsoft, Amazon and Facebook took place in 2014
Major acquisitions of gaming companies by Microsoft, Amazon and Facebook took place in 2014
  • September 2014: Microsoft acquired Mojang for $2.5 billion
    Mojang’s Minecraft game has 10 million users worldwide and an active developer community. The Lego-like Minecraft is popular on both Microsoft’s Xbox game console and Windows desktop and notebook PCs. In making the purchase, Microsoft CEO Satya Nadella said, “Gaming is a top activity spanning devices, from PCs and consoles to tablets and mobile, with billions of hours spent each year.”
  • August 2104: Amazon acquired Twitch for $970 million
    The massive online retailer has offered online video since 2006 and the purchase of Twitch—the online and live streaming game service—adds 45 million users to Amazon’s millions of Prime Video subscribers and FireTV (stick and set top box) owners. Amazon’s CEO Jeff Bezos said of the acquisition, “Broadcasting and watching gameplay is a global phenomenon and Twitch has built a platform that brings together tens of millions of people who watch billions of minutes of games each month.”
  • March 2014: Facebook acquired Oculus for $2 billion
    Facebook users take up approximately 20% of all the time that people spend online each day. The Facebook acquisition of Oculus—maker of virtual reality headsets—is an anticipation that social media will soon soon include an immersive experience as opposed to scrolling through rectangular displays on PCs and mobile devices. According to Facebook CEO Mark Zuckerberg, “Mobile is the platform of today, and now we’re also getting ready for the platforms of tomorrow. Oculus has the chance to create the most social platform ever, and change the way we work, play and communicate.”

The integration of gaming companies into the world’s largest software, e-commerce and social media corporations is further proof that media and technology convergence is a powerful force drawing many different industries together. As is clear from the three CEO quotes above, a race is on to see which company can offer a mix of products and services sufficient to dominate the number of hours per day the public spends consuming information, news and entertainment on their devices.

What is VR?

Among the most important current trends is the rapid growth and widespread adoption of virtual reality (VR). Formerly of interest to hobbyists and gaming enthusiasts, VR technologies are now moving into mainstream daily use.

A short definition of VR is a computer-simulated artificial world. More broadly, VR is an immersive multisensory, multimedia experience that duplicates the real world and enables users to interact with the virtual environment and with each other. In the most comprehensive VR environments, the sight, sound, touch and smell of the real world are replicated.

Current and most commonly used VR technologies include a stereoscopic headset—which tracks the movement of a viewer’s head in 3 dimensions—and surround sound headphones that add a spatial audio experience. Other technologies such as wired gloves and omnidirectional treadmills can provide tactile and force feedback that enhance the recreation of the virtual environment.

New York Times VR promtion
The New York Times’ VR promotion included a Google Cardboard viewer that was sent along with the printed newspaper to 1 million subscribers

Recent events have demonstrated that VR use is becoming more practical and accessible to the general public:

  • On October 13, in a partnership between CNN and NextVR, the presidential debate was broadcast in VR as a live stream and stored for later on demand viewing. The CNN experience made it possible for every viewer to watch the event as though they were present, including the ability to see other people in attendance and observe elements of the debate that were not visible to the TV audience. NextVR and the NBA also employed the same technology to broadcast the October 27 season opener between the Golden State Warriors and New Orleans Pelicans, the first-ever live VR sporting event.
  • On November 5, The New York Times launched a VR news initiative that included the free distribution of Google Cardboard viewers—a folded up cardboard VR headset that holds a smartphone—to 1 million newspaper subscribers. The Times’ innovation required users to download the NYTvr app to their smartphone in order to watch a series of short news films in VR.

Origins of VR

Virtual reality is the product of the convergence of theater, camera, television, science fiction and digital media technologies. The basic ideas of virtual reality go back more than two hundred years and coincide with the desire of artists, performers and educators to recreate scenes and historical events. In the early days this meant painting panoramic views, constructing dioramas and staging theatrical productions where viewers had a 360˚ visual surround experience.

In the late 19th century, hundreds of cycloramas were built—many of them depicting major battles of the Civil War—where viewers sat in the center of a circular theater as the timeline of the historical event moved and was recreated around them in sequence. In 1899, a Broadway dramatization of the novel Ben Hur employed live horses galloping straight toward the audience on treadmills as a backdrop revolved in the opposite direction creating the illusion of high speed. Dust clouds were employed to provide additional sensory elements.

Kromscop viewer invented by Frederic Eugene Ives at the beginning of the 20th century
Frederic Eugene Ives’ Kromscop viewer

Contemporary ideas about virtual reality are associated with 3-D photography and motion pictures of the early twentieth century. Experimentation with color stereoscopic photography began in the late 1800s and the first widely distributed 3-D images were of the 1906 San Francisco earthquake and taken by Frederic Eugene Ives. As with present day VR, Ives’ images required both a special camera and viewing device called the Kromskop in order to see 3-D effect.

1950s-era 3-D View-Master with reels
1950s-era 3-D View-Master with reels

3-D photography was expanded and won popular acceptance beginning in the late 1930s with the launch of the View-Master of Edwin Eugene Mayer. The virtual experience of the View-Master system was enhanced with the addition of sound in 1970. Mayer’s company was eventually purchased by toy maker Mattel and later by Fischer-Price and the product remained successful until the era of digital photography in the early 2000s.

An illustration of the Teleview system that mounted a viewer containing a rotation mechanism in the armrest of theater seats
An illustration of the Teleview system that mounted a viewer containing a rotation mechanism in the armrest of theater seats

Experiments with stereoscopic motion pictures were conducted in the late 1800s. The first practical application of a 3-D movie took place in 1922 using the Teleview system of Laurens Hammond (inventor of the Hammond Organ) with a rotating shutter viewing device attached to the armrest of the theater seats.

Prefiguring the present-day inexpensive VR headset, the so-called “golden era” of 3-D film began in the 1950s and included cardboard 3-D glasses. Moviegoers got their first introduction to 3-D with stereophonic sound in 1953 with the film House of Wax starring Vincent Price. The popular enthusiasm for 3-D was eventually overtaken by the practical difficulties associated with the need to project two separate film reels in perfect synchronization.

1950s 3-D glasses and a movie audience wearing them
1950s 3-D glasses and a movie audience wearing them

Subsequent waves of 3-D movies in the second half of the twentieth century—projected from a single film strip—were eventually displaced by the digital film and audio methods associated with the larger formats and Dolby Digital sound of Imax, Imax Dome, Omnimax and Imax 3D. Anyone who has experienced the latest in 3-D animated movies such as Avatar (2009) can attest to the mesmerizing impact of the immersive experience made possible by the latest in these movie theater techniques.

Computers and VR

Recent photo of Ivan Sutherland; he invented the first head-mounted display at MIT in 1966
Recent photo of Ivan Sutherland; he invented the first head-mounted display at MIT in 1966

It is widely acknowledged that the theoretical possibility of creating virtual experiences that “convince” all the senses of their “reality” began with the work of Ivan Sutherland at MIT in the 1960s. Sutherland invented in 1966 the first head-mounted display—nicknamed the “Sword of Damocles”—that was designed to immerse the viewer in a simulated 3-D environment. In a 1965 essay called “The Ultimate Display,” Sutherland wrote about how computers have the ability to construct a “mathematical wonderland” that “should serve as many senses as possible.”

With increases in the performance and memory capacity of computers along with the decrease in the size of microprocessors and display technologies, Sutherland’s vision began to take hold in the 1980s and 1990s. Advances in vector based CGI software, especially flight simulators created by government researchers for military aircraft and space exploration, brought the term “reality engine” into use. These systems, in turn, spawned notions of complete immersion in “cyberspace” where sight, sound and touch are dominated by computer system generated sensations.

The term “virtual reality” was popularized during these years by Jaron Lanier and his VPL Laboratory. With VR products such as the Data Glove, the Eye Phone and Audio Sphere, Lanier combined with game makers at Mattel to create the first virtual experiences with affordable consumer products, despite their still limited functionality.

By the end of the first decade of the new millennium, many of the core technologies of present-day VR systems were developed enough to make simulated experiences more convincing and easy to use. Computer animation technologies employed by Hollywood and video game companies pushed the creation of 3-D virtual worlds to new levels of “realness.”

An offshoot of VR, called augmented reality (AR), took advantage of high resolution camera technologies and allowed virtual objects to appear within the actual environment and enabled users to view and interact with them on computer desktop and mobile displays. AR solutions became popular with advertisers offering unique promotional opportunities that capitalized on the ubiquity of smartphones and tablets.

Expectations

Scene from the 2009 movie Avatar
A scene from the 2009 animated film “Avatar”

Aside from news, entertainment and advertising, there are big possibilities opening up for VR in many business disciplines. Some experts expect that VR will impact almost every industry in a manner similar to that of PCs and mobile devices. Entrepreneurs and investors are creating VR companies with the aim of exploiting the promise of the new technology in education, health care, real estate, transportation, tourism, engineering, architecture and corporate communications (to name just a few).

Like consumer-level artificial intelligence, i.e. Apple Siri and Amazon Echo, present-day virtual reality technologies tend to fall frustratingly short of expectations. However, with the rapid evolution of core technologies—processors, software, video displays, sound, miniaturization and haptic feedback systems—it is conceivable that VR is ripe for a significant leap in the near future.

In many ways, VR is the ultimate product of media convergence as it is the intersection of multiple and seemingly unrelated paths of scientific development. As pointed out by Howard Rheingold in his authoritative 1991 book Virtual Reality, “The convergent nature of VR technology is one reason why it has the potential to develop very quickly from a scientific oddity into a new way of life … there is a significant chance that the deep cultural changes suggested here could happen faster than anyone has predicted.”