A version of this article was originally published on Medium by Michael Thompson.
Neurable’s BCI headset for HTC Vive®
Today Neurable is offering a first look at a product that is without precedent in modern tech: a brain-computer interface for virtual reality. Our integrated platform is built for one purpose: to enable developers to create brain-controlled content for virtual reality.
Imagine the power of your mind in VR. You awake hanging upside down in a snowy cave to discover you’ve been captured by a hungry Wampa. Sighting your light saber laying just out of reach, you calm yourself, concentrate, and summon the power of the force to grab your weapon. You cut yourself free just in time to slay the fearsome predator.
This dramatic close encounter is, of course, a famous scene from Star Wars. Popular fiction has explored themes like magic, telekinesis, and other super-human powers for as long as we can remember. As a society, we’re fascinated by fantasy: our imagination yearns to explore the impossible, the forbidden, the otherworldly.
The advent of immersive computing promises to bring those fantasies closer to sensory reality than we’ve ever known. Virtual and augmented reality are redrawing the boundaries of human experience. Both mediums force us to rethink how users should experience and interact with the digital world. The old rules of point-and-click no longer apply. Immersive computing demands a new approach to human-computer interaction.
The Ultimate Platform
We foresee an ecosystem of control inputs that will combine to make AR/VR environments incredibly responsive and adaptive to user behavior. Great strides have already been made with motion capture, haptics, eye-tracking, and natural language processing. What has been missing is a serious effort to link mixed reality to the ultimate computing platform — the human brain.
Neurable develops brain-computer interfaces (BCIs) for next-generation computing platforms. Our revolutionary technology allows people to interact with AR/VR environments using only their brain activity.
The benefits of a BCI in mixed reality are many and unique. BCIs analyze patterns of brain activity to determine user intent. This tech is already capable of typing on virtual keyboards and controlling prosthetic limbs, entirely from brain activity. Such intent-driven interactions hold tremendous promise for mixed reality environments, where current problems with user interaction constitute a significant barrier to more widespread adoption.
The best solution is a brain-computer interface that allows users to scroll menus, select items, launch applications, manipulate objects, and even input text using only their brain activity. Imagine the productivity revolution that a high-performance, non-invasive, intuitive BCI would unleash in mixed reality.
Combining Neurotech with VR
An illustration of Neurable’s BCI in VR
This weekend, Neurable is debuting Awakening, a VR game preview made in partnership with eStudiofuture, at SIGGRAPH 2017 in Los Angeles. Awakening is a futuristic story reminiscent of Stranger Things: you are a child held prisoner in a government science laboratory. You discover that experiments have endowed you with telekinetic powers. You must use those powers to escape your cell, defeat the robotic prison guards, and free yourself from the lab. The game allows you to manipulate objects and battle foes with your mind, and is played entirely without handheld controllers.
This incredible experience is made possible by Neurable’s machine learning platform, which interprets your brain activity in real time to afford virtual powers of telekinesis. Our complex machine learning pipeline has been distilled into an SDK compatible with Unity®. With the Neurable SDK, Unity developers can easily integrate brain-activity as a control input into any game.
Brain signal acquisition is accomplished through our upgraded headband for the HTC Vive. Simply remove the elastic straps in the back and replace them with our straps. Our solution is a demonstration prototype of how brain sensors and neurotechnology can be integrated with AR/VR devices.
Future Applications
Gaming is an exciting forum for experimenting with new technology, but the applications for BCIs extend far beyond entertainment. As AR/VR devices move from early adopters to broader use cases in health, education, industry and more, interfaces will evolve to support more complex tasks.
In the long run, we expect that AR/VR headset companies will integrate brain sensors directly into their products. They will do this because BCI systems radically empower users in mixed reality. Recent announcements and other publicly-available information confirm that major tech companies are actively developing BCI technology for commercial applications. What the touch interface became to smart phones, BCIs will become to mixed reality headsets.
How do I Build With Neurable?
We are working with content creators and location-based VR companies to bring our technology to consumers. We welcome additional partners. If you are interested in creating an experience with Neurable, please visit our Developer page at neurable.com/developers.
Disclaimer: We actively write about the themes in which we invest: artificial intelligence, robotics, virtual reality, and augmented reality. From time to time, we will write about companies that are in our portfolio. Content on this site including opinions on specific themes in technology, market estimates, and estimates and commentary regarding publicly traded or private companies is not intended for use in making investment decisions. We hold no obligation to update any of our projections. We express no warranties about any estimates or opinions we make.