Webopedia on Google+Webopedia on TwitterWebopedia on FacebookTech Bytes Blog
Main » Blog »

It's Happening Now: Perceptual Computing is Real

RealSense SupportIt is no longer just a matter of simply using touch, voice, and keyboards to provide your computer with information. Going forward, how you interact with your computer is going to change. More importantly, your computer will be able to perceive what is happening around it and take that into consideration as well.

Perceptual computing is not new. It has been in the mainstream consumer market for half a decade, thanks to Microsoft and the Microsoft Kinect. Perceptual computing, however, is not just a toy for gaming consoles; it is quickly about to become a part of computing systems across the ecosystem.

What is Perceptual Computing?

In simple terms, perceptual computing is the ability for a computer to recognize what is going on around it. More specifically, the computer can perceive the environment and the users in that environment. The computer then can determine what needs a user might have, as well as react to those needs without giving or receiving any additional information.

As mentioned, Microsoft released the Kinect with the Xbox One. This brought the basic concepts of perceptual computing to the forefront. Soon after it released the Kinect for Xbox, it then released a Windows version for desktop and notebook computers. The adoption of this device in the industry was minimal relative to the number of Kinects used with gaming consoles.

Other devices that allow for some portions of perceptual computing to be sensed are also available. This includes the LeapMotion device. Leap Motion, however, is more limited to gestures versus the full spectrum of sights and sounds.

Intel's RealSense Device

The entry that will disrupt the market the most, however, is coming from Intel. This is Intel's RealSense device. RealSense offers a depth sensor and cameras that provide a 3D vision and immersive experience. It can do facial analysis, hand and finger tracking, and speech recognition. It also can be used for augmented reality, including the removal of backgrounds. The device has the capability to track 10 fingers simultaneously as well as do gesture recognition. For facial tracking, multiple people can be tracked at once. The software has the capability of identify features such as eyes, mouth, and nose.

What does all of this "percepting" allow your computer to do? With the help of developers using the SDK, and a system like RealSense, computers will be able to gain insights from users that can then be applied to applications being run. A few examples can help illustrate this.

Passwords are no longer needed. When your computer is able to recognize you, there is no need for a password. You are your password. With perceptual computing, this is.

Measuring is simple. With perceptual computing, the computing system can determine depth. This in turn allows distances to be calculated. By applying this technology to devices such as cameras and phones, you’ll be able to point at something and determine distances.

In addition to measuring distance, gestures and other movements can be tracked. For example, with the Microsoft Kinect, they can track movements of a person’s chest. This will allow for things such as heart and breathing rates to be determined.

Checking a person's emotions is possible. By analyzing facial expression, the computer can guess at a how a person is feeling. In fact, with Intel’s RealSense tools for developers, they include a set of routines that allows the developer to tap into this data and then apply it to their applications. If an application can now tell that a person is getting angry, it then would be possible to adjust what is happening to try to rectify the situation. For example, the application could offer to launch the help system.

perceptual computing devices

Nearly all of the capabilities of perceptual computing devices are open to developers to build into applications.

How Real is Perceptual Computing?

How real is all of this? As mentioned, the Microsoft Kinect and LeapMotion devices have been around for a while. It is worth noting, however, that the Intel RealSense technology is also available. In fact, you can find it on a number of devices, including:

  • Asus N441 JQ – A 15” Ultrabook
  • Asus Rog G5771 JM – A 17” gaming laptop
  • Asus X751LD – A 17” everyday notebook
  • HP Envy 15t Touch RealSense – A full-featured laptop
  • Dell Inspiron 15 5548 – a lightweight, slim laptop
  • Acer Aspire V 17 Nitro – A 17” high-performance notebook
  • Lenovo ThinkPad Yoga 15 – A thin, lightweight convertible
  • Lenovo ThinkPad E550 – a thin, full-featured notebook
  • Lenovo B5030 – An all-in-one with a 23.8” touch display
  • Dell Inspiron 23” 7000 – An all-in one with a 23” thin touch screen
  • HP Sprout – A “creativity station”

These are just some of the devices that support RealSense today. As you can see, with major players like HP, Asus, Dell, Acer, and Lenovo supporting the technology, is just a matter of time before the perceptual computing hardware becomes standard in the same way a video camera is standard in most new computing devices today.

Your computer will soon perceive you. When it does, you'll want to be nicer to your computer because it will know when you are mad...

Bradley L. Jones
Bradley L. Jones is the Director and Editor in Chief of the Developer.com Network of sites, which includes Developer.com, Codeguru, DevX, and HTMLGoodies. He is an internationally bestselling author who has written more than 20 developer-related books across a variety of topics ranging from C++ to Windows and from C# to Web 2.0

susanrey said on October 21, 2015 22:53 PM PDT

I think this is very cool. and I want to know if there is anyone doing this experiment? this is totally automatic. and the perceive from the computer is correct?

singhmonika said on August 21, 2015 22:20 PM PDT

I really appreciate computing blog.

Star Link India said on July 08, 2015 00:04 AM PDT

We find checking the user's emotions the most intriguing of them all. Maybe, based upon the facial expression, the computer can also figure if the person is feeling unwell? And a medical app can get launched?

Dr.Sanjay Shelar said on May 16, 2015 01:39 AM PDT

Is there any laptop model with inbuilt projector and real sense device?. I am impressed with the technology.

Brad Jones said on May 14, 2015 18:13 PM PDT

Did you see Microsoft's "Hello Windows"? This is the use of cameras like Intel's RealSense to recognize the person sitting in front of the computer and automatically log them into Windows 10. This replaces the password, finger print scanner, or other passwords used in previous versions of Windows for logging in those that have perceptual computing equipment.

John Jones said on May 12, 2015 02:29 AM PDT

Dank memes, Brad! -Tony

Paul said on May 06, 2015 05:29 AM PDT

Great article, Brad! - Paul

Make a comment

    (Maximum characters: 1200). You have characters left.


    8 Agenda Apps to Help Students Stay Organized

    Webopedia's student apps roundup will help you to better organize your class schedule and stay on top of assignments and homework. Read More »

    List of Free Shorten URL Services

    A URL shortener is a way to make a long Web address shorter. Try this list of free services. Read More »

    Top 10 Tech Terms of 2015

    The most popular Webopedia definitions of 2015. Read More »

    Java Basics, Part 1

    Java is a high-level programming language. This guide describes the basics of Java, providing an overview of syntax, variables, data types and... Read More »

    Java Basics, Part 2

    This second Study Guide describes the basics of Java, providing an overview of operators, modifiers and control Structures. Read More »

    The 7 Layers of the OSI Model

    The Open System Interconnection (OSI) model defines a networking framework to implement protocols in seven layers. Use this handy guide to compare... Read More »