This year, Lenovo's ThinkPad E550 has two special upgrade points. The first is that the latest Win10 is pre installed at the factory; The other is RealSense 3D reality technology in the high configuration version. RealSense 3D reality technology endows computing devices with "eyes" and "brain", which can recognize and analyze users' facial and body language. In this way, we can complete the cool body feeling control, face brushing and boot up like Iron Man and other sci-fi movies.
This time, Lenovo integrated it into the camera of the notebook, greatly reducing the threshold for users to try new things. Compared with Kinect, which needs to purchase hardware independently, it is much more practical and friendly. Now let's experience this black technology together.
What is the implementation principle?
First, let's popularize what RealSense 3D is. RealSense 3D is Intel's first demonstration of realism technology at last year's IDF conference. This set of perceptual computing solutions requires the cooperation of both hardware and software.
The hardware part is the world's smallest 3D camera, which consists of a depth sensor and a full 1080p color lens, while the software part is a full set of development tools such as drivers and software provided by Intel. Together, they can complete real-time recognition of foreground and background, gesture movements, facial features, and even enable devices to understand human actions and emotions.
According to the direction of the camera, Intel's RealSense 3D camera can be divided into two types: one is the front 3D camera used for close range and high-precision, and the other is the rear 3D camera used for a longer distance.
The latter first appeared on the flat panel using Intel chips. Its active stereo imaging uses the parallax principle similar to the human eye, uses the left and right infrared sensors to track the beam position emitted by the infrared transmitter, and uses the triangle positioning principle to calculate the depth information in the 3D image, so that it can complete the functions of physical measurement, taking pictures first and focusing later.
The former is the type we want to experience today. Its principle is similar to Microsoft's Kinect: the "structured light" infrared ray projected by the transmitter is collected by the camera after being reflected by the object surface. According to the changes in the optical signal caused by the object, the position and depth of the object can be calculated, and then the entire three-dimensional space can be restored.
The use scenarios of RealSense 3D camera include: gesture control, 3D scanning, physical measurement, taking pictures before focusing, real-time image processing, etc. The device used for today's experience is the 15 inch high configuration Lenovo ThinkPad E550.
Where can I find the application?
The machine comes with RealSense 3D related drivers. Just download the applications that support RealSense 3D in Intel's RealSense Application Exhibition Center.
The official website classifies applications according to "games, video conferences, music, 3D scanning and printing, education, lifestyle", etc. Here we select some interesting ones to experience.
The main part of Intel's official SDK is the runtime for face and gesture tracking. For some games that require advanced support, installation and upgrade prompts will pop up during installation.
The runtime even includes SDKs for voice recognition, scene perception, facial expressions, 3D, and point and block detection. Users who like the sense of technology are expected to choose all the names even if they just look at them.
Make the game more interesting - gesture control
Here, I will take the shooting game named Space Astro Blaster, which I am deeply impressed with, as an example to experience. After opening the game, we can find that the front camera of the computer will light up the work light.
The game start interface is not different from the regular game, but when we raise our hands in front of the screen, we will find that the selection cursor will automatically follow the position of the hand. Move the cursor to stop on the target option, and the cursor will have a countdown prompt for loading. If you stay on the target for 2-3 seconds, you will automatically enter the option, so you can avoid clicking.
In the game, the fighter will follow the position of the palm, and the user can carry out full 3D full screen movement from front to back, left to right.
Bombing and other tasks can be completed through gestures: the fingers can be closed to fire bullets, and the V sign can be used to fire missiles that are sure to kill in one blow.
After entering the meteorite area, because there is only left and right operation, a special "head control" mode is also designed here, so you can control the aircraft to avoid flying "meteorites" by swinging your head left and right.
Another game that the author prefers is Warrior Wave, a leisure and loving game.
The goal of the game is to make the soldiers arrive at the destination smoothly, and the road is the projection of the user's hands. In this game, the 3D control is not a point, but a real image of the user's hands.
In the game, the hand image follows the optical principle of near large and far small. Users can pose strange gestures to form a constantly changing "road", so that their soldiers can successfully reach the target location.
Even users can recognize their faces, that is, they can play the game by using the nail hammer posture, while RealSense 3D can even accurately identify users' ears, eyes and hair styles, which is really not satisfactory
The most unexpected thing for the author is that Tencent has just launched the online game Xuanyuan Legend II. Because of its cooperation with Intel and Lenovo, it has natively supported RealSense 3D. Users in the game can use their hands to complete the role movement, perspective transformation, and moves, and experience the same cool.
In addition, there are some small games, such as bee guard, drum and other games. The drum rack is one of the few games that can support both hands recognition at the same time, so it will be more immersive to play.
Make the experience more upgraded - face brushing and power on
When we thought that somatosensory operations were still in the lab or customized games, Intel's RealSense had begun to integrate daily applications.
Windows Hello facial recognition security access function has been added to Windows10. This function requires the laptop hardware to provide compatibility. ThinkPad E550 is the first product to officially support this function. The machine can directly enable this function without any settings. For the first time, you need to enter personal portrait information, which lasts about 5 or 6 seconds.
When the machine is standby or powered on, Windows Hello will automatically call the RealSense camera for face recognition. The recognition speed can even catch up with fingerprint recognition. Even in the environment with poor backlight or light, the unlocking time is only about 1-2 seconds. It is difficult to detect its existence when it is turned on normally. Its practicability is much higher than that of face recognition on Android.
Black technology can also be very friendly
As one of the leading PC manufacturers, Lenovo combines the advanced Intel RealSense 3D technology with the classic ThinkPad products, bringing the "black technology" that brings innovative experience to more consumers.
Although the current RealSense technology has a slight defect in target occlusion - the user's hands need to be within the range of wide-angle lens and spatial structure light to be correctly recognized, the distance is about 30-50cm, and the place where the lens light cannot shine becomes a blind area.
However, these are not big problems at the civilian level, and RealSense 3D body sense is made. In shooting, full space perspective type applications and games, it has intuitive and space depth operating advantages. The use experience is more intuitive and easy to use than the original mouse, which has to make people look forward to its popularity.
