On October 10, the 2024 vivo developer conference was held in Shenzhen International Convention and Exhibition Center with the theme of "One Heart, One Peer". At the meeting, vivo officially released a new AI strategy - "Blueheart Intelligence", which brought a fully upgraded self-developed Blueheart big model matrix, original system 5 (OriginOS 5), Blue River operating system 2 (BlueOS 2), and vivo's latest achievements in security, cultural and ecological cooperation.
Shi Yujian, senior vice president and chief technology officer of Vivo, took the stage first and reviewed the achievements of Vivo in the past. He mentioned that in the past three years and the first three quarters of this year, vivo has always ranked first in the sales of domestic mobile phones. Not long ago, Vivo also landed on the list of the top 100 most valuable Chinese brands of Kaidu BrandZ. Because of its steady performance in the consumer electronics track, Vivo also won the Kaidu BrandZ Innovation Star Brand Award.
Shi Yujian, Senior Vice President and Chief Technology Officer of vivo, made a speech on the spot
Last year, vivo launched its own technology brand, Blue Technology. Blue Technology is a technology R&D system built by Vivo based on user needs, from application innovation to bottom level technology innovation, from hardware driven to software hardware integration capability. It includes "Blueprint Image", "Blue Ocean Endurance System", "Blue Chip Technology Stack", and the newly upgraded "Blue Core Model" and "Blue River Operating System".
Shi Yujian, Senior Vice President and Chief Technology Officer of vivo, made a speech on the spot
Shi Yujian expressed that, With the arrival of the AI era, vivo will always keep an open mind. Whether in mobile phone hardware, AI big model, operating system, or in the field of Internet and IoT, vivo will adhere to user oriented scientific and technological innovation, constantly explore the boundaries of science and technology, work together with users and developers, share the fruits of cooperation and development, build a win-win ecosystem of mutual trust, and create a bright future of science and technology.
Vivo Releases a New AI Strategy - Blueheart Intelligence
At last year's developer conference, vivo released a Blueheart big model matrix composed of five language big models with three self-developed parameter levels of 1 billion, 10 billion and 100 billion. In addition, it took the lead in the industry to run through the big end models of 1B, 7B and 13B, and launched the Blue Center Small V and Blue Center Qianxun APP based on the Blue Center big model. In November last year, the Blueheart model ranked first in terms of comprehensive ability in the list of SuperCLUE, CMMLU, C-EVAL and other major models. Vivo's positioning for the Blueheart big model is to make the Blueheart big model the best model for Chinese people by enriching the supply of Chinese data and knowledge. As of today, vivo's AI capability has covered more than 60 countries and regions around the world, serving more than 500 million mobile phone users, and the output of large model tokens has exceeded 3 trillion.
At this conference, Vivo's new AI strategy, Blueheart Intelligence, was officially released around the vice president of Vivo, vice president of OS products, and president of Vivo AI Global Research Institute.
Vivo Vice President, OS Product Vice President, Vivo AI Global Research Institute President
Blueheart Intelligence is a personal intelligence that deeply integrates big model technology with mobile phone operating system. It is explained that, based on the big model of Blueheart, Blueheart Intelligence can understand users' personal situations and preferences and provide users with personalized and exclusive services; At the same time, Blueheart Intelligence will protect users' privacy and security in an all-round way; Through the deep integration of the system, users can continue to build more natural and intuitive interactions, bringing a more intelligent and warm experience.
To achieve this, vivo restructured the system experience with AI from three aspects. The first is to reconstruct the interactive experience between people and devices to make the interaction more natural and intuitive. With the help of the Blueheart model, the mobile phone will have a stronger analytical ability. Whether it is the strength of pressing the screen, circling text or pictures, or dragging a piece of address information, the multimodal model can deeply interpret your intention, and then give you the feedback and services you need. On the other hand, depending on the text model, combined with self-monitoring learning voice codec, multi voice task learning, modal alignment and other technologies, Blueheart V will further have a strong ability to understand and generate voice representations in addition to its text capabilities, so that mobile phones can talk to people naturally, translate languages, simulate voice and even understand emotions in dialogue.
The second aspect is to reconstruct the service experience of people and the digital world to make intelligence more personalized, that is, to build simple and efficient service acquisition and active service capabilities, so that mobile phones can become smart and warm personal assistants. Vivo has comprehensively upgraded the basic functions of mobile phones based on the big model of Blueheart. At the same time, vivo has built a framework and platform for third-party developers to connect services, so that people can find services while actively matching people's needs. In addition, vivo has also built a personal intelligence system framework to build a common memory between people and devices through localized knowledge maps and based on the capability of large end model.
Vivo Vice President, OS Product Vice President, Vivo AI Global Research Institute President
At the meeting, Vivo's vice president, vice president of OS products, and president of the Vivo AI Global Research Institute demonstrated a new exploration of Vivo based on the Blue Center big model technology, that is, "PhoneGPT", that is, mobile phone intelligent agent. In the demonstration, Blueheart V can not only identify and operate the screen interface, but also conduct independent dialogue by taking over the audio to complete the tasks assigned by users, such as helping us to order restaurants, coffee, etc. This is a small step of mobile phone automation, but a big step to free users' hands. With the development of AI, PhoneGPT will surely bring more application scenarios and better intelligent experience in the future, so that V will become a personal assistant who knows you better.
Vivo Vice President, OS Product Vice President, Vivo AI Global Research Institute President
The third aspect is to reconstruct the connection experience between people and the physical world to make communication more smooth and warm. Last year, the release of the vivo music reading function enabled visually impaired people who love music to learn music scores and instruments on their mobile phones. Today, Vivo uses the multimodal large model to make mobile phones the eyes of visually impaired people, helping them to go further and safely to unfamiliar places alone. Vivo hopes to bridge the communication gap through AI technology, help the disabled people to pursue their dreams and explore the beauty of the world.
The new Blueheart big model matrix was officially released
In order to further consolidate the AI capability base, vivo released the new self-developed Blueheart big model matrix at this year's developer conference. Comprehensively upgrade the language model and end side model capabilities, and bring voice model, image model and multi-mode model developed by vivo. This indicates that Blueheart Intelligence has taken an important step towards personalized and diversified development.
In terms of the language model, the 100 billion level Blue Core cloud model focuses on optimizing the intention understanding and distribution and task planning capabilities. Compared with last year, the overall ability has increased by 30%, and continues to lead the first echelon in China on the SuperCLUE and C-EVAL lists.
Vivo Vice President, OS Product Vice President, Vivo AI Global Research Institute President
The privacy and security of users has always been the primary principle for Vivo to build Blueheart intelligence. After the introduction of three end side models last year, Vivo officially released a new 3 billion parameter level Blueheart end side model 3B. In terms of dialogue writing, summary, information extraction and other capabilities, Blueheart 3B can leapfrog the industry's 7B-9B model. Compared with the Blue Core 7B, the extreme performance of the Blue Core 3B is improved by 300%, the power consumption optimization in the balanced mode is up to 46%, the extreme word speed can reach 80 words/s, the system power consumption is only 450mA, and the memory occupation is only 1.4GB. In the evaluation of the comprehensive ability of small models by SuperCLUE and Equal Eval, Blueheart 3B ranked first, and also obtained the certification of the comprehensive ability of large models at the end side of Thale Laboratory and the certification of AIIA security defense ability.
In addition, vivo has also brought a new self-developed Blueheart voice model that can accurately understand the natural semantics and simulate the voice, a Blueheart image model that strengthens the fusion and generation ability of Chinese characteristics and oriental aesthetics, and a Blueheart multimodal model that upgrades visual perception and understanding.
Vivo Vice President, OS Product Vice President, Vivo AI Global Research Institute President
In the future, Blueheart Intelligence will continue to explore the deep integration of AI and OS and continue to create an open and win-win agent ecosystem based on the Blueheart big model matrix.
The original system 5 (OriginOS 5) officially appeared: natural and smooth, with AI
As the primary interface between users and mobile phones, the operating system directly determines the user experience. This vivo continues the design concept of "natural comfort, intuitive", focuses on its own technical achievements in AI, endurance, communication and other fields, as well as its thinking on the basic experience, design, humanities and other aspects of mobile phones, and launches a new generation of operating system - the original system 5 (OriginOS 5).
Vivo Vice President, OS Product Vice President, Vivo AI Global Research Institute President
In the original system 5, as the basis of AI reconstruction system experience, Blueheart V and Jovi voice were formally merged, bringing a more natural voice interaction experience. New interactive methods such as long press at the bottom of the screen and calling out "small V search" are added. Based on Blueheart's multi-modal large model technology, vivo has launched a new small V-circle search function. On the basis of existing text search, it accurately searches for objects through the combination of image recognition and circle selection interaction, bringing users more convenient "search in one circle".
Huang Zixun, product director of vivo OS, made a speech
The original system 5 has also upgraded the "Atom Island" function. In addition to the notification function, it has the strong intention recognition ability of Blueheart V, constantly analyzes and judges users' current needs, and actively provides users with subsequent services. And with more flexible design, one click one copy, or one click one drag to meet the user's multi task needs.
Huang Zixun, product director of vivo OS, made a speech
In addition, the original system 5 has upgraded the "Little V Suggestion" that provides you with intelligent services all day in the form of desktop components, the "Little V Helper" that supports simultaneous interpretation, the "vivo input method" with built-in "Little V Writing" capability, and the "Little V Houguang Silhouette" that supports one click editing and AI customized lyrics and songs. The new "small V memory" function, which can remember how to get along with users, is also introduced. At the same time, the "small V cross end ecology" enables users to directly interact with small V at the computer end and the car machine end for the first time. Vivo has brought users a smart experience at their fingertips through Blueheart Intelligence in dozens of modules such as phones and photo albums in the original system 5.
Xiong Guanjing, Senior Director of vivo AI System Center, gives a speech on the spot
In terms of fluency, the original system 5 has built an all-round fluency experience including light and shadow, interaction, shape switching and scene transition, and has carried out more than 1000 optimization of fluency experience, aiming to run through every scene of the system with a "natural and comfortable, intuitive" use experience.
At the bottom level of the system, the unfair scheduling mechanism of the original system 5 has once again ushered in a major upgrade of version 3.0, introducing the unfair scheduling mechanism of GPU for the first time, and significantly improving the smoothness of foreground applications through intelligent allocation of GPU resources. At the memory level, the original system 5 innovatively introduced the Ledger memory ledger mechanism, the first in the Android field, to achieve system level accurate scheduling of memory resources, unified allocation and management of memory resources, effectively reducing the burden of applications. At the same time, it can also intelligently build a memory ledger and dynamically optimize memory allocation according to actual application scenarios, Ensure that every memory in the phone can be used efficiently. At the display level, the virtual graphics card of the original system 5 has been upgraded to a more powerful version 2.0. As the exclusive first display enhancement technology of vivo, it integrates three core technologies, namely, the fast response dynamic architecture, the synthetic rendering accelerator, and the graphics link collaboration engine, to comprehensively optimize the whole link experience from touch to feedback interface.
The original system 5 focuses on solving user pain points and continuously optimizing the use experience. In terms of network communication, the original system 5 realized a new technological breakthrough and comprehensive experience upgrade driven by user scenarios. Based on Bluetooth, it has realized the industry's first kilometre level wireless communication technology, which supports point-to-point voice intercom and text chat up to 1.5 kilometers in an open environment without a network. For the home scene with Wi Fi through the wall, the ten thousand concert scene with network congestion, and the commuting scene with weak signals such as elevators, high-speed trains, and subways, the original system 5 also conducted in-depth network performance tuning to ensure a smooth network experience in the whole scene. In terms of endurance, the original system 5 launched a new and upgraded blue ocean endurance system, including the introduction of a new scene energy efficiency engine, the introduction of heterogeneous computing space 2.0 and other technologies, which realized efficient and accurate power management and all-weather endurance.
Vivo OS Product Director Wu Baiqi gives a speech
In addition to the "rational project", the original system 5 also deduces perceptual aesthetics. In terms of design, it has carried out two dimensional upgrades based on the atomic design system. First, it introduced the concept of spatial perception, made the interface content clear at a glance with the help of rich light, shadow, material expression, classified card list, etc., and introduced panoramic weather that restores people's daily experience of nature, Bring a wonderful experience of natural integration of reality and virtual world. On the other hand, the original system 5 interprets elegant aesthetics, upgrades personalized lock screen, situational wallpaper and other functions, and makes the screen turn off and turn on naturally and comfortably, making the digital world more warm.
Ai Min, the artistic creative director of vivo OS, gives a live speech
In the past year, through the implementation of the user consultant plan, the team was organized to listen carefully to user suggestions every month and invited user consultants to participate in every aspect of innovation. Both the feedback of experience and the unremitting pursuit of aesthetics provide rich inspiration for the system team. This has also made today's upgrade of the original system 5.
Vivo Vice President, OS Product Vice President, Vivo AI Global Research Institute President
Blue River kernel blessing, Blue River operating system 2: full stack self research, born for AI
Since last November, vivo released its self-developed BlueOS for the first time Later, at this year's developer conference, the newly upgraded Lanhe operating system 2 made its synchronous debut. It was equipped with a real-time operating system kernel based on the Rust language - Lanhe kernel. It has the characteristics of security, versatility and high performance, can be compatible with different embedded platforms, and has complete system scheduling, memory management, file system Network and equipment management capability. Blue River OS 2 will also become the industry's first operating system written in Rust language.
Vivo Vice President, OS Product Vice President, Vivo AI Global Research Institute President
Blue River OS 2 has built a more intelligent system architecture. First, the bottom layer is a base composed of the Blue Center model developed by vivo and the VCAP reasoning computing acceleration platform. Lanhe has integrated the Blue Center big model matrix from the beginning of design, supporting flexible end cloud deployment of different parameters of the Blue Center big model, and supporting visual, voice and other AI algorithms. In addition, VCAP ensures the efficient operation of various AI algorithms at the end. On this base, we have brought a new service engine, which includes data services, intention perception and decision services, and provides capability support for the intention framework. The intention framework can fully perceive the user's usage scenarios, accurately understand the user's intention, and finally automatically plan and execute tasks based on the user's behavior and usage habits. Through this system architecture, Blue River Operating System 2 builds AI capabilities from the bottom layer, further realizing innate intelligence.
Blue River OS 2 deeply integrates the powerful AI capabilities of Blueheart Intelligence, in which the big model of Blueheart is the technical base, the small V of Blueheart is the exclusive assistant, and the agent platform provides professional services. In terms of ecology, Blue River is compatible with the Hapjs fast application standard incubated by the Open Atom Open Source Foundation. With the fast application upgrading to 2.0, it will also bring more intelligent service ecology to users. At the same time, vivo has brought a new Blue River UI framework to developers. Based on adaptive UI layout, it only needs one development to bring a consistent experience on screens of different sizes.
In the AGI era, in addition to more intelligent operating systems, intelligent hardware also ushered in a new round of reform. Blue River operating system 2 can adapt to devices of different sizes, and also endow different devices with powerful AI capabilities. Vivo is willing to open up and cooperate with the industry to jointly explore the Blue River operating system 2 and the Blue Center big model, and the solutions on intelligent glasses, robots and even more AI devices, so as to jointly create a truly future oriented intelligent terminal.
User centered realization of open Zhilian
In recent years, vivo has continued to focus on five life scenarios, namely, smart travel, smart home, smart office, sports and health, and audio-visual entertainment. It is committed to breaking barriers between different brands, taking users as the center, and realizing a truly open smart network. In this regard, on the one hand, Vivo achieves ecological openness, actively builds its own capabilities, and enables external ecological equipment. At the same time, it takes the lead in creating alliances that are widely compatible with industry standards, allowing users to break through ecological barriers and freely connect their favorite smart devices. On the other hand, vivo hopes to make the connection more intelligent. Vivo transfers powerful AI capabilities to ecological devices across terminals, enabling users to effectively communicate with devices through natural language.
Vivo Vice President, OS Product Vice President, Vivo AI Global Research Institute President
At this stage, vivo smart car has achieved the leading coverage scale in the industry, connecting more than 170 car brands and covering more than 8500 models. Vivo actively promotes the development of industry technology with an open and win-win attitude. In order to upgrade the technology of smart car and digital car keys, vivo led the ICCOA alliance and launched agreements covering more than 350W cars in the market.
In the scene of home smart device interconnection, vivo is deeply involved in the construction of the matter ecology, and there are more than 1200 SKUs in the alliance in the categories that can be connected. At the same time, vivo also supports CCSA and other authoritative associations, helping to formulate more than 20 IoT industry standards.
In addition, vivo has realized AIGC's ability to get on the car and computer through "small V cross end", and will also launch "home agent" and "car agent", so that users can control intelligent devices through natural language, making the connection more convenient. It is worth mentioning that vivo has also become the first domestic manufacturer compatible with Apple's ecosystem. In order to bring users a more silky cross device experience, we realized cross end collaboration with Apple computers by deeply adapting Apple M-series chips. Users can conduct full end search and remote control on Apple computers through vivo office suite.
Stick to the long-term principle and protect users' security and privacy
The development of emerging technologies has brought about a huge leap in life and production efficiency. However, the coordinated development of safety, culture and industry must be taken into account when developing technology, so that technology can be better applied and benefit mankind.
Lv Jinghui, chief security officer of vivo, made a speech on the spot
At the meeting, Lu Jinghui, the chief security officer of vivo, shared the latest progress of vivo AI in the security field. He said that on the protection of privacy rights, vivo advocates and practices a "transparent" privacy policy, and gives users the right to dominate. When providing AI services, vivo adopts the technical strategy of "end side first, end cloud collaboration", and data that can be processed on the end side will never go to the cloud. In the face of complex AI task processing, on the premise of ensuring user privacy and data security, call the cloud side big model capability to achieve efficient and secure end cloud collaboration, and ensure that AI services are both intelligent and secure. In the face of sensitive privacy information, vivo removes or blurs personal identity information before collecting and analyzing data through anonymous processing and differential privacy technology, and provides personalized services on the premise of ensuring privacy. Lu Jinghui stressed that to create personalized intelligence, user privacy security is always the primary principle, and vivo will continue to find the best balance between personalized services and privacy protection. Let the "private customization" of Lanxin Intelligent be convenient, intimate, safe and reliable.
In addition, via Blueheart Intelligence, Vivo empowers the end AI capability to "a thousand mirror trusted engine" and builds a full link fraud protection. At the same time, the mobile phone loss protection system has been upgraded, and a new "network search" function has been launched. In addition to offline search, it takes the lead in the Android camp to achieve shutdown positioning and improve the probability of mobile phone retrieval by using hundreds of millions of vivo devices and advanced network positioning technology. If it cannot be retrieved, the data can be safely deleted at the remote physical level. At the same time, it can also be used for chip level machine brushing activation lock anti-theft. Three lines of defense protect your equipment and data security layer by layer.
AI does not matter, and technology lights up the bright future
The achievements of science and technology can benefit everyone, including nearly 30 million people with hearing impairment, 17.3 million people with visual impairment and more than 200 million elderly people in China. Vivo continues to enable barrier free application experience with AI technology. Last year, vivo launched the first software "Sign Language Translator" integrating sign language recognition and synthesis, and won the first place in CCL2024 sign language digital human translation quality evaluation. This year, in order to help the popularization and promotion of the national common sign language, we upgraded the "sign language learning" function in the "sign language translator", hoping to help more people learn sign language.
Vivo Vice President, OS Product Vice President, Vivo AI Global Research Institute President
At the same time, based on the big model of Blueheart voice, "vivo listening and speaking" has added the function of free dialect speaking. At present, it supports six dialects to solve the problem of communication barriers between regions, and also allows users to interact with mobile phones with their most familiar local accent. In order to enable more people's local accent to be recognized by the voice model, next, we will adapt more and more languages to various functions of mobile phones, so that the language interaction of mobile phones is more natural, more intuitive, and more fluent and warm communication between people.
Vivo Vice President, OS Product Vice President, Vivo AI Global Research Institute President
In addition to "vivo listening and speaking", "vivo seeing" has also been blessed by the voice big model, and the real-time question and answer function has been added, making it the industry's first multi-modal big model visual aid product. Based on years of technology accumulation and industry practice, vivo produced the industry's first guide software for visually impaired users for the National Barrier Free Environment Exhibition Hall, which officially opened on August 28. Provide assistance for the exhibition hall through vivo mobile phone products and visual aids of "vivo see".
At the same time, the Vivo Accessibility Solution was selected into the United Nations ITU Case Collection of Artificial Intelligence for Good and the World Internet Conference Public Welfare Action Plan, and won more than 10 authoritative awards and honors, including the Outstanding Case of Accessible Information Accessibility. Vivo has become a strategic partner of the China Disabled Persons' Federation, donating accessibility equipment to more than 1000 disabled students in 10 universities, and recruiting 100 dream instructors to help disabled youth find jobs and pursue their dreams bravely.
Work together with global developers and partners to create an open future
Surround, vice president of vivo, vice president of OS products and president of vivo AI Global Research Institute, said that a flower is not spring, and a single tree does not make a forest. Vivo always adheres to the cooperation concept of "coordinated development, mutual trust and win-win", constantly deepens and integrates the underlying core technologies, including the measurement system capability to improve the application experience, AI and Blue River operating system technology leading innovation, IoT technology of Open Smart Connect, etc.
AI, as the core force of a new round of scientific and technological revolution, has created new opportunities for the industry to improve operating efficiency, optimize user experience, and enhance market competitiveness. Vivo hopes to gather global partners and developers to continue in-depth cooperation, accelerate product and service innovation and industrial ecological construction, and jointly open the infinite possibilities of the AI era.
