Apple AI Renaissance New Blueprint: Desktop Robots Lead 2027 Strategy, Smart Home Cameras Open New Growth Pole

According to Zhitong Finance APP, Apple (AAPL.US) is revitalizing its position in the artificial intelligence field with a series of ambitious new products, including a desktop robot, a more human-like version of Siri, smart speakers with displays, and home security cameras.

According to insiders, a desktop robot set to launch in 2027 is central to its AI strategy. Meanwhile, smart speakers with displays are planned for release next year as part of an initiative to enter the entry-level smart home product market.

Additionally, the home security system is seen as another significant growth opportunity. The new cameras will become a core component of Apple's security system, which can automate home functions. These individuals stated that this approach helps enhance the appeal of Apple's product ecosystem, making its products more favored by consumers.

All of this is aimed at revitalizing Apple Inc. Its latest major project, the Vision Pro headset, has yet to achieve sales success, and the design of its best-selling products has remained largely unchanged for years.

At the same time, Apple has faced criticism for failing to keep up with the generative AI revolution. OpenAI may even threaten Apple's core business area by developing AI-based new devices in collaboration with former Apple design chief Jony Ive.

Although Apple is still in the early stages of reversing its AI software, executives believe that the development progress of hardware products is a key factor in its revival—helping it compete in new areas against companies like Samsung Electronics and Meta (META.US).

A spokesperson for Apple declined to comment. Since these products have not yet been announced, the company's plans may still change or be canceled. Many initiatives and their timelines depend on Apple's continued progress in AI-driven software.

Apple CEO Tim Cook told employees at an all-hands meeting this month that Apple must succeed in the field of artificial intelligence and revealed upcoming new products.

In addition to home devices, Apple is preparing to launch a thinner, redesigned iPhone model this year. In the long term, it also plans to release smart glasses, foldable phones, a 20th-anniversary edition iPhone, and an improved headset called N100. Furthermore, the company is planning a large foldable device that combines features of the MacBook and iPad.

Apple is attempting to boost sales of its flagship products through a series of initiatives, as its product sales growth has slowed for several years. Additionally, the company has canceled expansion plans in some new areas, such as autonomous vehicles, further increasing its pressure to find alternative revenue sources. At the same time, these new initiatives will also help counter claims that the company is no longer innovating as it once did.

Reports last year indicated that Apple was advancing a desktop robot project called "J595" and was formulating a new smart home strategy. Now, clearer information about its entry into this market is gradually emerging—significant for its AI goals Desktop Robot

This desktop robot resembles an iPad mounted on movable limbs, which can rotate and reposition to follow users moving around the room. Like a human head, it can turn towards the person speaking or calling it, and even attempt to attract the attention of those not facing it.

Its goal is to apply artificial intelligence technology to practical products in ways that some other hardware manufacturers have not yet achieved. Apple envisions users placing it on their desks or kitchen counters to help them complete work, watch media content, and organize daily tasks.

FaceTime calls will also be a key feature of the device. During video conferences, the display can automatically adjust to lock onto people in the room. Apple is testing a feature that turns the iPhone screen into a joystick, allowing the user’s robot to rotate and move to showcase different people or items in the room during video calls.

However, the device's standout feature is its new version of the Siri voice assistant, which can engage in conversations among multiple people. It can interact with users throughout the day and retrieve information more easily.

The concept is to allow this device to act as a person in the room. For example, it could interrupt conversations between friends about dinner plans and recommend nearby restaurants or relevant recipes. Additionally, the device is designed for two-way discussions about planning trips or completing tasks—similar to OpenAI's voice mode.

Apple plans to place Siri at the core of the device's operating system and give it a visual personality to make it feel more real. This approach, called "Bubbles," is somewhat reminiscent of "Clippy," the animated paperclip that served as a virtual assistant in Microsoft Office software in the 1990s.

Apple has attempted to make Siri's appearance resemble an animated version of the "Finder" logo—the iconic smiling face representing the Apple computer file management system. However, the final design has not yet been determined, and designers are considering options closer to the "Memoji" style. "Memoji" refers to the fun characters representing Apple user accounts.

The device prototype features a horizontal display of about 7 inches, similar in size to an iPad mini. An electric retractable arm can extend the display about half a foot from the base, with adjustable directions.

Some people familiar with the product refer to it as the "Pixar Lamp," referring to the famous logo of the animation film company. Apple previously revealed some research findings in this area: in January, the company published a paper detailing a movable lamp utilizing robotic technology.

Apple has multiple teams across its artificial intelligence, hardware, software, and interface design departments working on this project. This work is led by Kevin Lynch, who previously drove the development of smartwatch software and automotive-related projects This tech giant is developing several other robots. It has formed a team to research wheeled mobile robots—similar to Amazon's (AMZN.USA) "Astro" robot—and has also broadly explored humanoid robot models.

Apple has a dedicated team actively developing a large robotic arm for use in manufacturing environments or to perform tasks in the back of retail stores, which could potentially replace some employees. This robot, named T1333, will take several more years to come to market.

Desktop Robot New Operating System: Charismatic

The smart home project includes a product with a standalone display set to launch in mid-next year. Codenamed J490, this device is a simplified version of the robot, lacking arms and the voice assistant Siri (at least in the initial phase). It will still feature home control, music playback, note-taking, web browsing, and video conferencing capabilities. It may also come with a new Siri visual interface.

Both the smart display and the desktop robot will run a new operating system called "Charismatic," designed for multiple users. Its interface primarily consists of a clock interface and widgets—these small software functions are typically dedicated to specific tasks.

"Charismatic" (previously known as "Pebble" and "Rock," having undergone different names during development) integrates design concepts from the Apple TV and Apple Watch operating systems. It features functionalities such as multi-user mode and watch face themes, including a watch face theme based on the comic "Snoopy."

These devices are designed for easy sharing: they are equipped with a front-facing camera that can scan the user's facial information as they approach the device, automatically adjusting the layout, functions, and content based on that user's personal preferences.

Certain versions of the software adopt circular app icons and feature a hexagonal app grid layout. Apple plans to incorporate many of its core applications (including Calendar, Camera, Music, Reminders, and Notes) into it. However, the interface will heavily rely on voice interaction and widgets, rather than frequently switching between different applications.

Although the device will come with a touchscreen, the primary input method will be Siri and an upcoming feature upgrade called "App Intents." This software will allow users to control the interface and applications precisely through voice commands.

The hardware itself resembles the Google Nest Hub but is square in shape, with thin black or white borders and rounded corners.

This non-robotic 7-inch display sits atop a hemispherical base that integrates some electronic components, with holes at the bottom edge for installing speakers and microphones. Additionally, it can be mounted on a wall.

This release will mark Apple's first official entry into the smart home sector, whereas Amazon and Google (GOOGL.US) have been launching smart speakers with screens nearly a decade ago For Apple Inc., the home environment is a crucial target market, especially as more users watch programs and automate home device operations through their living rooms.

Apple has long held a significant position in the mobile device sector and has rapidly entered the automotive industry through CarPlay—but this success has not extended to the smart home sector. Although the company launched HomeKit in 2014 for controlling third-party devices, its own HomePod speaker has not achieved significant success.

Linwood and Glenwood

For new home devices (as well as existing products like the iPhone and iPad), the core lies in a comprehensive improvement of the underlying system for Siri.

Engineers are developing a version codenamed "Linwood," which centers around a new "brain" based on large language models—this is the foundation of generative artificial intelligence. The goal of this version is to utilize personal data to answer questions, a feature that was previously delayed due to issues in the current version.

Reports indicate that the new software, internally codenamed "LLM Siri," is expected to launch as early as next spring. However, development work is still ongoing: Apple is preparing a redesigned smart assistant for the iPhone and iPad, which will also debut early next year.

Craig Federighi, Senior Vice President of Software Engineering, revealed at an internal employee meeting this month that the company will undergo a comprehensive reform that exceeds expectations.

He stated, "The work we have done for this end-to-end overhaul of Siri has yielded the results we needed, allowing us not only to achieve the originally announced plans but also to implement a larger upgrade than we initially envisioned." He also mentioned, "Currently, no other project has received as much attention as this one."

"Linwood" is built on technology developed by Apple's Foundation Model team, but the company also has a competing project named "Glenwood," which will support Siri using external technology.

A final decision on which models of devices will be used has not yet been made, but Apple is testing with Anthropic PBC's "Claude" model. Earlier this year, former Vision Pro head Mike Rockwell, who was responsible for the Siri project, is overseeing both projects.

In developing desktop robots, Apple's engineers have extensively used ChatGPT and Google Gemini to build and test functionalities. Throughout Apple's AI and Siri teams, software developers are increasingly incorporating third-party systems into their development processes.

Home Camera

Apple is developing a camera named J450, designed specifically for home security, capable of recognizing individuals and automatically performing tasks. The device will be battery-powered, with a single charge lasting from several months to a year, and performance comparable to similar products The device is equipped with facial recognition and infrared sensor capabilities, allowing it to identify people in the room. Apple believes that users will install cameras throughout their homes to assist with automation. This could mean that lights automatically turn off when someone leaves the room or that music favored by a family member automatically plays.

Apple plans to develop various types of cameras and home security products as part of a new hardware and software series. Its goal is to compete with Amazon, Google, and Roku, leveraging its customer loyalty to sell more products.

It is also testing a doorbell that uses facial recognition technology to unlock doors. Apple has launched the iCloud+ service, which includes online storage for storing surveillance footage, but these services are aimed at third-party cameras