Apple engineers have proposed a way to speed up chatbots on a smartphone
Apple experts have described a new way of working with generative artificial intelligence (AI) tools on smartphones. The study was published on the arXiv preprint server.
In the material, a team of scientists proposed a way in which generative artificial intelligence could be used even on old devices. The company said that to process operations, you can use the device’s permanent memory rather than RAM.
During operation, the AI model can reuse data that has already been processed. The chatbot will also be able to quickly receive information from the iPhone’s built-in memory, which will speed up the service.
According to experts, the new method will reduce the load on the processor by 4-5 times, and the graphics accelerator by 20-25 times. Also, the data will not be processed on servers – as in the case of the popular chatbot ChatGPT, but directly on the smartphone. “This breakthrough is particularly important for introducing advanced LLM programs into resource-limited environments, thereby expanding their applicability and accessibility,” the study authors noted.
In November, insiders said that future Samsung smartphones will have built-in artificial intelligence support. According to sources, gadget owners will be able to access various services without an Internet connection.
Source: Lenta
Mabel is a talented author and journalist with a passion for all things technology. As an experienced writer for the 247 News Agency, she has established a reputation for her in-depth reporting and expert analysis on the latest developments in the tech industry.
