The math behind PrismML's 27B-parameter model in 4GB of RAM

PrismML has developed a technique to run a 27-billion-parameter AI model in just 4GB of RAM, potentially enabling powerful on-device AI on iPhones and giving Apple a competitive edge in mobile AI.

Article URL: https://thebluenarwhal.com/27-billion-parameters-on-an-iphone-why-on-device-ai-may-be-apples-next-big-advantage/ Comments URL: https://news.ycombinator.com/item?id=48915625 Points: 1 Comments: 0