Here’s how your old iPhone might get on-device generative AI

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • phillynewsnow
    Site Moderator - Staff

    • Oct 11
    • 18079
    • Pixel 7 Pro
    • Android
    • Metro PCS

    #1

    Heres how your old iPhone might get on-device generative AI




    Credit: Robert Triggs / Android Authority
    • A recent Apple research paper has detailed its solution for bringing on-device generative AI to iPhones.
    • The approach reduces the need for plenty of RAM, suggesting that this solution could enable on-device AI on older iPhones.




    We’re expecting loads of Android flagship phones to offer on-device generative AI capabilities in 2024, but Apple has been pretty quiet in this regard. Now, a new research paper published by the company has revealed how the company could get AI running locally on its iPhones.

    The Financial Times spotted an Apple research paper that details a solution for running large language models (LLMs) on devices with limited RAM. The paper reveals how Apple could keep the “model parameters” in storage and bring chunks of them to the device’s RAM as needed, as opposed to loading the entire model into RAM.



    More...
    Interested in creating an online community? How about growing one? How about profiting from one? Does it all seem so confusing, though? It doesn't have to be! Join SPJ Bulletin Communities to engage and network with beginner to seasoned online community managers just like you. Membership is free register today or login if you have an account.
Working...