• eicker@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    29
    ·
    8 days ago

    The interesting part is not whether Apple wins the biggest model race, but whether it changes the economics: If enough AI runs locally, every token avoided is cloud capacity nobody has to build. That is a very different business model from selling ever more cloud compute.

    • errer@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      7 days ago

      I’m pretty skeptical local models can hold a candle to the cloud-based ones, particularly the ones Apple trains.

      • eicker@lemmy.worldOP
        link
        fedilink
        English
        arrow-up
        15
        ·
        7 days ago

        Raw capability is only one metric: A local model probably will not beat the best cloud model any time soon, but it does not need to. If it handles 80 to 90% of everyday tasks instantly, privately and at near zero marginal cost, that is a huge win. Reserve the cloud for the genuinely hard requests, not every prompt.