• errer@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    7 days ago

    I’m pretty skeptical local models can hold a candle to the cloud-based ones, particularly the ones Apple trains.

    • eicker@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      15
      ·
      7 days ago

      Raw capability is only one metric: A local model probably will not beat the best cloud model any time soon, but it does not need to. If it handles 80 to 90% of everyday tasks instantly, privately and at near zero marginal cost, that is a huge win. Reserve the cloud for the genuinely hard requests, not every prompt.