• Rhaedas@fedia.io
    link
    fedilink
    arrow-up
    16
    ·
    1 day ago

    The different LLMs do vary in abilities. What I find amazing is how bad Copilot is compared to any of the others. Not just on complex stuff, but basic requests. I’ve had local models do better, years ago.

    • jubilationtcornpone@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      1
      ·
      1 day ago

      IKR? For what it costs and for how hard Microsoft has worked to shoehorn it into everything, it offers very little in terms of increased productivity. I would go so far as to call it an epic failure. Especially considering they spent vast sums of money on it and all they managed to produce was something that is at best marginally good at drafting emails.

      As far as a coding assistant, Copilot is pathetic and produces code that is utter trash much of the time.

    • deadcream@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      1 day ago

      AFAIK compilot just provides integration with visual studio and GitHub, it doesn’t have its own models. You pay through Microsoft to use use other companies’ models (like GPT or Claude). Though agent harness itself has a big impact on the performance of models.