Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • First_Thunder@lemmy.zip
    link
    fedilink
    English
    arrow-up
    26
    ·
    13 hours ago

    What this shows though is that there isn’t actual reasoning behind it. Any improvements from here will likely be because this is a popular problem, and results will be brute forced with a bunch of data, instead of any meaningful change in how they “think” about logic

    • MangoCats@feddit.it
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      13
      ·
      12 hours ago

      Plenty of people employ faulty reasoning every single day of their lives…