• 0 Posts
  • 3 Comments
Joined 1 year ago
cake
Cake day: December 20th, 2023

help-circle


  • Allero@lemmy.todaytoTechnology@lemmy.worldWhy I am not impressed by A.I.
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    2
    ·
    edit-2
    17 days ago

    Here’s my guess, aside from highlighted token issues:

    We all know LLMs train on human-generated data. And when we ask something like “how many R’s” or “how many L’s” is in a given word, we don’t mean to count them all - we normally mean something like “how many consecutive letters there are, so I could spell it right”.

    Yes, the word “strawberry” has 3 R’s. But what most people are interested in is whether it is “strawberry” or “strawbery”, and their “how many R’s” refers to this exactly, not the entire word.