• @perestroika@slrpnk.net
    link
    fedilink
    6
    edit-2
    11 days ago

    Regarding AI, some simple examples of likely computing expense:

    • performing 1 + 1 in assembly language: 1 CPU cycle
    • performing 1 + 1 in a high level interpreted language: maybe 10 CPU cycles
    • performing 1 + 1 using an LLM: millions of CPU cycles
    • asking “why was the rabbit an animal after 1 + 1”: probably priceless, maybe a billion cycles
    • @keepthepace@slrpnk.net
      link
      fedilink
      411 days ago

      Nowadays with JIT #1 and #2 are very close. There was less than a x2 performance gap when I compared a direct simple task in C and javascript.

      About #3 no one does that.

      #3 and #4 will be on the same scale, every token generated is roughly the same amount of CPU.