@stabby_cicada@slrpnk.net to Solarpunk technology@slrpnk.net • 11 days agoThe real cost of AI is being paid in deserts far from Silicon Valley | Rest of Worldrestofworld.orgexternal-linkmessage-square6fedilinkarrow-up163arrow-down13
arrow-up160arrow-down1external-linkThe real cost of AI is being paid in deserts far from Silicon Valley | Rest of Worldrestofworld.org@stabby_cicada@slrpnk.net to Solarpunk technology@slrpnk.net • 11 days agomessage-square6fedilink
minus-square@perestroika@slrpnk.netlinkfedilink6•edit-211 days agoRegarding AI, some simple examples of likely computing expense: performing 1 + 1 in assembly language: 1 CPU cycle performing 1 + 1 in a high level interpreted language: maybe 10 CPU cycles performing 1 + 1 using an LLM: millions of CPU cycles asking “why was the rabbit an animal after 1 + 1”: probably priceless, maybe a billion cycles
minus-square@keepthepace@slrpnk.netlinkfedilink4•11 days agoNowadays with JIT #1 and #2 are very close. There was less than a x2 performance gap when I compared a direct simple task in C and javascript. About #3 no one does that. #3 and #4 will be on the same scale, every token generated is roughly the same amount of CPU.
minus-square@Ugurcan@lemmy.worldlinkfedilink3•11 days agoTo be honest we lost that war when JavaScript dominated everything.
Regarding AI, some simple examples of likely computing expense:
Nowadays with JIT #1 and #2 are very close. There was less than a x2 performance gap when I compared a direct simple task in C and javascript.
About #3 no one does that.
#3 and #4 will be on the same scale, every token generated is roughly the same amount of CPU.
To be honest we lost that war when JavaScript dominated everything.
PHP would like a word.