It has become impossible to tell managers mesmerised by artificial intelligence that the tools are not, in fact, helpful. So employees just play along with the fiction to keep their jobs, writes our tech columnist
When you send a message to a chatbot, it cuts it up to little pieces made up of a few letters, assigns numbers to them, does math, and gives you back a bunch of other numbers that it translates back to pieces and puts together into a sentence.
You pay for the chatbot by the amount of little pieces in and little pieces out. The little pieces are the tokens.
Oh definitely. The whole “reasoning” thing was just sending the answer back as a prompt a few times in different structures, and it was of course all billed
What tf are tokens?
When you send a message to a chatbot, it cuts it up to little pieces made up of a few letters, assigns numbers to them, does math, and gives you back a bunch of other numbers that it translates back to pieces and puts together into a sentence.
You pay for the chatbot by the amount of little pieces in and little pieces out. The little pieces are the tokens.
I wonder if they make a fortune off engagement padding.
Oh definitely. The whole “reasoning” thing was just sending the answer back as a prompt a few times in different structures, and it was of course all billed
It’s about 4 letters
It’s how AI usage is measured and charged.