sanitation@lemmy.today to Programmer Humor@programming.dev · 1 month agoNew compression techniqueimagemessage-square163linkfedilinkarrow-up11.23Karrow-down116file-text
arrow-up11.22Karrow-down1imageNew compression techniquesanitation@lemmy.today to Programmer Humor@programming.dev · 1 month agomessage-square163linkfedilinkfile-text
minus-squareboonhet@sopuli.xyzlinkfedilinkarrow-up1·1 month agoAlso if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol
Also if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol