nick@campfyre.nickwebster.dev to Programmer Humor@programming.devEnglish · 1 year agoComputer components cheat sheetcampfyre.nickwebster.devimagemessage-square40fedilinkarrow-up168arrow-down14
arrow-up164arrow-down1imageComputer components cheat sheetcampfyre.nickwebster.devnick@campfyre.nickwebster.dev to Programmer Humor@programming.devEnglish · 1 year agomessage-square40fedilink
minus-squaredan@upvote.aulinkfedilinkarrow-up0·edit-211 months agoThat’s just due to IEEE754 floating point. The CPU would do it the same way if you had a software-based implementation. 0.1 in binary doesn’t have a precise value. It’s recurring, the same way we can’t represent 1/3 (0.333333333…) precisely in decimal.
minus-squarefrezik@midwest.sociallinkfedilinkarrow-up1·11 months agoIn other words, “computes numbers incorrectly”. You don’t have to overthink it on a meme that describes a hard drive as “remembers numbers loudly”.
0.1+0.2
That’s just due to IEEE754 floating point. The CPU would do it the same way if you had a software-based implementation.
0.1 in binary doesn’t have a precise value. It’s recurring, the same way we can’t represent 1/3 (0.333333333…) precisely in decimal.
In other words, “computes numbers incorrectly”.
You don’t have to overthink it on a meme that describes a hard drive as “remembers numbers loudly”.