jaykrown@lemmy.world to Technology@lemmy.worldEnglish · 22 hours agoDDR6 RAM shrinks by 44% while delivering 4X DDR5's baseline bandwidth — JEDEC previews 12.8 GT/s modules with up to 1 terabyte of capacity per slotwww.tomshardware.comexternal-linkmessage-square29linkfedilinkarrow-up1179arrow-down12
arrow-up1177arrow-down1external-linkDDR6 RAM shrinks by 44% while delivering 4X DDR5's baseline bandwidth — JEDEC previews 12.8 GT/s modules with up to 1 terabyte of capacity per slotwww.tomshardware.comjaykrown@lemmy.world to Technology@lemmy.worldEnglish · 22 hours agomessage-square29linkfedilink
minus-squareaksdb@lemmy.worldlinkfedilinkEnglisharrow-up4·edit-213 hours agoLLM workloads become faster with higher bandwidth, which directly translates to token per second. So it does matter for daily use. But you are right that more and slightly slower is still better than less but fast.
LLM workloads become faster with higher bandwidth, which directly translates to token per second. So it does matter for daily use.
But you are right that more and slightly slower is still better than less but fast.