jaykrown@lemmy.world to Technology@lemmy.worldEnglish · 23 hours agoDDR6 RAM shrinks by 44% while delivering 4X DDR5's baseline bandwidth — JEDEC previews 12.8 GT/s modules with up to 1 terabyte of capacity per slotwww.tomshardware.comexternal-linkmessage-square29linkfedilinkarrow-up1180arrow-down12
arrow-up1178arrow-down1external-linkDDR6 RAM shrinks by 44% while delivering 4X DDR5's baseline bandwidth — JEDEC previews 12.8 GT/s modules with up to 1 terabyte of capacity per slotwww.tomshardware.comjaykrown@lemmy.world to Technology@lemmy.worldEnglish · 23 hours agomessage-square29linkfedilink
minus-squaremantricx@lemmy.worldlinkfedilinkEnglisharrow-up8·17 hours agoSo many non-gaming workloads these days are capacity driven more than bandwidth driven. Any AI, LLM, image generation, video editing, etc. would be much better off with 32GB of DDR3 than 8GB of DDR4/5. 32GB of DDR4 is a good sweet spot to be in today.
minus-squareaksdb@lemmy.worldlinkfedilinkEnglisharrow-up4·edit-214 hours agoLLM workloads become faster with higher bandwidth, which directly translates to token per second. So it does matter for daily use. But you are right that more and slightly slower is still better than less but fast.
So many non-gaming workloads these days are capacity driven more than bandwidth driven. Any AI, LLM, image generation, video editing, etc. would be much better off with 32GB of DDR3 than 8GB of DDR4/5.
32GB of DDR4 is a good sweet spot to be in today.
LLM workloads become faster with higher bandwidth, which directly translates to token per second. So it does matter for daily use.
But you are right that more and slightly slower is still better than less but fast.