Which GPU(s) to Get for Deep Learning: My Experience and Advice for Using GPUs in Deep Learning timdettmers.com/2023/01…learning Wow, this time he mentions: - A primer on how GPUs work - Used GPUs - Blower fans - An interesting variety of GPUs - Finally proper caveats on memory, cooling, blower fans As usual, the Ivory tower caveats: - Not sure where you can actually get Ada or Hopper GPUs - Lol, did he see the TDP of 40* GPUs? I have not seen sane options yet ... - No mention of A10 or A5000 - No mention of Bitcoin bubble bs - No mention of EPYC vendor lock - For us FP16 only helped with memory - Did not see massive practical support of FP8 yet - No mention of 40* Nvidia pricing bs (mostly relevant for gaming) - The 1600W PSU mumbo jumbo is most likely due to the fact that he lives in the 120V country and never builds with server parts