Choosing the best GPU for Training / Inference In my opinion - 3090 is still the best even at 2x the recommended price. And A4000 is a clear winner for inference, with 140W TDP and single-slot.