Neural networks are becoming massive monsters that are hard to train (without the "regular" 12 last-generation GPUs).