原推:Very hard to conceptualize a ~5,000x capability improvement (our ~2025 expectation for neural nets.)
To give you a sense *compared to the 2007 original* this year’s iPhone will likely be between ~200x (on a CPU basis) and ~3,000x (on a GPU basis) more performant https://t.co/sr3VD9EtFY
We believe the cost to train a neural net will fall 2.5x per year through 2030.
AND we expect budgets to continue to balloon, doubling annually at least through 2025.
Combine the two:
Neural net capability should increase by ~5,000x by 2025 https://t.co/oE1JTSdkd7