RT @karpathy: Excellent and unintuitive read on GPUs. The chip doing the compute has tiny amount of memory & is connected to the main memor…