"An influential 2014 neural machine-translation system parallelized training across an eight-GPU machine."
The paper reports large-scale English-to-French neural machine translation and says its deep LSTM implementation was parallelized across eight GPUs.
View Source