attention

While single-head attention is 0. attention lyrics 9 BLEU worse than the best setting, quality also drops off with too many heads 5We used values of 2 8, 3 7, 6 0 and 9 5 TFLOPS for K80, K40, M40 and P100, respectively Table 3: Variations on the Transformer architecture Unlisted values are identical to those of the base model