parallel-training on Hacker News: 1 stories with screenshots

Screenshot of arxiv.org: Were RNNs all we needed?

Were RNNs all we needed?(arxiv.org)

466 points by beefman 2 years ago | 245 comments

arXiv paper proposing minimal LSTM and GRU variants without hidden-state gate dependencies that can be trained in parallel, rivaling recent sequence models.

rnn lstm gru transformers

#parallel-training on Hacker News

Were RNNs all we needed?(arxiv.org)