returnn

The RWTH extensible training framework for universal recurrent neural networks

Github stars Tracking Chart

==================
Welcome to RETURNN

GitHub repository <https://github.com/rwth-i6/returnn>__.
RETURNN paper 2016 <https://arxiv.org/abs/1608.00895>,
RETURNN paper 2018 <https://arxiv.org/abs/1805.05225>
.

RETURNN - RWTH extensible training framework for universal recurrent neural networks,
is a Theano/TensorFlow-based implementation of modern recurrent neural network architectures.
It is optimized for fast and reliable training of recurrent neural networks in a multi-GPU environment.

Features include:

  • Mini-batch training of feed-forward neural networks
  • Sequence-chunking based batch training for recurrent neural networks
  • Long short-term memory recurrent neural networks
    including our own fast CUDA kernel
  • Multidimensional LSTM (GPU only, there is no CPU version)
  • Memory management for large data sets
  • Work distribution across multiple devices
  • Flexible and fast architecture which allows all kinds of encoder-attention-decoder models

See documentation <http://returnn.readthedocs.io/>.
See basic usage <https://returnn.readthedocs.io/en/latest/basic_usage.html>

and technological overview <https://returnn.readthedocs.io/en/latest/tech_overview.html>__.

Here is the video recording of a RETURNN overview talk <https://www-i6.informatik.rwth-aachen.de/web/Software/returnn/downloads/workshop-2019-01-29/01.recording.cut.mp4>_
(slides <https://www-i6.informatik.rwth-aachen.de/web/Software/returnn/downloads/workshop-2019-01-29/01.returnn-overview.session1.handout.v1.pdf>,
exercise sheet <https://www-i6.informatik.rwth-aachen.de/web/Software/returnn/downloads/workshop-2019-01-29/01.exercise_sheet.pdf>
;
hosted by eBay).

There are many example demos <https://github.com/rwth-i6/returnn/blob/master/demos/>_
which work on artificially generated data,
i.e. they should work as-is.

There are some real-world examples <https://github.com/rwth-i6/returnn-experiments>_
such as setups for speech recognition on the Switchboard or LibriSpeech corpus.

Some benchmark setups against other frameworks
can be found here <https://github.com/rwth-i6/returnn-benchmarks>.
The results are in the RETURNN paper 2016 <https://arxiv.org/abs/1608.00895>
.
Performance benchmarks of our LSTM kernel vs CuDNN and other TensorFlow kernels
are in TensorFlow LSTM benchmark <https://returnn.readthedocs.io/en/latest/tf_lstm_benchmark.html>__.

There is also a wiki <https://github.com/rwth-i6/returnn/wiki>.
Questions can also be asked on
StackOverflow using the RETURNN tag <https://stackoverflow.com/questions/tagged/returnn>
.

.. image:: https://travis-ci.org/rwth-i6/returnn.svg?branch=master
:target: https://travis-ci.org/rwth-i6/returnn

Main metrics

Overview
Name With Ownerrwth-i6/returnn
Primary LanguagePython
Program languagePython (Language Count: 4)
Platform
License:Other
所有者活动
Created At2016-06-14 14:37:14
Pushed At2025-06-04 15:01:36
Last Commit At2025-06-03 23:21:35
Release Count3
Last Release Namev2.1.0-beta (Posted on 2018-11-20 11:52:20)
First Release Namev2.0.1-beta (Posted on )
用户参与
Stargazers Count367
Watchers Count26
Fork Count132
Commits Count12.1k
Has Issues Enabled
Issues Count693
Issue Open Count181
Pull Requests Count909
Pull Requests Open Count27
Pull Requests Close Count90
项目设置
Has Wiki Enabled
Is Archived
Is Fork
Is Locked
Is Mirror
Is Private