학술논문
Theano: A Python framework for fast computation of mathematical expressions
Document Type
Working Paper
Author
The Theano Development Team; Al-Rfou, Rami; Alain, Guillaume; Almahairi, Amjad; Angermueller, Christof; Bahdanau, Dzmitry; Ballas, Nicolas; Bastien, Frédéric; Bayer, Justin; Belikov, Anatoly; Belopolsky, Alexander; Bengio, Yoshua; Bergeron, Arnaud; Bergstra, James; Bisson, Valentin; Snyder, Josh Bleecher; Bouchard, Nicolas; Boulanger-Lewandowski, Nicolas; Bouthillier, Xavier; de Brébisson, Alexandre; Breuleux, Olivier; Carrier, Pierre-Luc; Cho, Kyunghyun; Chorowski, Jan; Christiano, Paul; Cooijmans, Tim; Côté, Marc-Alexandre; Côté, Myriam; Courville, Aaron; Dauphin, Yann N.; Delalleau, Olivier; Demouth, Julien; Desjardins, Guillaume; Dieleman, Sander; Dinh, Laurent; Ducoffe, Mélanie; Dumoulin, Vincent; Kahou, Samira Ebrahimi; Erhan, Dumitru; Fan, Ziye; Firat, Orhan; Germain, Mathieu; Glorot, Xavier; Goodfellow, Ian; Graham, Matt; Gulcehre, Caglar; Hamel, Philippe; Harlouchet, Iban; Heng, Jean-Philippe; Hidasi, Balázs; Honari, Sina; Jain, Arjun; Jean, Sébastien; Jia, Kai; Korobov, Mikhail; Kulkarni, Vivek; Lamb, Alex; Lamblin, Pascal; Larsen, Eric; Laurent, César; Lee, Sean; Lefrancois, Simon; Lemieux, Simon; Léonard, Nicholas; Lin, Zhouhan; Livezey, Jesse A.; Lorenz, Cory; Lowin, Jeremiah; Ma, Qianli; Manzagol, Pierre-Antoine; Mastropietro, Olivier; McGibbon, Robert T.; Memisevic, Roland; van Merriënboer, Bart; Michalski, Vincent; Mirza, Mehdi; Orlandi, Alberto; Pal, Christopher; Pascanu, Razvan; Pezeshki, Mohammad; Raffel, Colin; Renshaw, Daniel; Rocklin, Matthew; Romero, Adriana; Roth, Markus; Sadowski, Peter; Salvatier, John; Savard, François; Schlüter, Jan; Schulman, John; Schwartz, Gabriel; Serban, Iulian Vlad; Serdyuk, Dmitriy; Shabanian, Samira; Simon, Étienne; Spieckermann, Sigurd; Subramanyam, S. Ramana; Sygnowski, Jakub; Tanguay, Jérémie; van Tulder, Gijs; Turian, Joseph; Urban, Sebastian; Vincent, Pascal; Visin, Francesco; de Vries, Harm; Warde-Farley, David; Webb, Dustin J.; Willson, Matthew; Xu, Kelvin; Xue, Lijun; Yao, Li; Zhang, Saizheng; Zhang, Ying
Source
Subject
Language
Abstract
Theano is a Python library that allows to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. Since its introduction, it has been one of the most used CPU and GPU mathematical compilers - especially in the machine learning community - and has shown steady performance improvements. Theano is being actively and continuously developed since 2008, multiple frameworks have been built on top of it and it has been used to produce many state-of-the-art machine learning models. The present article is structured as follows. Section I provides an overview of the Theano software and its community. Section II presents the principal features of Theano and how to use them, and compares them with other similar projects. Section III focuses on recently-introduced functionalities and improvements. Section IV compares the performance of Theano against Torch7 and TensorFlow on several machine learning models. Section V discusses current limitations of Theano and potential ways of improving it.
Comment: 19 pages, 5 figures
Comment: 19 pages, 5 figures