Deep LearningFeaturedInsights & Opinion

Top 10 Deep Learning Frameworks

Editor’s Note: This article was first published in May 2017, with the aim of bringing together the best and most widely used deep learning tools and frameworks for you to choose from.

As you know, Artificial Intelligence is a domain where change is the only constant – newer innovations mean new tools and libraries are being developed and adopted to make the work of data scientists and AI researchers easier. As it is almost December now, we thought it best to keep up with the times and update the list – so that you always know what’s trending!

This is the age of artificial intelligence. Machine Learning and predictive analytics are now established and integral to just about every modern businesses, but artificial intelligence expands the scale of what’s possible within those fields. It’s what makes deep learning possible. Systems with greater ostensible autonomy and complexity can solve similarly complex problems.

If Deep Learning is able to solve more complex problems and perform tasks of greater sophistication, building them is naturally a bigger challenge for data scientists and engineers. Luckily, there’s a growing range of frameworks that make it a little easier to build deep learning solutions of some complexity. This wave of frameworks is another manifestation of a wider trend across modern technology for engineering communities to develop their own tools that offer a higher level of abstraction and simplify potentially difficult programming tasks. Every framework is different, built for a different purpose and offering a unique range of features. However, understanding what this landscape looks like will help to inform how you take on your next deep learning challenge, giving you a better sense of what’s available to help you.

Top 10 Deep learning Frameworks

1. Tensorflow

One of the most popular Deep Learning libraries out there, Tensorflow, was developed by the Google Brain team and open-sourced in 2015. Positioned as a ‘second-generation machine learning system’, Tensorflow is a Python-based library capable of running on multiple CPUs and GPUs. It is available on all platforms, desktop, and mobile. It also has support for other languages such as C++ and R and can be used directly to create deep learning models, or by using wrapper libraries (for e.g. Keras) on top of it.

In November 2017, Tensorflow announced a developer preview for Tensorflow Lite, a lightweight machine learning solution for mobile and embedded devices. The machine learning paradigm is continuously evolving – and the focus is now slowly shifting towards developing machine learning models that run on mobile and portable devices in order to make the applications smarter and more intelligent.

If you are just starting out with deep learning, this is THE go-to framework. It’s Python-based, backed by Google, has a very good documentation, and there are tons of tutorials and videos available on the internet to guide you. You can check out Packt’s TensorFlow catalog here.

2. Keras

Although TensorFlow is a very good deep learning library, creating models using only Tensorflow can be a challenge, as it is a pretty low-level library and can be quite complex to use for a beginner. To tackle this challenge, Keras was built as a simplified interface for building efficient neural networks in just a few lines of code and it can be configured to work on top of TensorFlow. Written in Python, Keras is very lightweight, easy to use, and pretty straightforward to learn. Because of these reasons, Tensorflow has incorporated Keras as part of its core API.  

Despite being a relatively new library, Keras has a very good documentation in place. If you want to know more about how Keras solves your deep learning problems, this interview by our best-selling author Sujit Pal should help you.

If you have some knowledge of Python programming and want to get started with deep learning, this is one library you definitely want to check out!

3. Caffe

Built with expression, speed, and modularity in mind, Caffe is one of the first deep learning libraries developed mainly by Berkeley Vision and Learning Center (BVLC). It is a C++ library which also has a Python interface and finds its primary application in modeling Convolutional Neural Networks. One of the major benefits of using this library is that you can get a number of pre-trained networks directly from the Caffe Model Zoo, available for immediate use. If you’re interested in modeling CNNs or solve your image processing problems, you might want to consider this library.

Following the footsteps of Caffe, Facebook also recently open-sourced Caffe2, a new light-weight, modular deep learning framework which offers greater flexibility for building high-performance deep learning models.

4. Torch

Torch is a Lua-based deep learning framework and has been used and developed by big players such as Facebook, Twitter and Google. It makes use of the C/C++ libraries as well as CUDA for GPU processing.  Torch was built with an aim to achieve maximum flexibility and make the process of building your models extremely simple. More recently, the Python implementation of Torch, called PyTorch, has found popularity and is gaining rapid adoption.

5. PyTorch

PyTorch is a Python package for building deep neural networks and performing complex tensor computations. While Torch uses Lua, PyTorch leverages the rising popularity of Python, to allow anyone with some basic Python programming language to get started with deep learning. PyTorch improves upon Torch’s architectural style and does not have any support for containers – which makes the entire deep modeling process easier and transparent to you.

Still wondering how PyTorch and Torch are different from each other? Make sure you check out this interesting post on Quora.

6. Deeplearning4j

DeepLearning4j (or DL4J) is a popular deep learning framework developed in Java and supports other JVM languages as well. It is very slick and is very widely used as a commercial, industry-focused distributed deep learning platform. The advantage of using DL4j is that you can bring together the power of the whole Java ecosystem to perform efficient deep learning, as it can be implemented on top of the popular Big Data tools such as Apache Hadoop and Apache Spark.

If Java is your programming language of choice, then you should definitely check out this framework. It is clean, enterprise-ready, and highly effective. If you’re planning to deploy your deep learning models to production, this tool can certainly be of great worth!

7. MXNet

MXNet is one of the most languages-supported deep learning frameworks, with support for languages such as R, Python, C++ and Julia. This is helpful because if you know any of these languages, you won’t need to step out of your comfort zone at all, to train your deep learning models. Its backend is written in C++ and cuda, and is able to manage its own memory like Theano. MXNet is also popular because it scales very well and is able to work with multiple GPUs and computers, which makes it very useful for the enterprises. This is also one of the reasons why Amazon made MXNet its reference library for Deep Learning too. In November, AWS announced the availability of ONNX-MXNet, which is an open source Python package to import ONNX (Open Neural Network Exchange) deep learning models into Apache MXNet.

Read why MXNet is a versatile deep learning framework here.

8. Microsoft Cognitive Toolkit

Microsoft Cognitive Toolkit, previously known by its acronym CNTK, is an open-source deep learning toolkit to train deep learning models. It is highly optimized and has support for languages such as Python and C++. Known for its efficient resource utilization, you can easily implement efficient Reinforcement Learning models or Generative Adversarial Networks (GANs) using the Cognitive Toolkit. It is designed to achieve high scalability and performance and is known to provide high-performance gains when compared to other toolkits like Theano and Tensorflow when running on multiple machines.

Here is a fun comparison of TensorFlow versus CNTK, if you would like to know more.

9. deeplearn.js

Gone are the days when you required serious hardware to run your complex machine learning models. With deeplearn.js, you can now train neural network models right on your browser! Originally developed by the Google Brain team, deeplearn.js is an open-source, JavaScript-based deep learning library which runs on both WebGL 1.0 and WebGL 2.0.

deeplearn.js is being used today for a variety of purposes – from education and research to training high-performance deep learning models. You can also run your pre-trained models on the browser using this library.

10. BigDL

BigDL is distributed deep learning library for Apache Spark and is designed to scale very well. With the help of BigDL, you can run your deep learning applications directly on Spark or Hadoop clusters, by writing them as Spark programs. It has a rich deep learning support and uses Intel’s Math Kernel Library (MKL) to ensure high performance. Using BigDL, you can also load your pre-trained Torch or Caffe models into Spark. If you want to add deep learning functionalities to a massive set of data stored on your cluster, this is a very good library to use.

Editor’s Note: We have removed Theano and Lasagne from the original list due to the Theano retirement announcement.

RIP Theano!

Before Tensorflow, Caffe or PyTorch came to be, Theano was the most widely used library for deep learning. While it was a low-level library supporting CPU as well as GPU computations, you could wrap it with libraries like Keras to simplify the deep learning process. With the release of version 1.0, it was announced that the future development and support for Theano would be stopped. There would be minimal maintenance to keep it working for the next one year, after which even the support activities on the library would be suspended completely. “Supporting Theano is no longer the best way we can enable the emergence and application of novel research ideas”, said Prof. Yoshua Bengio, one of the main developers of Theano.

Thank you Theano, you will be missed!

Goodbye Lasagne

Lasagne is a high-level deep learning library that runs on top of Theano.  It has been around for quite some time now and was developed with the aim of abstracting the complexities of Theano, and provide a more friendly interface to the users to build and train neural networks. It requires Python and finds many similarities to Keras, which we just saw above. However, if we are to find differences between the two, Keras is faster and has a better documentation in place.

There are many other deep learning libraries and frameworks available for use today – DSSTNE, Apache Singa, Veles are just a few worth an honorable mention.

The list above presents a very interesting question, then. Which deep learning framework would best suit your needs? Ultimately, that depends on a number of factors. If you want to get started with deep learning, your safest bet would be to use a Python-based framework like Tensorflow, which are quite popular. For seasoned professionals, the efficiency of the trained model, ease of use, speed and resource utilization are all important considerations for choosing the best deep learning framework.


Amey Varangaonkar

Data Science Enthusiast. A massive science fiction and Manchester United fan. Loves to read, write and listen to music.

Related Articles

2 thoughts on “Top 10 Deep Learning Frameworks”

  1. Java is one of the most popular and used programming languages these days. There are many Java web frameworks available for programmers that make the lives of these software developers easy.

  2. Check out Deep Learning Studio offered by Deep Cognition. This tool is free to use ( $Zero subscription for both cloud and Desktop Version). You can use simple drag and drop interface to build deep learning models or can use their earlier version of AutoML. Check out the website or you can read more about this tool on this kdnuggets article

    They are planning to offer lot more tools that may be of benefit to deep learning community

    If you can add this tool to your existing article then that would be great as I feel others can benefit from it
    Disclosure: I work with Deep Cognition

Leave a Reply

Your email address will not be published. Required fields are marked *