Brief Introduction About TensorFlow

Tensor flow is a distributed computing tool, which allows colossus neural networks to train over a distributed server. Tensor flow is a product of the Google brain team, and Google used tensor flow for its internal use. Used in google photos, google search and google cloud speech.

What is Tensor flow?

• Tensor flow is an open source software library. This library used for data flow programming throughout the scope of tasks.
• Tensor flow is a symbolic Math library, used for machine learning applications such as Neural Networks.
• Tensor flow is a machine-learning library, suited for large-scale machine learning.
• TensorFlow uses computational graphs/ data flow for numerical computations.
• Google uses TensorFlow for Research and production.

History of TensorFlow

Distbelief is a previous version of tensorflow. Distbelief based on deep learning neural networks. Distbelief released in 2011. After updating the Distbelief, tensorflow come into existence. Tensorflow developed by Google Brain Team for the internal use of Google. TensorFlow released in 2015.

Characteristics of Tensorflow

Following are the characteristics of TensorFlow:

• Tensor flow has C++ implementations of Machine learning, which is highly efficient. Besides, it has custom C++ operations.
• Tensor flow runs on primary operating systems like Linux, Windows, and MacOS. Besides, it runs on a mobile operating system like Android, iOS.
• The TF layers, Pretty tensor and Keras are the high-level API. High-level API’s runs on the top of the tensor flow.
• For simple training routines, tensor flow provides simple API TF-slim (tensorflow.contrib.slim).
• For the reduction of a cost function, optimization nodes search for parameters. Tensor flow provides the optimization nodes, which reduces the cost of function.
• Tensor flow provides AutoDiff (Automatic Differentiating). AutoDiff automatically computes the slopes (gradients) of cost functions.
• Tensor flow provides the visualization tool, called as TensorBoard. Through TensorBoard, user able to view learning curves and computation graph.
• For the training of neural networks, tensor flow provides a small Python API called ‘TF.Learn’. It has a few lines of code.

Types of API, which Tensorflow supports

Tensor flow provides two kinds of API such as:

1. TensorFlow core API
2. A higher level of API

TensorFlow core API

TensorFlow core API is a low-level of API. This API used in low-level machine learning development. This API gives complete programming control. Besides, it provides a fine level of control. This API is suitable for machine learning Researchers.

A higher level of API

A higher level of API provides tf.layers and tf.contrib.learn API, which is more compact. These API present on the top of the tenser flow. Higher level API is easy to learn and use than TensorFlow core API. It makes the repeated task, smooth and more consistent between different users. The high-level API manages datasets, inference, estimators, and training.

What is Tensor?

A tensor is a central unit of data in tensorflow. Tensors are a generalization of Matrices, vectors, and scalars to an arbitrary number of indices. Matrices have exactly two indices, and vectors have single indices whereas scalars have no index.

Tensors are the inputs, outputs of tensor flow or multidimensional data array.

Mathematically tensor represents a physical entity that describes features by the magnitude and multiple directions.

Usually, tensors contain float values. Moreover, it carries strings in the form of byte arrays. Tensors travel among the nodes of computation graphs.

NumPy used for numerical computations, NumPy is a Python API.

What is TensorBoard?

For the visualization, Tensorflow provides the TensorBoard. This TensorBoard used to visualize the graph, to plot the quantitative metrics of the graph and pass the images through it.

Computational Graph or Data Flow Graph

In the computational graph, tensor flow operations arranged into graphs. Tensor flow builds a graph of ‘program logic’ in memory, that graph known as a computational graph. Tensor Flow uses the Data flow graph to represents the computations.

Computational graphs allow creating large scale neural networks as computing and distributed among several CPUs or GPUs (Graphical Processing Unit) similarly.

Nodes in the graph represent mathematical operations. A node represents the unit of computation. Operator: ‘+’ addition is the mathematical operation.

Edges in the graph represent a multi-dimensional data array called Tensors. Edges represent data consumed or produced by operation/ computation.

Input Tensor: X, Y

Output Tensor: Z

Example: Following tensor flow graph/ data flow graph/ computational graph represents

1. Single node corresponding addition operator.
2. Two incoming edges indicate the input to the operation.
3. The One outgoing edge indicates the output of the computation.

Parallelism:

Distributed Execution:

Portability:

Compilation:

What is the Default Computational Graph?

Tensor Flow Program Elements

1. Constant: The value, which does not change.

2. Placeholder: The Placeholder allows the value to assigned later.

3. Variable: A Variable is the value that can change. It’s value is not fix. it may or may not varry.

4. Session: A Session is an element of tensor flow and session runs to evaluate the nodes.A session called as Tensor flow Runtime.

5. feed_dict parameter: A feed_dict parameter instructs to the tensor, to pass the actual value to the placeholder.

Phases of Computational Graph

1. Construction Phase
2. Execution Phase
3. Initialization Phase
4. Initialization and Execution Phase

Products build using TensorFlow

1. Teachable Machine

2. Nsynth Super

3. Giorgio Camthat

4. Rank Brain

5. Deep Speech

Advantages of Tensorflow

1. Responsive Constructs: Tensorflow has responsive constructs. The user can easily visualize every graph. Moreover user able to visualize each part of the graph.
2. Platform Flexibility/ Cross Platform: Tensorflow is flexible with any platform. A tensorflow is a modular library. Tensorflow has some standalone parts, and some mingle/ consolidated part.
3. Easily Trainable: For distributed computing, Tensorflow is easily trainable on CPU and GPU.
4. Auto Differentiation Capability: Tensorflow has auto differentiation capabilities. Auto differentiation capability helps in gradient-based machine learning algorithms. To obtain the graph extension, the user can compute the derivation of values concerning other value. This process results in a graph extension.
5. Supports to threads, queue, and asynchronous computation: the Tensorflow supports asynchronous calculations. It supports to the concept of threads and queue.
6. Open source and Customizable: The Tensorflow is an open source library. Tensorflow is customizable means; it can modify any suite or separate task.

Disadvantages of Tensorflow

1. GPU memory conflicts: TensorFlow has some memory conflicts. These conflicts occurred only in GPU (Graphical Processing Unit) memory when Theano imported in the same scope. When imports in other scope conflicts do not occur.

2. No Support for OpenCL : Tensorflow does not support for OpenCL.

3. Need to have prior knowledge of Machine Learning, advanced Calculus and linear algebra: For understanding the concepts of tensorflow, the user must have a good understanding of Google Machine Learning. Moreover, the user must be clear with the ideas of advanced calculus and linear algebra.

Applications of TensorFlow

• Speech Recognition System
• Image/ Video Recognition
• Self-Driving Cars
• Text Summarization
• Sentiment Analysis
• Google translate