학술논문

In situ TensorView: In situ Visualization of Convolutional Neural Networks
Document Type
Conference
Source
2018 IEEE International Conference on Big Data (Big Data) Big Data (Big Data), 2018 IEEE International Conference on. :1899-1904 Dec, 2018
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Signal Processing and Analysis
Transportation
Data visualization
Training
Convolutional neural networks
Neurons
Trajectory
Pipelines
Deep Neural Networks
Neural Network Compression
Online Pruning
Language
Abstract
Convolutional Neural Networks(CNNs) are complex systems trained to recognize images, texts and more. However, once trained, they are regarded as black-boxes that are not easy to analyze and understand. Visualizing the dynamics within such deep artificial neural networks can provide a better understanding of how they are learning and making predictions. In the field of scientific simulations, visualization tools like Paraview have long been utilized to provide insights. We present in situ TensorView to visualize the training and functioning of CNNs as if they are systems of scientific simulations. In situ TensorView is a loosely coupled in situ visualization open framework that provides multiple viewers with the ability to visualize and understand their networks. It leverages the capability of co-processing from Paraview to provide real-time visualization during training and predicting phases, and avoids heavy I/O overhead. Tensorview is easily coupled with Tensorflow, as it only requires the insertion of a few lines of code into a TensorFlow framework. In this work, we showcase visualizing LeNet-5 and VGG16 using in situ TensorView. With the insight provided by Tensorview, users can adjust network architectures, or compress pre-trained networks guided by visualization results.