Predicting Real-Time Neural Network Performance

Quantifying Performance

Timur Doumler shares more information on meeting real-time deadlines in audio programming.

What’s A Good Score?

Predicting Performance

  • Implement the relevant neural network layers (using SIMD instructions wherever possible).
  • Count the operations used by the neural network as a function of the network hyper-parameters.
  • Measure the network performance for a variety of hyper-parameter choices.
  • Use a regression to estimate how long each operation will take.

Example: Dense Network

Visualization of a Dense network with 2 inputs, 2 outputs, 2 hidden layers, and a hidden size of 8.
  • SIMD Multiplies + SIMD HSums + Scalar Adds: W * (N + L * W + O) / V
  • SIMD Adds: ((L + 1) * W + O) / V
  • SIMD Activations: (L + 1) * W / V
  • SIMD Multiplies + SIMD HSums + Scalar Adds: 5.45500463e-03 seconds
  • SIMD Adds: 1.47277176e-25 seconds
  • SIMD ReLU Activations: 7.23480113e-26
Real-Time Factor for Dense/ReLU and Dense/Tanh networks of a given size. Networks that fall above the red line are too slow to run in real-time at 48 kHz.

Example: Recurrent Networks

Real-Time Factor for LSTM and GRU networks of a given size.

Why Is This Useful?

Conclusion

--

--

--

Jatin Chowdhury is a student.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Acoustic sound localization (ASL)

Day -14 MLOPs

Building a Custom Semantic Segmentation Model

Kornia 0.6 — High Level Computer Vision for AI

Logistic Regression with StandardScaler-From the Scratch

Fraud Detection in the Age of Machine Learning

An Overview of the Various BERT Pre-Training Methods

Step-by-step understanding LSTM Autoencoder layers

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Jatin Chowdhury

Jatin Chowdhury

Jatin Chowdhury is a student.

More from Medium

Create a Bot to Find Diamonds in Minecraft

How to Extract Handwritten & Printed Text Accurately with DEEPREAD Free Form: Part 1

Performance Analysis: YoloV5 vs YoloR

NVIDIA Driver Installation on Computers and Jetson Embedded AI Development Cards