Skip to content

Commit b646f4e

Browse files
louie-tsaiashahba
authored andcommitted
Perf analysis notebooks among different data types (fp32/bf16/int8)
1 parent 9347bcf commit b646f4e

15 files changed

+2830
-202
lines changed

docs/notebooks/perf_analysis/README.md

+27-12
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,18 @@
11
# Introduction
22
## Jupyter Notebooks
33

4-
These Jupyter notebooks help users to analyze the performance benefit from using Intel Optimizations for Tensorflow with the oneDNN library.
5-
6-
| Notebook | Notes|
7-
| ------ | ------ |
8-
| benchmark_perf_comparison.ipynb | Compare performance between Stock and Intel Tensorflow among different models |
9-
| benchmark_perf_timeline_analysis.ipynb | Analyze the performance benefit from oneDNN among different layers by using Tensorflow Timeline |
4+
These Jupyter notebooks help users to analyze the performance benefit from using Intel® Optimizations for TensorFlow* with the oneDNN library.
5+
There are two different analysis type.
6+
* For the "stock vs. Intel Tensorflow" analysis type, users can understand the performance benefit between stock and Intel Tensorflow.
7+
* For the "fp32 vs. bf16 vs. int8" analysis type, users can understand the performance benefit among different data types on Intel Tensorflow.
8+
9+
10+
| Analysis Type | Notebook | Notes|
11+
| ------ | ------ | ------ |
12+
|stock vs. Intel Tensorflow | 1. [benchmark_perf_comparison](benchmark_perf_comparison.ipynb) | Compare performance between Stock and Intel Tensorflow among different models |
13+
|^| 2. [benchmark_perf_timeline_analysis](benchmark_perf_timeline_analysis.ipynb) | Analyze the performance benefit from oneDNN among different layers by using Tensorflow Timeline |
14+
|fp32 vs. bf16 vs. int8 | 1. [benchmark_data_types_perf_comparison](benchmark_data_types_perf_comparison.ipynb) | Compare Model Zoo benchmark performance among different data types on Intel Optimizations for Tensorflow |
15+
|^| 2.[benchmark_data_types_perf_timeline_analysis](benchmark_data_types_perf_timeline_analysis.ipynb) | Analyze the bf16/int8 data type performance benefit from oneDNN among different layers by using Tensorflow Timeline |
1016

1117
## Miscellaneous Files
1218

@@ -148,16 +154,25 @@ These Jupyter notebooks help users to analyze the performance benefit from using
148154
149155
## How to Run
150156
151-
1. Clone the Intel Model Zoo: `$git clone https://gitlab.devtools.intel.com/intelai/models.git`
157+
1. Clone the Intel Model Zoo: `$git clone https://github.com/IntelAI/models.git`
152158
2. Launch Jupyter notebook: `$jupyter notebook --ip=0.0.0.0`
153159
154160
> NOTE: Users don't need to apply step 2 on DevCloud Environment.
155161
156162
3. Follow the instructions to open the URL with the token in your browser
157163
4. Browse to the `models/docs/notebooks/perf_analysis` folder
158-
5. Click the `benchmark_perf_comparison.ipynb` or `benchmark_perf_timeline_analysis.ipynb` file
159-
6. Change your Jupyter notebook kernel to either "stock-tensorflow" or "intel-tensorflow" (highlighted in the diagram below)
160-
<br><img src="images/jupyter_kernels.png" width="300" height="300"><br>
161-
7. Run through every cell of the notebook one by one
164+
5. Click the 1st notebook file like `benchmark_perf_comparison.ipynb` or `benchmark_data_types_perf_comparison` from an analysis type.
165+
166+
> Note: For "stock v.s. Intel Tensorflow" analysis type, please change your Jupyter notebook kernel to either "stock-tensorflow" or "intel-tensorflow" (highlighted in the diagram below)
167+
<br><img src="images/jupyter_kernels.png" width="300" height="300"><br>
168+
169+
> Note: For "fp32 vs. bf16 vs. int8" analysis type, please select "intel-tensorflow" as your Jupyter notebook kernel.
170+
171+
6. Run through every cell of the notebook one by one
172+
173+
> NOTE: For "stock vs. Intel Tensorflow" analysis type, in order to compare between stock and Intel-optimized TF results in section "Analyze TF Timeline results among Stock and Intel Tensorflow", users need to run all cells before the comparison section with both stock-tensorflow and intel-tensorflow kernels.
174+
175+
7. Click the 2nd notebook file like `benchmark_perf_timeline_analysis.ipynb` or `benchmark_data_types_perf_timeline_analysis` from an analysis type.
176+
8. Run through every cell of the notebook one by one to get the analysis result.
162177
163-
> NOTE: In order to compare between stock and Intel-optimized TF results in section "Analyze TF Timeline results among Stock and Intel Tensorflow", users need to run all cells before the comparison section with both stock-tensorflow and intel-tensorflow kernels.
178+
> NOTE: There is no requirement for the Jupyter kernel when users run the 2nd notebook to analysis performance in detail.

0 commit comments

Comments
 (0)