|
1 | 1 | # Introduction
|
2 | 2 | ## Jupyter Notebooks
|
3 | 3 |
|
4 |
| -These Jupyter notebooks help users to analyze the performance benefit from using Intel Optimizations for Tensorflow with the oneDNN library. |
5 |
| - |
6 |
| -| Notebook | Notes| |
7 |
| -| ------ | ------ | |
8 |
| -| benchmark_perf_comparison.ipynb | Compare performance between Stock and Intel Tensorflow among different models | |
9 |
| -| benchmark_perf_timeline_analysis.ipynb | Analyze the performance benefit from oneDNN among different layers by using Tensorflow Timeline | |
| 4 | +These Jupyter notebooks help users to analyze the performance benefit from using Intel® Optimizations for TensorFlow* with the oneDNN library. |
| 5 | +There are two different analysis type. |
| 6 | +* For the "stock vs. Intel Tensorflow" analysis type, users can understand the performance benefit between stock and Intel Tensorflow. |
| 7 | +* For the "fp32 vs. bf16 vs. int8" analysis type, users can understand the performance benefit among different data types on Intel Tensorflow. |
| 8 | + |
| 9 | + |
| 10 | +| Analysis Type | Notebook | Notes| |
| 11 | +| ------ | ------ | ------ | |
| 12 | +|stock vs. Intel Tensorflow | 1. [benchmark_perf_comparison](benchmark_perf_comparison.ipynb) | Compare performance between Stock and Intel Tensorflow among different models | |
| 13 | +|^| 2. [benchmark_perf_timeline_analysis](benchmark_perf_timeline_analysis.ipynb) | Analyze the performance benefit from oneDNN among different layers by using Tensorflow Timeline | |
| 14 | +|fp32 vs. bf16 vs. int8 | 1. [benchmark_data_types_perf_comparison](benchmark_data_types_perf_comparison.ipynb) | Compare Model Zoo benchmark performance among different data types on Intel Optimizations for Tensorflow | |
| 15 | +|^| 2.[benchmark_data_types_perf_timeline_analysis](benchmark_data_types_perf_timeline_analysis.ipynb) | Analyze the bf16/int8 data type performance benefit from oneDNN among different layers by using Tensorflow Timeline | |
10 | 16 |
|
11 | 17 | ## Miscellaneous Files
|
12 | 18 |
|
@@ -148,16 +154,25 @@ These Jupyter notebooks help users to analyze the performance benefit from using
|
148 | 154 |
|
149 | 155 | ## How to Run
|
150 | 156 |
|
151 |
| -1. Clone the Intel Model Zoo: `$git clone https://gitlab.devtools.intel.com/intelai/models.git` |
| 157 | +1. Clone the Intel Model Zoo: `$git clone https://github.com/IntelAI/models.git` |
152 | 158 | 2. Launch Jupyter notebook: `$jupyter notebook --ip=0.0.0.0`
|
153 | 159 |
|
154 | 160 | > NOTE: Users don't need to apply step 2 on DevCloud Environment.
|
155 | 161 |
|
156 | 162 | 3. Follow the instructions to open the URL with the token in your browser
|
157 | 163 | 4. Browse to the `models/docs/notebooks/perf_analysis` folder
|
158 |
| -5. Click the `benchmark_perf_comparison.ipynb` or `benchmark_perf_timeline_analysis.ipynb` file |
159 |
| -6. Change your Jupyter notebook kernel to either "stock-tensorflow" or "intel-tensorflow" (highlighted in the diagram below) |
160 |
| - <br><img src="images/jupyter_kernels.png" width="300" height="300"><br> |
161 |
| -7. Run through every cell of the notebook one by one |
| 164 | +5. Click the 1st notebook file like `benchmark_perf_comparison.ipynb` or `benchmark_data_types_perf_comparison` from an analysis type. |
| 165 | +
|
| 166 | +> Note: For "stock v.s. Intel Tensorflow" analysis type, please change your Jupyter notebook kernel to either "stock-tensorflow" or "intel-tensorflow" (highlighted in the diagram below) |
| 167 | + <br><img src="images/jupyter_kernels.png" width="300" height="300"><br> |
| 168 | + |
| 169 | +> Note: For "fp32 vs. bf16 vs. int8" analysis type, please select "intel-tensorflow" as your Jupyter notebook kernel. |
| 170 | +
|
| 171 | +6. Run through every cell of the notebook one by one |
| 172 | +
|
| 173 | +> NOTE: For "stock vs. Intel Tensorflow" analysis type, in order to compare between stock and Intel-optimized TF results in section "Analyze TF Timeline results among Stock and Intel Tensorflow", users need to run all cells before the comparison section with both stock-tensorflow and intel-tensorflow kernels. |
| 174 | +
|
| 175 | +7. Click the 2nd notebook file like `benchmark_perf_timeline_analysis.ipynb` or `benchmark_data_types_perf_timeline_analysis` from an analysis type. |
| 176 | +8. Run through every cell of the notebook one by one to get the analysis result. |
162 | 177 |
|
163 |
| -> NOTE: In order to compare between stock and Intel-optimized TF results in section "Analyze TF Timeline results among Stock and Intel Tensorflow", users need to run all cells before the comparison section with both stock-tensorflow and intel-tensorflow kernels. |
| 178 | +> NOTE: There is no requirement for the Jupyter kernel when users run the 2nd notebook to analysis performance in detail. |
0 commit comments