Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

OpenVINO resnet_50_v1 python example with VNNI #1582

Merged
merged 13 commits into from
Aug 30, 2019
Merged

OpenVINO resnet_50_v1 python example with VNNI #1582

merged 13 commits into from
Aug 30, 2019

Conversation

aqtjin
Copy link
Contributor

@aqtjin aqtjin commented Aug 22, 2019

No description provided.

qiyuangong
qiyuangong reviewed Aug 22, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/inference.py Outdated

predictions = model.predict(image_set)

result = np.swapaxes(predictions,0,1)[0]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code style.

qiyuangong
qiyuangong reviewed Aug 22, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/inference.py Outdated
"can be either a folder or an image path")
parser.add_option("--model", type=str, dest="model_path",
help="Zoo Model Path")
parser.add_option("--partition_num", type=int, dest="partition_num", default=4,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think partition_num is necessary. Because current example is a local example. :)

qiyuangong
qiyuangong reviewed Aug 22, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/inference.py Outdated

(options, args) = parser.parse_args(sys.argv)

predict(options.model_path, options.img_path, options.partition_num)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add a blank line at the end of file.

@qiyuangong qiyuangong changed the title resnet_50_v1 example OpenVINO resnet_50_v1 python example Aug 22, 2019
qiyuangong
qiyuangong reviewed Aug 22, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/inference.py Outdated
@@ -0,0 +1,48 @@
import sys
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add copyright https://github.com/intel-analytics/analytics-zoo/blob/master/pyzoo/zoo/examples/openvino/predict.py#L1

qiyuangong
qiyuangong reviewed Aug 27, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/inference.py Outdated
image_set = np.expand_dims(image_set, axis=1)

if len(image_set) % batch_size == 0:
a = 0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pls use more meaningful variable name.

qiyuangong
qiyuangong reviewed Aug 27, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/inference.py Outdated
for i in range(len(image_set) // batch_size + a):
index = i * batch_size
batch = image_set[index]
for j in range(index + 1, index + size):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Size used here is not correct. For example,

batch_size = 4
len(image_set)==11
size = 11 % 4 = 3

Then, you will only take 3 images for each batch.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you can use min(index + batch_size, len(image_set)) in this place. Such that you don't need a and size.

qiyuangong
qiyuangong reviewed Aug 28, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/README.md
* `--partition_num` The number of partitions.

## Results
We print the inference result of each batch.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pls add detailed running command for this example. :)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any sample output to put here?

qiyuangong
qiyuangong reviewed Aug 28, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/README.md Outdated
## PrepareOpenVINOResNet
TensorFlow models cannot be directly loaded by OpenVINO. It should be converted to OpenVINO optimized model and int8 optimized model first. You can use PrepareOpenVINOResNet or [OpenVINO toolkit](https://docs.openvinotoolkit.org/2018_R5/_docs_MO_DG_prepare_model_convert_model_Convert_Model_From_TensorFlow.html) to finish this job. Herein, we focused on PrepareOpenVINOResNet.

Download [TensorFlow ResNet50_v1](http://download.tensorflow.org/models/resnet_v1_50_2016_08_28.tar.gz), [validation image set](https://s3-ap-southeast-1.amazonaws.com/analytics-zoo-models/openvino/val_bmp_32.tar) and [OpenCVLibs](https://s3-ap-southeast-1.amazonaws.com/analytics-zoo-models/openvino/opencv_4.0.0_ubuntu_lib.tar). Extract files from these packages.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can just add a link to original document and remove model convert section.

@qiyuangong qiyuangong changed the title OpenVINO resnet_50_v1 python example OpenVINO resnet_50_v1 python example with VNNI Aug 28, 2019
hkvision
hkvision reviewed Aug 28, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/README.md Outdated
Follow the instructions [here](https://analytics-zoo.github.io/master/#PythonUserGuide/install/) to install analytics-zoo via __pip__ or __download the prebuilt package__.

## PrepareOpenVINOResNet
TensorFlow models cannot be directly loaded by OpenVINO. It should be converted to OpenVINO optimized model and int8 optimized model first. You can use PrepareOpenVINOResNet or [OpenVINO toolkit](https://docs.openvinotoolkit.org/2018_R5/_docs_MO_DG_prepare_model_convert_model_Convert_Model_From_TensorFlow.html) to finish this job. Herein, we focused on PrepareOpenVINOResNet.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

and -> or?
focused -> focus?

hkvision
hkvision reviewed Aug 28, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/README.md Outdated
resnet_v1_50_inference_graph.xml
```

Amount them, `resnet_v1_50_inference_graph.xml` and `resnet_v1_50_inference_graph.bin` are OpenVINO optimized ResNet_v1_50 model and weight, `resnet_v1_50_inference_graph-calibrated.xml` and `resnet_v1_50_inference_graph-calibrated.bin` are OpenVINO int8 optimized ResNet_v1_50 model and weight. Both of them can be loaded by OpenVINO or Zoo.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

amount or among?

qiyuangong
qiyuangong reviewed Aug 29, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/README.md Outdated
* Apache Spark (This version needs to be same with the version you use to build Analytics Zoo)
* [Analytics Zoo](https://analytics-zoo.github.io/master/#PythonUserGuide/install/)

Environment Setting:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove this line. It is duplicate with ## Environment.

qiyuangong
qiyuangong reviewed Aug 29, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/README.md
### Results
We print the inference result of each batch.
```
[ INFO ] Start inference (1 iterations)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove FPS related performance log.

qiyuangong
qiyuangong reviewed Aug 29, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/inference.py Outdated
from zoo.feature.image import *
from zoo.pipeline.nnframes import *

batch_size = 4
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

global variable should in up case

qiyuangong
qiyuangong reviewed Aug 29, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/README.md
Environment Setting:
- Set `ZOO_NUM_MKLTHREADS` to determine cores used by OpenVINO, e.g, `export ZOO_NUM_MKLTHREADS=10`. If it is set to `all`, e.g., `export ZOO_NUM_MKLTHREADS=all`, then OpenVINO will utilize all physical cores for Prediction.
- Set `KMP_BLOCKTIME=200`, i.e., `export KMP_BLOCKTIME=200`

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One blank line is enough

qiyuangong
qiyuangong reviewed Aug 29, 2019
View reviewed changes
pyzoo/zoo/examples/vnni/openvino/README.md Outdated
## Image Classification with ResNet_v1_50

```
python inference.py --image ${image} --model ${model}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pls change inference.py to predict.py to align with existing examples.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change inference.py to predict.py in README.md.

@aqtjin
Copy link
Contributor Author

aqtjin commented Aug 30, 2019

http://10.239.47.211:18888/job/ZOO-PR-Validation/2578/console @qiyuangong

qiyuangong
qiyuangong approved these changes Aug 30, 2019
View reviewed changes
Copy link
Contributor

@qiyuangong qiyuangong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@qiyuangong qiyuangong merged commit 9a62665 into intel-analytics:master Aug 30, 2019
Litchilitchy pushed a commit that referenced this pull request Nov 14, 2019
Inference tensorboard (#1752)
b110146 
* fix bn param copy (#1554)

* bigdl-old-caffeloader

* zoo-new-caffeloader

* move convert after layer creation

* fix recursion

* delete unused converter

* fix copy of old bn params

* SessionRecommender python api and example (#1465)

* session recommender python

* fix release bug of AbstractInferenceModel (#1556)

* fix release bug of AbstractInferenceModel

* fix release bug of AbstractInferenceModel

* fix bug

* fix session recommender (#1558)

* Pytorch training and inference for model with multiple output and multiple input (#1544)

* inference with table output

* add unit test

* multi and unit test

* remove duplicate ut

* clear caching data

* support multiple shape

* multi input ut

* release

*  remove empty line

* update so

* Session recommender document (#1559)

* add document for session recommender

* Bert inference perf improve (#1555)

Split big Dense into several small dense in TransformerLayer
Ensure bert is using MKL to do math operations.

* modify run-pytests to check version before test ray (#1532)

* Create .keep

* update .keep path

* add rl_pong example

* move to rl_pong direction

* remove original file

* add parameter server example

* add license

* PEP8 checks

* PEP8 checks

* Add into integration test

* Wrap tests into bash function

* Update license

* PEP8 checks

* Correct syntax of rl_pong

* modify run-pytests to check version before test ray

* test pyspark version and spark home

* add check spark_home's pyspark in case pyspark can't be found

* add check version before run ray examples

* change spark home

* change spark home

* install packages which are needed in ray examples

* check error

* fix error

* change execution to spark-submit

* change memory

* change object memory to test

* add atari_py dependency

* remove .keep

* move ray test to new files

* change some ray-pip lines into function

* remove rl_pong and fix parameter_server iterations

* add iteration

* change iterate, print info

* add more info

* add __init__ files

* change ray to rayexample to avoid conflict and change spark-submit to python to submit tasks

* renamed foreach_evaluator to foreach_worker because rllib update and rename file rllib to rllibexample

* add a dedicated file for the ray test

* PEP8 check fix

* PEP8 check fix

* remove test_split

* remove --doctest-modules about ray

* add time.sleep

* pytorch doc and example update. (#1560)

* pytorch doc

* update example

* remove transfomer

* doc and example update

* fix sample_input

* check none

* param update

* check trace

* Update Dockerfile

* update powerby page  (#1542)

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Make keras datasets to a package (#1562)

* update

* add datasets package

* add license

* support multi input models for nnframes (#1553)

* support multi input for nnframes

* update ut

* add doc and unit test

* doc update

* scala style

* create temp file with minimal permissions (#1565)

* create temp file with minimal permissions

* fix unit test

* fix style check

* Add optim method option in TFOptimizer.from_keras (#1574)

* Add Polynomial Decay based on epochs (#1575)

* poly on epoch

* doc and ut

* style

* Simple TFNet and NNFrames example  (#1580)

* TFNet example

* comments

* Add session_recommender into Scala integration-test (#1561)

* integration-test

* Update integration-test.robot

* Update integration-test.robot

* Update integration-test.robot

* Update integration-test.robot

* Update integration-test.robot

* Update integration-test.robot

* support reading tfrecord in tfdataset (#1584)

* support reading tfrecord in tfdataset

* add doc and test

* fix style

* fix dependency

* fix test

* add resource file

* refactor test

* fix style

* address comment

* add test back

* fix style

* fix tests

* fix python 3.5

* Flink example (#1586)

* Restnet50 example

* Resnet50 example

* add README

* update flink example

* update Flink example

* update Flink example

* update Flink example

* update Flink example

* Update README.md

* Update README.md

* Update README.md

* OpenVINO resnet_v1_50 python example with VNNI (#1582)

* This Python resnet_v1_50 example support both fp32 and int8 OpenVINO model. Replacing fp32 model path with int8 model path will give you better performance.
* VNNI: If the running platform has VNNI instruction, then using int8 quantized models can generally give you additional performance boost.

* Fix openvino VNNI doc typo (#1590)

* Fix ZOO_NUM_MKLTHREADS
* Fxi typo

* Support TensorFlow metric in TFOptimizer (#1593)

* test

* support stateless metric

* support metric in TFOptimizer

* fix tests

* fix style

* add tests

* fix ray and add more test (#1596)

* fix ray and add more test

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* modify raycontext and move test file to func

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* modify process and add sc.stop in the end

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* delete one repeat and check PEP8

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* change file name and remove some useless code

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* rename test yarn reinit file

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* ignore test reinit raycontext

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* Save Keras-like model to pure keras or tensorflow protobuf. (#1600)

* checkpoint

* some update

* refine api

* some update

* fix build fail

* meet code review

* style check

* fix typo

* fix style check

* Update visualization.md (#1461)

* update snapshot release for bigdl 0.9.1 (#1605)

* Add Estimator Python API and Inception Example (#1597)

* Using non-freezing graph for TF training (#1488)

* support unfreeze training

* support two version

* fix

* fix

* fix test

* fix test

* fix test

* fix tests

* reduce test

* add tests back

* fix style

* split tests

* isolate tfpark tests

* change back tfnet

* add multi thread sample to minibatch (#1589)

* add mt sample to minibatch

* revert log level

* delete some debug code

* add comments

* fix style check

* update pom

* Fix confusing scaler variable name (#1608)

* Fix imageset read relative path (#1610)

* fix imageset read relative path

* get relative path

* Update build.sh (#1618)

* Fix typo in ChannelScaledNormalizer (#1619)

* Fix predict batch size in anomaly_detection.py (#1614)

* Fix predict batch size in anomaly_detection.py
* Add `input_dir` check to avoid NonType error.
* Add usage.

* NNFrames: support caching training data on Disk (#1588)

* disk cache for NNFrames

* update doc and example

* update train method

* fix style

* fix ut

* fix ut

* Enable submit scala application (#1624)

* refactor scripts

* fix

* change docs

* fix image preprocessing (#1632)

* Resnet50 example

* add README

* update Flink example

* load various images

* update

* solve image preprocess

* add labels

* fix images processing

* Update ImageClassificationStreaming.scala

* delete the image in resources

* fix pytroch on yarn model output is NaN (#1625)

* add yarn mode

* fix pytroch on yarn Nan

* fix

* fix predict

* delete debug code

* move evaluate to mappartition

* update resnet-finetune

* update resnet-finetune

* Update README.md

* Update README.md

* Update README.md

* save TorchNet as Pytorch script module (#1564)

* support save pytorch model to script

* unit test

* use temp folder

* add import

* correct evaluate

* import

* style fix

* pytorch native code cleanup (#1642)

* code clean

* remove load

* fix style

* Support TorchNet save load with NNFrames (#1645)

* nnestimator

* nnestimator

* Save KerasModel to pure keras or tf protobuf (#1606)

* checkpoint

* add unit test

* revert neuralCF

* revert neuralCF

* some update

* some update

* some change

* update bigdl to 0.9.1 (#1648)

* add execute permission (#1651)

* restructure tfpark examples (#1654)

* restructure examples

* fix test scripts

* fix license

* Fix invalid cross-device and filesystem closed issues in Streaming examples (#1656)

* Fix Invalid cross-device link in image_path_writer.py.
* Fix HDFS filesystem closed issue in ImagePathWriter and StreamingObjectDetection.
* Modify document.

* Update doc link for image classification (#1663)

* Dockerfile (#1664)

* remove py27 in Dockerfile

* Update Dockerfile

* Expose PyTorch to doc/programming guide  (#1653)

* Update mkdocs.yml

* Update mkdocs.yml

* doc for rayonspark (#1669)

* update TFOptimizer doc (#1658)

* update doc

* address comments

* add file link

* fix style

* Clean up dist-mac (#1666)

* Clean up dist-mac.
* Modify mac openvino bin path.

* update Featureset apiguide (#1680)

* Update featureset.md

* Update featureset.md

* Update featureset.md

* Update FeatureSet.scala

* Fix sentiment numpy issue and docker file issue (#1650)

* sentiment

* Add lib6

* doc

* change to tfnet readme to using bash shell (#1682)

* Fix transformer example and update doc (#1676)

* fix and update doc

* meet review

* minor

* fix typo

* improve TFPark readme (#1684)

* improve readme

* fix path

* change sh to bash

* Add Estimator Doc (#1687)

* Add Estimator Doc

* Add estimator to mkdocs

* Replace \ with <br>

* Fix

* Modify vnni openvino example doc (#1691)

* Use full path to avoid calibration error.

* change <mainClass> and version in pom.xml (#1667)

* change <mainClass> and version in pom.xml

* update bigdl version to 0.9.1

* Update release-download.md (#1698)

* update doc links in master (#1700)

* Update release-docs.md

* Update release-docs.md

* Autoencoder (#1436)

* add anomaly-detection-hd
* modified according to comments
* Data download sccipt added
* visualization optimized
* minor fix
* typo correction
* refactor autoencoder

* Update README.md

* Update index.md

* Update README.md

* fix link (#1711)

* Reduce openvino debug logs (#1713)

* Replace OpenVINO related decompression output with one line log info.
* Remove unnecessary `ls`.

* bump to 0.7.0-S (#1719)

* bump to 0.7.0-SNAPSHOT

* TFNet support load saved model (#1714)

* add tests

* add comments

* skip serialization test

* fix style

* fix bug (#1730)

* Update release-download.md (#1721)

* Upgrade pip bigdl dependency to 0.9.1 (#1709)

* upgrade

* update doc

* Update RayOnSpark doc (#1732)

* update ray doc and pip doc

* update

* update Spark Summit talks and slides in powerby and presentation  (#1734)

* Update presentations.md

* Update powered-by.md

* Update presentations.md (#1737)

* Minor fix for detecting sc is local (#1735)

* fix sc local

* update

* Update powered-by.md (#1739)

* Add tfpark example test (#1736)

* add tfpark example test

* fix path

* add pip

* Update powered-by.md (#1741)

* fix script (#1740)

* Support iterate a dataset in sequential order when training (#1743)

* support iterate a dataset in sequential order when training

add unit test

fix style

* unpersist

* fix bug

* [Bug Fix] Fix estimator python validation method argument type bug (#1746)

* fix estimator validation method argument type bug

* fix style

* handle null

* fix estimator NPE problem (#1750)

* add load TF saved model as TFNet inference model  (#1745)

* Refine OpenVINO VNNI Perf (#1726)

* Add pure Scala Perf for Resnet.
* Refine document and log.

* TFoptimizer use analytics-zoo estimator (#1749)

* tfoptimizer use analytics-zoo estimator

* fix style

* fix bug

* fix tests and add documents

* fix style

* fix test

* fix example

* fix test

* fix tests

* fix tests

* always repartition

* Fix CategoricalCrossEntropy may NaN. (#1705)

* clip in categoricalCrossEntropy

* add unit test

* clean up

* remove bigdl engine init (#1753)

* Update powered-by.md (#1756)

* update bigdl version to 0.10.0 (#1757)

* update ut for inference model to test no bigdl properties (#1758)

* local estimator and lenet resnet example (#1725)

* local estimator and lenet resnet example

* add params to examples

* add params to examples

* fix style issue

* fix typo

* change to abstract module

* fix tfnet bug and add transfer learning example

* change val to args

* update

* update

* add scala doc

* add scala doc

* Add files via upload

* Delete boston_housing.py

* scala serving v1

* loader

* docker of serving;

* serving folder structure and config yaml

* struture change

* deleted pom

* pom

* Update README.md

* Update README.md

* mod

* yaml parsing and bash rename

* final mod of forward

* add img cls and obj detect

* Update README.md

* switch to inference model

* naming loader to helper

* naming

* Inf Model Concur, Dockerfile order, log

* params limit

* result format and api instructions and dummy label map

* multiple model checking

* Update README.md

* Update README.md

* dynamic load foreachBatch

* revert pom.xml

* exception handling fix

* style fix

* delete those not used for this version

* style fix

* license

* style

* style fix;

* style

* tensorboard-inference;

* inference throughput

* inference-tensorboard

* fix inference bug

* 1244

* pom for serving

* blas support
Litchilitchy pushed a commit that referenced this pull request Nov 22, 2019
Inf tfboard seperated (#1786)
4d0906b 
* fix bn param copy (#1554)

* bigdl-old-caffeloader

* zoo-new-caffeloader

* move convert after layer creation

* fix recursion

* delete unused converter

* fix copy of old bn params

* SessionRecommender python api and example (#1465)

* session recommender python

* fix release bug of AbstractInferenceModel (#1556)

* fix release bug of AbstractInferenceModel

* fix release bug of AbstractInferenceModel

* fix bug

* fix session recommender (#1558)

* Pytorch training and inference for model with multiple output and multiple input (#1544)

* inference with table output

* add unit test

* multi and unit test

* remove duplicate ut

* clear caching data

* support multiple shape

* multi input ut

* release

*  remove empty line

* update so

* Session recommender document (#1559)

* add document for session recommender

* Bert inference perf improve (#1555)

Split big Dense into several small dense in TransformerLayer
Ensure bert is using MKL to do math operations.

* modify run-pytests to check version before test ray (#1532)

* Create .keep

* update .keep path

* add rl_pong example

* move to rl_pong direction

* remove original file

* add parameter server example

* add license

* PEP8 checks

* PEP8 checks

* Add into integration test

* Wrap tests into bash function

* Update license

* PEP8 checks

* Correct syntax of rl_pong

* modify run-pytests to check version before test ray

* test pyspark version and spark home

* add check spark_home's pyspark in case pyspark can't be found

* add check version before run ray examples

* change spark home

* change spark home

* install packages which are needed in ray examples

* check error

* fix error

* change execution to spark-submit

* change memory

* change object memory to test

* add atari_py dependency

* remove .keep

* move ray test to new files

* change some ray-pip lines into function

* remove rl_pong and fix parameter_server iterations

* add iteration

* change iterate, print info

* add more info

* add __init__ files

* change ray to rayexample to avoid conflict and change spark-submit to python to submit tasks

* renamed foreach_evaluator to foreach_worker because rllib update and rename file rllib to rllibexample

* add a dedicated file for the ray test

* PEP8 check fix

* PEP8 check fix

* remove test_split

* remove --doctest-modules about ray

* add time.sleep

* pytorch doc and example update. (#1560)

* pytorch doc

* update example

* remove transfomer

* doc and example update

* fix sample_input

* check none

* param update

* check trace

* Update Dockerfile

* update powerby page  (#1542)

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Update powered-by.md

* Make keras datasets to a package (#1562)

* update

* add datasets package

* add license

* support multi input models for nnframes (#1553)

* support multi input for nnframes

* update ut

* add doc and unit test

* doc update

* scala style

* create temp file with minimal permissions (#1565)

* create temp file with minimal permissions

* fix unit test

* fix style check

* Add optim method option in TFOptimizer.from_keras (#1574)

* Add Polynomial Decay based on epochs (#1575)

* poly on epoch

* doc and ut

* style

* Simple TFNet and NNFrames example  (#1580)

* TFNet example

* comments

* Add session_recommender into Scala integration-test (#1561)

* integration-test

* Update integration-test.robot

* Update integration-test.robot

* Update integration-test.robot

* Update integration-test.robot

* Update integration-test.robot

* Update integration-test.robot

* support reading tfrecord in tfdataset (#1584)

* support reading tfrecord in tfdataset

* add doc and test

* fix style

* fix dependency

* fix test

* add resource file

* refactor test

* fix style

* address comment

* add test back

* fix style

* fix tests

* fix python 3.5

* Flink example (#1586)

* Restnet50 example

* Resnet50 example

* add README

* update flink example

* update Flink example

* update Flink example

* update Flink example

* update Flink example

* Update README.md

* Update README.md

* Update README.md

* OpenVINO resnet_v1_50 python example with VNNI (#1582)

* This Python resnet_v1_50 example support both fp32 and int8 OpenVINO model. Replacing fp32 model path with int8 model path will give you better performance.
* VNNI: If the running platform has VNNI instruction, then using int8 quantized models can generally give you additional performance boost.

* Fix openvino VNNI doc typo (#1590)

* Fix ZOO_NUM_MKLTHREADS
* Fxi typo

* Support TensorFlow metric in TFOptimizer (#1593)

* test

* support stateless metric

* support metric in TFOptimizer

* fix tests

* fix style

* add tests

* fix ray and add more test (#1596)

* fix ray and add more test

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* modify raycontext and move test file to func

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* modify process and add sc.stop in the end

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* delete one repeat and check PEP8

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* change file name and remove some useless code

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* rename test yarn reinit file

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* ignore test reinit raycontext

Signed-off-by: Jieru Hong <hongjieru30@gmail.com>

* Save Keras-like model to pure keras or tensorflow protobuf. (#1600)

* checkpoint

* some update

* refine api

* some update

* fix build fail

* meet code review

* style check

* fix typo

* fix style check

* Update visualization.md (#1461)

* update snapshot release for bigdl 0.9.1 (#1605)

* Add Estimator Python API and Inception Example (#1597)

* Using non-freezing graph for TF training (#1488)

* support unfreeze training

* support two version

* fix

* fix

* fix test

* fix test

* fix test

* fix tests

* reduce test

* add tests back

* fix style

* split tests

* isolate tfpark tests

* change back tfnet

* add multi thread sample to minibatch (#1589)

* add mt sample to minibatch

* revert log level

* delete some debug code

* add comments

* fix style check

* update pom

* Fix confusing scaler variable name (#1608)

* Fix imageset read relative path (#1610)

* fix imageset read relative path

* get relative path

* Update build.sh (#1618)

* Fix typo in ChannelScaledNormalizer (#1619)

* Fix predict batch size in anomaly_detection.py (#1614)

* Fix predict batch size in anomaly_detection.py
* Add `input_dir` check to avoid NonType error.
* Add usage.

* NNFrames: support caching training data on Disk (#1588)

* disk cache for NNFrames

* update doc and example

* update train method

* fix style

* fix ut

* fix ut

* Enable submit scala application (#1624)

* refactor scripts

* fix

* change docs

* fix image preprocessing (#1632)

* Resnet50 example

* add README

* update Flink example

* load various images

* update

* solve image preprocess

* add labels

* fix images processing

* Update ImageClassificationStreaming.scala

* delete the image in resources

* fix pytroch on yarn model output is NaN (#1625)

* add yarn mode

* fix pytroch on yarn Nan

* fix

* fix predict

* delete debug code

* move evaluate to mappartition

* update resnet-finetune

* update resnet-finetune

* Update README.md

* Update README.md

* Update README.md

* save TorchNet as Pytorch script module (#1564)

* support save pytorch model to script

* unit test

* use temp folder

* add import

* correct evaluate

* import

* style fix

* pytorch native code cleanup (#1642)

* code clean

* remove load

* fix style

* Support TorchNet save load with NNFrames (#1645)

* nnestimator

* nnestimator

* Save KerasModel to pure keras or tf protobuf (#1606)

* checkpoint

* add unit test

* revert neuralCF

* revert neuralCF

* some update

* some update

* some change

* update bigdl to 0.9.1 (#1648)

* add execute permission (#1651)

* restructure tfpark examples (#1654)

* restructure examples

* fix test scripts

* fix license

* Fix invalid cross-device and filesystem closed issues in Streaming examples (#1656)

* Fix Invalid cross-device link in image_path_writer.py.
* Fix HDFS filesystem closed issue in ImagePathWriter and StreamingObjectDetection.
* Modify document.

* Update doc link for image classification (#1663)

* Dockerfile (#1664)

* remove py27 in Dockerfile

* Update Dockerfile

* Expose PyTorch to doc/programming guide  (#1653)

* Update mkdocs.yml

* Update mkdocs.yml

* doc for rayonspark (#1669)

* update TFOptimizer doc (#1658)

* update doc

* address comments

* add file link

* fix style

* Clean up dist-mac (#1666)

* Clean up dist-mac.
* Modify mac openvino bin path.

* update Featureset apiguide (#1680)

* Update featureset.md

* Update featureset.md

* Update featureset.md

* Update FeatureSet.scala

* Fix sentiment numpy issue and docker file issue (#1650)

* sentiment

* Add lib6

* doc

* change to tfnet readme to using bash shell (#1682)

* Fix transformer example and update doc (#1676)

* fix and update doc

* meet review

* minor

* fix typo

* improve TFPark readme (#1684)

* improve readme

* fix path

* change sh to bash

* Add Estimator Doc (#1687)

* Add Estimator Doc

* Add estimator to mkdocs

* Replace \ with <br>

* Fix

* Modify vnni openvino example doc (#1691)

* Use full path to avoid calibration error.

* change <mainClass> and version in pom.xml (#1667)

* change <mainClass> and version in pom.xml

* update bigdl version to 0.9.1

* Update release-download.md (#1698)

* update doc links in master (#1700)

* Update release-docs.md

* Update release-docs.md

* Autoencoder (#1436)

* add anomaly-detection-hd
* modified according to comments
* Data download sccipt added
* visualization optimized
* minor fix
* typo correction
* refactor autoencoder

* Update README.md

* Update index.md

* Update README.md

* fix link (#1711)

* Reduce openvino debug logs (#1713)

* Replace OpenVINO related decompression output with one line log info.
* Remove unnecessary `ls`.

* bump to 0.7.0-S (#1719)

* bump to 0.7.0-SNAPSHOT

* TFNet support load saved model (#1714)

* add tests

* add comments

* skip serialization test

* fix style

* fix bug (#1730)

* Update release-download.md (#1721)

* Upgrade pip bigdl dependency to 0.9.1 (#1709)

* upgrade

* update doc

* Update RayOnSpark doc (#1732)

* update ray doc and pip doc

* update

* update Spark Summit talks and slides in powerby and presentation  (#1734)

* Update presentations.md

* Update powered-by.md

* Update presentations.md (#1737)

* Minor fix for detecting sc is local (#1735)

* fix sc local

* update

* Update powered-by.md (#1739)

* Add tfpark example test (#1736)

* add tfpark example test

* fix path

* add pip

* Update powered-by.md (#1741)

* fix script (#1740)

* Support iterate a dataset in sequential order when training (#1743)

* support iterate a dataset in sequential order when training

add unit test

fix style

* unpersist

* fix bug

* [Bug Fix] Fix estimator python validation method argument type bug (#1746)

* fix estimator validation method argument type bug

* fix style

* handle null

* fix estimator NPE problem (#1750)

* add load TF saved model as TFNet inference model  (#1745)

* Refine OpenVINO VNNI Perf (#1726)

* Add pure Scala Perf for Resnet.
* Refine document and log.

* TFoptimizer use analytics-zoo estimator (#1749)

* tfoptimizer use analytics-zoo estimator

* fix style

* fix bug

* fix tests and add documents

* fix style

* fix test

* fix example

* fix test

* fix tests

* fix tests

* always repartition

* Fix CategoricalCrossEntropy may NaN. (#1705)

* clip in categoricalCrossEntropy

* add unit test

* clean up

* remove bigdl engine init (#1753)

* Update powered-by.md (#1756)

* update bigdl version to 0.10.0 (#1757)

* update ut for inference model to test no bigdl properties (#1758)

* local estimator and lenet resnet example (#1725)

* local estimator and lenet resnet example

* add params to examples

* add params to examples

* fix style issue

* fix typo

* change to abstract module

* fix tfnet bug and add transfer learning example

* change val to args

* update

* update

* add scala doc

* add scala doc

* inference-tensorboard
sgwhat pushed a commit to sgwhat/analytics-zoo that referenced this pull request Oct 15, 2021
@aqtjin
OpenVINO resnet_v1_50 python example with VNNI (intel-analytics#1582)
49e045b 
* This Python resnet_v1_50 example support both fp32 and int8 OpenVINO model. Replacing fp32 model path with int8 model path will give you better performance.
* VNNI: If the running platform has VNNI instruction, then using int8 quantized models can generally give you additional performance boost.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@hkvision hkvision hkvision left review comments

@qiyuangong qiyuangong qiyuangong approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@aqtjin @qiyuangong @hkvision