Object detection; MLPerf inference; TensorFlow CPU; COCO; 50 images validation; Linux; benchmark; Demo
Component: cr-solution:demo-obj-detection-coco-tf-cpu-benchmark-linux-demo (v1.5.0)
Added by: guillouh (2019-12-23 14:11:02)
Creation date: 2019-12-04 17:43:00
CID: 1dde4902b05ae08f:3b19c68f67d72f3fcr-solution:demo-obj-detection-coco-tf-cpu-benchmark-linux-demo  )

Sign up here to be notified when new results are reproduced or new CodeReef components are shared!

Related paper: MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Related and reproduced results (crowd-experiments): crowd-benchmarking-mlperf-inference-classification-mobilenets
How to get stable CodeReef version (under development):
  pip install codereef
  cr init demo-obj-detection-coco-tf-cpu-benchmark-linux-demo
  cr run demo-obj-detection-coco-tf-cpu-benchmark-linux-demo
  # If benchmarking is supported:
  cr benchmark demo-obj-detection-coco-tf-cpu-benchmark-linux-demo
Portable CK workflow:
  ck run program:object-detection-tf-py-benchmark --cmd_key=default
Host OS: linux-64 (Ubuntu 18.04.3 LTS)
Target OS: linux-64 (Ubuntu 18.04.3 LTS)
Target machine:
Target CPU: Intel(R) Core(TM) i5-7300HQ CPU @ 2.50GHz
Target CPUs:
Target GPU:
Python version for virtual env: 3.7.3

CodeReef client connection cr start

Dependencies on other components

Prerequisites for further automation:
   * https://github.com/mlperf/inference/tree/master/v0.5/classification_and_detection/optional_harness_ck/detection
   * https://github.com/mlperf/inference/blob/master/v0.5/classification_and_detection/optional_harness_ck/detection/tf-py/README.md
   This CodeReef solution demo was prepared by Grigori Fursin and Hervé Guillou (CodeReef).
   Ubuntu (need those deps to rebuild COCO API):
    sudo apt update
    sudo apt install git wget libz-dev curl cmake
    sudo apt install gcc g++ autoconf autogen libtool
    sudo apt-get install libfreetype6-dev
    sudo apt-get install python3.7-dev
   On some occasion we need to install extra deps:
    sudo apt install -y libsm6 libxext6 libxrender-dev

pip install gast pip install astor pip install termcolor pip install tensorflow-estimator==1.13.0 pip install keras_applications==1.0.4 --no-deps pip install keras_preprocessing==1.0.2 --no-deps pip install opencv-python ck install package:lib-tensorflow-1.14.0-cpu ck install package --tags=model,tf,object-detection,mlperf,ssd-mobilenet,non-quantized ck install package --tags=lib,python-package,numpy ck install package --tags=lib,python-package,scipy --force_version=1.2.1 ck install package --tags=lib,python-package,matplotlib ck install package --tags=lib,python-package,pillow ck install package --tags=lib,python-package,cython ck install package --tags=lib,python-package,cv2 ck install package:tool-coco ck install package:dataset-coco-2017-val-small

All versions:

All files (click to download):

Public comments

    Please log in to add your comment!

If you notice inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!