Object detection; MLPerf inference; TensorFlow CPU; COCO; 50 images validation; Linux; benchmark; Portable Workflows
Component: cr-solution:demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows (v1.1.1)
Added by: guillouh (2020-01-14 15:21:34)
Creation date: 2019-12-18 16:28:10
CID: 1dde4902b05ae08f:4a878a967f3636b9cr-solution:demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows  )

Sign up here to be notified when new results are reproduced or new CodeReef components are shared!

Related paper: MLPerf Inference Benchmark
Related and reproduced results (crowd-experiments): sota-mlperf-object-detection-v0.5-crowd-benchmarking
How to get stable CodeReef version (under development):
  pip install codereef
  cr init demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows
  cr run demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows
  # If benchmarking is supported:
  cr benchmark demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows
Portable CK workflow:
  ck run program:object-detection-tf-py-benchmark --cmd_key=default
Host OS: linux-64 (Ubuntu 18.04.3 LTS)
Target OS: linux-64 (Ubuntu 18.04.3 LTS)
Target machine:
Target CPU: Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz
Target CPUs:
Target GPU:
Python version for virtual env:

CodeReef client connection cr start

Dependencies on other components

Prerequisites for further automation:
   # Tested on Ubuntu 18.04
   # (including Docker and Windows 10 Sybsystem for Linux)
   # These dependencies are needed to rebuild COCO API:
   sudo apt update
   sudo apt install git wget libz-dev curl cmake
   sudo apt install gcc g++ autoconf autogen libtool
   sudo apt install libfreetype6-dev
   sudo apt install python3.7-dev
   sudo apt install -y libsm6 libxext6 libxrender-dev

cr download --version=1.0.0 --force package:model-tf-mlperf-ssd-mobilenet cr download --version=1.0.0 --force soft:model.tensorflow.object-detection cr download --version=1.0.0 --force script:install-package-tensorflowmodel-object-detection cr download --version=1.0.0 --force package:lib-python-numpy cr download --version=1.0.0 --force soft:lib.python.numpy cr download --version=1.0.0 --force package:lib-python-scipy cr download --version=1.0.0 --force soft:lib.python.scipy cr download --version=1.0.0 --force package:lib-python-matplotlib cr download --version=1.0.0 --force soft:lib.python.matplotlib cr download --version=1.0.0 --force package:lib-python-pillow cr download --version=1.0.0 --force soft:lib.python.pillow cr download --version=1.0.0 --force package:lib-python-cython cr download --version=1.0.0 --force soft:lib.python.cython cr download --version=1.0.0 --force package:lib-python-cv2 cr download --version=1.0.0 --force soft:lib.python.cv2 cr download --version=1.0.0 --force package:tool-coco-codereef cr download --version=1.0.0 --force soft:tool.coco cr download --version=1.0.0 --force package:dataset-coco-2017-val-small cr download --version=1.0.0 --force soft:dataset.coco.2017.val cr download --version=1.0.0 --force package:lib-tensorflow-1.1.0-cpu cr download --version=1.0.0 --force package:lib-tensorflow-1.4.0-cpu cr download --version=1.0.0 --force package:lib-tensorflow-1.14.0-cpu cr download --version=1.0.0 --force soft:lib.tensorflow cr download --version=1.0.0 --force package:labelmap-coco cr download --version=1.0.0 --force soft:labelmap.object-detection cr download --version=1.0.0 --force soft:compiler.gcc cr download --version=1.0.0 --force package:tensorflowmodel-api-object-detection cr download --version=1.0.0 --force soft:model.tensorflow-models-api cr download --version=1.0.0 --force package:lib-protobuf-3.0.0-host cr download --version=1.0.0 --force soft:lib.protobuf.host cr download --version=1.0.0 --force script:process-compiler-for-cmake cr download --version=1.0.0 --force soft:tool.cmake cr download --version=1.0.0 --force soft:lib.protobuf.host cr download --version=1.0.1 --force module:program cr download --version=1.0.0 --force module:dataset cr download --version=1.0.0 --force module:pipeline cr download --version=1.0.0 --force module:choice cr download --version=1.0.0 --force module:experiment cr download --version=1.0.0 --force module:math.variation cr download --version=1.2.1 --force program:object-detection-tf-py-benchmark ck install package:lib-tensorflow-1.14.0-cpu ck install package --tags=model,tf,object-detection,mlperf,ssd-mobilenet,non-quantized ck install package --tags=lib,python-package,numpy ck install package --tags=lib,python-package,scipy --force_version=1.2.1 ck install package --tags=lib,python-package,matplotlib ck install package --tags=lib,python-package,pillow ck install package --tags=lib,python-package,cython ck install package --tags=lib,python-package,cv2 ck install package:tool-coco-codereef ck install package:dataset-coco-2017-val-small

All versions:

All files (click to download):

Public comments

    Please log in to add your comment!

If you notice inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!