Object detection; MLPerf inference; TensorFlow CPU; COCO; 50 images validation; Raspberry Pi; benchmark; Portable Workflows
Component: cr-solution:demo-obj-detection-coco-tf-cpu-benchmark-rpi-portable-workflows (v1.3.0)
Added by: gfursin (2019-12-29 21:48:55)
Creation date: 2019-12-22 11:43:25
CID: 1dde4902b05ae08f:70ec4885b4735633cr-solution:demo-obj-detection-coco-tf-cpu-benchmark-rpi-portable-workflows  )

Sign up here to be notified when new results are reproduced or new CodeReef components are shared!

Related paper: MLPerf Inference Benchmark
Related and reproduced results (crowd-experiments): sota-mlperf-object-detection-v0.5-crowd-benchmarking
How to get stable CodeReef version (under development):
  pip install codereef
  cr init demo-obj-detection-coco-tf-cpu-benchmark-rpi-portable-workflows
  cr run demo-obj-detection-coco-tf-cpu-benchmark-rpi-portable-workflows
  # If benchmarking is supported:
  cr benchmark demo-obj-detection-coco-tf-cpu-benchmark-rpi-portable-workflows
Portable CK workflow:
  ck run program:object-detection-tf-py-benchmark --cmd_key=default
Host OS: linux-32 (Raspbian GNU/Linux 10 (buster))
Target OS: linux-32 (Raspbian GNU/Linux 10 (buster))
Target machine: Raspberry (Raspberry Pi 4 Model B Rev 1.1)
Target CPU: BCM2835
Target CPUs:
Target GPU:
Python version for virtual env:

CodeReef client connection cr start

Dependencies on other components

Prerequisites for further automation:
   # Tested on Raspberry Pi 4
   # These dependencies are needed to rebuild COCO API:
    sudo apt update
    sudo apt install git wget libz-dev curl cmake
    sudo apt install gcc g++ autoconf autogen libtool
    sudo apt install libfreetype6-dev
    sudo apt install python3.7-dev
    sudo apt install -y libsm6 libxext6 libxrender-dev

cr download --version=1.0.0 --force package:model-tf-mlperf-ssd-mobilenet cr download --version=1.0.0 --force soft:model.tensorflow.object-detection cr download --version=1.0.0 --force script:install-package-tensorflowmodel-object-detection cr download --version=1.0.0 --force package:lib-python-numpy cr download --version=1.0.0 --force soft:lib.python.numpy cr download --version=1.0.0 --force package:lib-python-scipy cr download --version=1.0.0 --force soft:lib.python.scipy cr download --version=1.0.0 --force package:lib-python-matplotlib cr download --version=1.0.0 --force soft:lib.python.matplotlib cr download --version=1.0.0 --force package:lib-python-pillow cr download --version=1.0.0 --force soft:lib.python.pillow cr download --version=1.0.0 --force package:lib-python-cython cr download --version=1.0.0 --force soft:lib.python.cython cr download --version=1.0.0 --force package:lib-python-cv2 cr download --version=1.0.0 --force soft:lib.python.cv2 cr download --version=1.0.0 --force package:tool-coco-codereef cr download --version=1.0.0 --force soft:tool.coco cr download --version=1.0.0 --force package:dataset-coco-2017-val-small cr download --version=1.0.0 --force soft:dataset.coco.2017.val cr download --version=1.0.2 --force package:lib-tensorflow-1.1.0-cpu cr download --version=1.0.0 --force package:lib-tensorflow-1.4.0-cpu cr download --version=1.0.0 --force package:lib-tensorflow-1.13.1-cpu cr download --version=1.0.0 --force package:lib-tensorflow-1.14.0-cpu cr download --version=1.0.0 --force soft:lib.tensorflow cr download --version=1.0.1 --force package:lib-tensorflow-pip cr download --version=1.0.0 --force soft:lib.python.tensorflow cr download --version=1.0.0 --force package:labelmap-coco cr download --version=1.0.0 --force soft:labelmap.object-detection cr download --version=1.0.0 --force soft:compiler.gcc cr download --version=1.0.0 --force package:tensorflowmodel-api-object-detection cr download --version=1.0.0 --force soft:model.tensorflow-models-api cr download --version=1.0.0 --force package:lib-protobuf-3.0.0-host cr download --version=1.0.0 --force soft:lib.protobuf.host cr download --version=1.0.0 --force script:process-compiler-for-cmake cr download --version=1.0.0 --force soft:tool.cmake cr download --version=1.0.0 --force soft:lib.protobuf.host cr download --version=1.0.1 --force module:program cr download --version=1.0.0 --force module:dataset cr download --version=1.0.0 --force module:pipeline cr download --version=1.0.0 --force module:choice cr download --version=1.0.0 --force module:experiment cr download --version=1.0.0 --force module:math.variation cr download --version=1.4.0 --force program:object-detection-tf-py-benchmark #ck install package:lib-tensorflow-pip --env.PACKAGE_VERSION=1.14.0 # Doens't install PIL needed further (1.13.1 package installs it) #ck install package:lib-tensorflow-1.13.1-cpu --env.VIA_PYPI --env.ALLOW_ALL_BITS ck install package:lib-tensorflow-1.14.0-cpu --env.VIA_PYPI --env.ALLOW_ALL_BITS ck install package --tags=model,tf,object-detection,mlperf,ssd-mobilenet,non-quantized ck install package --tags=lib,python-package,numpy ck install package --tags=lib,python-package,scipy --force_version=1.2.1 ck install package --tags=lib,python-package,matplotlib ck install package --tags=lib,python-package,pillow ck install package --tags=lib,python-package,cython ck install package --tags=lib,python-package,cv2,opencv-contrib-python --force_version= ck install package:tool-coco-codereef ck install package:dataset-coco-2017-val-small

All versions:

All files (click to download):

Public comments

    Please log in to add your comment!

If you notice inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!