This is the development version of the open CodeReef portal - please provide your feedback and request features using Slack or email!
SOTA: MLPerf inference benchmark v0.5 results snapshot (open, Available) for collaborative validation
Component: cr-result:sota-mlperf-inference-results-v0.5-open-available (v1.0.0)
Added by: gfursin (2019-11-17 01:17:53)
Authors: MLPerf
License: github.com/mlperf/policies/blob/master/TERMS%20OF%20USE.md
Source: mlperf.org/inference-overview/#overview
Creation date: 2019-11-07 11:43:59
CID: cb8caf8cbebafe20:49ba90a53ef0f5d0cr-result:sota-mlperf-inference-results-v0.5-open-available  )

We collaborate with ACM and use the standard artifact review and badging methodology to reproduce these results and assign reproducibility badges!
Sign up here to be notified when new results are reproduced or new CodeReef components are shared!


Benchmark results (performance): P_*_SS - Single Stream in milliseconds, P_*_MS - MultiStream in no. streams, P_*_S - Server in QPS, P_*_O - Offline in inputs/second.
Benchmark results (accuracy): A_IC* - Top-1, A_OD* - mAP, A_NMT* - BLEU.
CodeReef components: packages, software detection plugins.
Image Classification: IC1 - ImageNet, MobileNet-v1, IC2 - ImageNet, ResNet-50 v1.5.
Object detection: OD1 - COCO, SSD w/ MobileNet-v1, OD2 - COCO 1200x1200, SSD w/ ResNet-34.
Translation: NMT - WMT E-G, NMT.
Form Factor: FF_M - Mobile/Handheld, FF_D - Desktop/Workstation, FF_S - Server, FF_E - Edge/Embedded.
These are not official results but a snapshot to collaboratively reproduce results and add portable workflows!
MLPerf name and logo are trademarks. See www.mlperf.org for more information.


Related paper: MLPerf Inference Benchmark
Related solutions: 1 2 3 4 5 6 7






All versions:


Comments:

    Please log in to add your comment!


If you notice inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!