Results from GH action on NVIDIA_RTX4090x2

Author: arjunsuresh

closed/MLCommons/compliance/RTX4090x2-nvidia-gpu-TensorRT-default_config/3d-unet-99.9/offline/TEST01/performance/run_1/mlperf_log_detail.txt

@@ -4,7 +4,7 @@ MLPerf Results Summary
 SUT name : Server_3DUNet
 Scenario : Offline
 Mode     : PerformanceOnly
-Samples per second: 8.32063
+Samples per second: 8.31701
 Result is : VALID
   Min duration satisfied : Yes
   Min queries satisfied : Yes
@@ -13,21 +13,21 @@ Result is : VALID
 ================================================
 Additional Stats
 ================================================
-Min latency (ns)                : 185670142
-Max latency (ns)                : 666656050328
-Mean latency (ns)               : 333251561980
-50.00 percentile latency (ns)   : 333360280559
-90.00 percentile latency (ns)   : 600165696961
-95.00 percentile latency (ns)   : 633041563556
-97.00 percentile latency (ns)   : 646974284497
-99.00 percentile latency (ns)   : 660243875337
-99.90 percentile latency (ns)   : 666094131793
+Min latency (ns)                : 185684832
+Max latency (ns)                : 666946744577
+Mean latency (ns)               : 333421377388
+50.00 percentile latency (ns)   : 333491771830
+90.00 percentile latency (ns)   : 600444960008
+95.00 percentile latency (ns)   : 633331948488
+97.00 percentile latency (ns)   : 647262560012
+99.00 percentile latency (ns)   : 660531603651
+99.90 percentile latency (ns)   : 666384770649
 
 ================================================
 Test Parameters Used
 ================================================
-samples_per_query : 5546
-target_qps : 8.40383
+samples_per_query : 5544
+target_qps : 8.40139
 target_latency (ns): 0
 max_async_queries : 1
 min_duration (ms): 600000

closed/MLCommons/compliance/RTX4090x2-nvidia-gpu-TensorRT-default_config/3d-unet-99.9/offline/TEST01/performance/run_1/mlperf_log_summary.txt

@@ -1,4 +1,4 @@
 Verifying performance.
-reference score = 8.32062
-test score = 8.32063
+reference score = 8.31821
+test score = 8.31701
 TEST PASS

closed/MLCommons/compliance/RTX4090x2-nvidia-gpu-TensorRT-default_config/3d-unet-99.9/offline/TEST01/verify_performance.txt

@@ -1,2 +1,2 @@
 
-hash=93ae858ac3883e844a5f6317e9c047a9c5decd9e289a2f3900c21a88d2781bb4
+hash=6c58baafeb46b50a5410ca15681ee0576f3e00b446fc1c0f4f81c124e6f26dc7

closed/MLCommons/compliance/RTX4090x2-nvidia-gpu-TensorRT-default_config/3d-unet-99.9/singlestream/TEST01/accuracy/accuracy.txt

@@ -4,43 +4,43 @@ MLPerf Results Summary
 SUT name : Server_3DUNet
 Scenario : SingleStream
 Mode     : PerformanceOnly
-90th percentile latency (ns) : 429684484
+90th percentile latency (ns) : 429781643
 Result is : VALID
   Min duration satisfied : Yes
   Min queries satisfied : Yes
   Early stopping satisfied: Yes
 Early Stopping Result:
- * Processed at least 64 queries (6063).
- * Would discard 551 highest latency queries.
- * Early stopping 90th percentile estimate: 430282339
- * Early stopping 99th percentile estimate: 497896038
+ * Processed at least 64 queries (6020).
+ * Would discard 546 highest latency queries.
+ * Early stopping 90th percentile estimate: 430856558
+ * Early stopping 99th percentile estimate: 499560031
 
 ================================================
 Additional Stats
 ================================================
-QPS w/ loadgen overhead         : 4.52
-QPS w/o loadgen overhead        : 4.52
+QPS w/ loadgen overhead         : 4.51
+QPS w/o loadgen overhead        : 4.51
 
-Min latency (ns)                : 28046279
-Max latency (ns)                : 501469479
-Mean latency (ns)               : 221375381
-50.00 percentile latency (ns)   : 172747017
-90.00 percentile latency (ns)   : 429684484
-95.00 percentile latency (ns)   : 493732090
-97.00 percentile latency (ns)   : 494931750
-99.00 percentile latency (ns)   : 497353473
-99.90 percentile latency (ns)   : 499925617
+Min latency (ns)                : 27991003
+Max latency (ns)                : 580132284
+Mean latency (ns)               : 221876382
+50.00 percentile latency (ns)   : 173513551
+90.00 percentile latency (ns)   : 429781643
+95.00 percentile latency (ns)   : 493737198
+97.00 percentile latency (ns)   : 495582818
+99.00 percentile latency (ns)   : 498596786
+99.90 percentile latency (ns)   : 502951769
 
 ================================================
 Test Parameters Used
 ================================================
 samples_per_query : 1
-target_qps : 5.02842
+target_qps : 5.01457
 target_latency (ns): 0
 max_async_queries : 1
 min_duration (ms): 600000
 max_duration (ms): 0
-min_query_count : 6063
+min_query_count : 6020
 max_query_count : 0
 qsl_rng_seed : 6023615788873153749
 sample_index_rng_seed : 15036839855038426416

closed/MLCommons/compliance/RTX4090x2-nvidia-gpu-TensorRT-default_config/3d-unet-99.9/singlestream/TEST01/performance/run_1/mlperf_log_detail.txt

@@ -4,8 +4,8 @@ Reading performance mode results...
 num_acc_log_entries = 43
 num_acc_log_duplicate_keys = 0
 num_acc_log_data_mismatch = 0
-num_perf_log_entries = 61
-num_perf_log_qsl_idx_match = 61
+num_perf_log_entries = 60
+num_perf_log_qsl_idx_match = 60
 num_perf_log_data_mismatch = 0
 num_missing_qsl_idxs = 0
 TEST PASS

closed/MLCommons/compliance/RTX4090x2-nvidia-gpu-TensorRT-default_config/3d-unet-99.9/singlestream/TEST01/performance/run_1/mlperf_log_summary.txt

@@ -1,4 +1,4 @@
 Verifying performance.
-reference score = 429855931
-test score = 430282339
+reference score = 431066102
+test score = 430856558
 TEST PASS

closed/MLCommons/compliance/RTX4090x2-nvidia-gpu-TensorRT-default_config/3d-unet-99.9/singlestream/TEST01/verify_accuracy.txt

@@ -4,7 +4,7 @@ MLPerf Results Summary
 SUT name : Server_3DUNet
 Scenario : Offline
 Mode     : PerformanceOnly
-Samples per second: 8.32063
+Samples per second: 8.31701
 Result is : VALID
   Min duration satisfied : Yes
   Min queries satisfied : Yes
@@ -13,21 +13,21 @@ Result is : VALID
 ================================================
 Additional Stats
 ================================================
-Min latency (ns)                : 185670142
-Max latency (ns)                : 666656050328
-Mean latency (ns)               : 333251561980
-50.00 percentile latency (ns)   : 333360280559
-90.00 percentile latency (ns)   : 600165696961
-95.00 percentile latency (ns)   : 633041563556
-97.00 percentile latency (ns)   : 646974284497
-99.00 percentile latency (ns)   : 660243875337
-99.90 percentile latency (ns)   : 666094131793
+Min latency (ns)                : 185684832
+Max latency (ns)                : 666946744577
+Mean latency (ns)               : 333421377388
+50.00 percentile latency (ns)   : 333491771830
+90.00 percentile latency (ns)   : 600444960008
+95.00 percentile latency (ns)   : 633331948488
+97.00 percentile latency (ns)   : 647262560012
+99.00 percentile latency (ns)   : 660531603651
+99.90 percentile latency (ns)   : 666384770649
 
 ================================================
 Test Parameters Used
 ================================================
-samples_per_query : 5546
-target_qps : 8.40383
+samples_per_query : 5544
+target_qps : 8.40139
 target_latency (ns): 0
 max_async_queries : 1
 min_duration (ms): 600000

closed/MLCommons/compliance/RTX4090x2-nvidia-gpu-TensorRT-default_config/3d-unet-99.9/singlestream/TEST01/verify_performance.txt

@@ -1,4 +1,4 @@
 Verifying performance.
-reference score = 8.32062
-test score = 8.32063
+reference score = 8.31821
+test score = 8.31701
 TEST PASS

closed/MLCommons/compliance/RTX4090x2-nvidia-gpu-TensorRT-default_config/3d-unet-99/offline/TEST01/performance/run_1/mlperf_log_detail.txt

@@ -1,2 +1,2 @@
 
-hash=93ae858ac3883e844a5f6317e9c047a9c5decd9e289a2f3900c21a88d2781bb4
+hash=6c58baafeb46b50a5410ca15681ee0576f3e00b446fc1c0f4f81c124e6f26dc7