2026-04-28 10:20:10,154 - INFO - Starting benchmark run. Model: qwen3:4b, Input: c:\Users\Daniel\Desktop\TAM-AI-Engineer-Assessment\root_cause\user_conv_log\hph_inference_test_set_50.jsonl
2026-04-28 10:20:10,182 - INFO - [1/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 10:21:13,114 - INFO - [1/50] Done in 62.9s | Speed: 64.1 t/s | Tokens: 3954
2026-04-28 10:21:13,619 - INFO - [2/50] Starting inference for Tag: 3FW-H070 (Risk: High)
2026-04-28 10:22:21,900 - INFO - [2/50] Done in 68.3s | Speed: 58.4 t/s | Tokens: 3931
2026-04-28 10:22:22,402 - INFO - [3/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 10:22:51,270 - INFO - [3/50] Done in 28.8s | Speed: 63.2 t/s | Tokens: 1776
2026-04-28 10:22:51,773 - INFO - [4/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 10:23:20,049 - INFO - [4/50] Done in 28.3s | Speed: 64.7 t/s | Tokens: 1781
2026-04-28 10:23:20,553 - INFO - [5/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 10:24:00,897 - INFO - [5/50] Done in 40.3s | Speed: 65.2 t/s | Tokens: 2574
2026-04-28 10:24:01,401 - INFO - [6/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 10:24:34,466 - INFO - [6/50] Done in 33.0s | Speed: 64.2 t/s | Tokens: 2069
2026-04-28 10:24:34,968 - INFO - [7/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 10:25:06,722 - INFO - [7/50] Done in 31.7s | Speed: 64.8 t/s | Tokens: 2006
2026-04-28 10:25:07,225 - INFO - [8/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 10:26:11,850 - INFO - [8/50] Done in 64.6s | Speed: 62.9 t/s | Tokens: 4003
2026-04-28 10:26:12,351 - INFO - [9/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 10:26:56,160 - INFO - [9/50] Done in 43.8s | Speed: 61.8 t/s | Tokens: 2655
2026-04-28 10:26:56,663 - INFO - [10/50] Starting inference for Tag: 3FW-H070 (Risk: High)
2026-04-28 10:28:01,861 - INFO - [10/50] Done in 65.2s | Speed: 58.8 t/s | Tokens: 3779
2026-04-28 10:28:02,363 - INFO - [11/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 10:28:45,752 - INFO - [11/50] Done in 43.4s | Speed: 59.3 t/s | Tokens: 2528
2026-04-28 10:28:46,255 - INFO - [12/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 10:30:01,367 - INFO - [12/50] Done in 75.1s | Speed: 57.8 t/s | Tokens: 4280
2026-04-28 10:30:01,869 - INFO - [13/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 10:30:53,700 - INFO - [13/50] Done in 51.8s | Speed: 60.0 t/s | Tokens: 3055
2026-04-28 10:30:54,203 - INFO - [14/50] Starting inference for Tag: 3FW-H050 (Risk: Low)
2026-04-28 10:31:40,023 - INFO - [14/50] Done in 45.8s | Speed: 59.7 t/s | Tokens: 2692
2026-04-28 10:31:40,525 - INFO - [15/50] Starting inference for Tag: 3FW-H070 (Risk: Medium)
2026-04-28 10:32:17,924 - INFO - [15/50] Done in 37.4s | Speed: 60.4 t/s | Tokens: 2211
2026-04-28 10:32:18,427 - INFO - [16/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 10:33:03,055 - INFO - [16/50] Done in 44.6s | Speed: 59.5 t/s | Tokens: 2606
2026-04-28 10:33:03,558 - INFO - [17/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 10:33:49,815 - INFO - [17/50] Done in 46.2s | Speed: 58.8 t/s | Tokens: 2671
2026-04-28 10:33:50,318 - INFO - [18/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 10:34:23,102 - INFO - [18/50] Done in 32.8s | Speed: 60.4 t/s | Tokens: 1939
2026-04-28 10:34:23,605 - INFO - [19/50] Starting inference for Tag: 3FW-H050 (Risk: Low)
2026-04-28 10:35:14,979 - INFO - [19/50] Done in 51.4s | Speed: 59.2 t/s | Tokens: 2994
2026-04-28 10:35:15,481 - INFO - [20/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 10:35:55,084 - INFO - [20/50] Done in 39.6s | Speed: 59.1 t/s | Tokens: 2293
2026-04-28 10:35:55,585 - INFO - [21/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 10:37:11,535 - INFO - [21/50] Done in 75.9s | Speed: 56.4 t/s | Tokens: 4226
2026-04-28 10:37:12,038 - INFO - [22/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 10:38:00,266 - INFO - [22/50] Done in 48.2s | Speed: 57.2 t/s | Tokens: 2712
2026-04-28 10:38:00,769 - INFO - [23/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 10:38:58,126 - INFO - [23/50] Done in 57.3s | Speed: 57.2 t/s | Tokens: 3229
2026-04-28 10:38:58,629 - INFO - [24/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 10:39:42,941 - INFO - [24/50] Done in 44.3s | Speed: 55.6 t/s | Tokens: 2422
2026-04-28 10:39:43,444 - INFO - [25/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 10:40:51,858 - INFO - [25/50] Done in 68.4s | Speed: 56.1 t/s | Tokens: 3787
2026-04-28 10:40:52,362 - INFO - [26/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 10:41:54,574 - INFO - [26/50] Done in 62.2s | Speed: 55.5 t/s | Tokens: 3402
2026-04-28 10:41:55,078 - INFO - [27/50] Starting inference for Tag: 3FW-H070 (Risk: High)
2026-04-28 10:42:42,510 - INFO - [27/50] Done in 47.4s | Speed: 58.7 t/s | Tokens: 2738
2026-04-28 10:42:43,013 - INFO - [28/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 10:43:55,035 - INFO - [28/50] Done in 72.0s | Speed: 57.9 t/s | Tokens: 4112
2026-04-28 10:43:55,538 - INFO - [29/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 10:44:38,190 - INFO - [29/50] Done in 42.6s | Speed: 60.5 t/s | Tokens: 2530
2026-04-28 10:44:38,694 - INFO - [30/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 10:45:53,250 - INFO - [30/50] Done in 74.5s | Speed: 57.5 t/s | Tokens: 4221
2026-04-28 10:45:53,753 - INFO - [31/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 10:47:04,569 - INFO - [31/50] Done in 70.8s | Speed: 56.9 t/s | Tokens: 3965
2026-04-28 10:47:05,073 - INFO - [32/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 10:47:36,196 - INFO - [32/50] Done in 31.1s | Speed: 58.9 t/s | Tokens: 1789
2026-04-28 10:47:36,699 - INFO - [33/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 10:48:30,595 - INFO - [33/50] Done in 53.9s | Speed: 58.4 t/s | Tokens: 3097
2026-04-28 10:48:31,097 - INFO - [34/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 10:49:49,653 - INFO - [34/50] Done in 78.5s | Speed: 60.3 t/s | Tokens: 4671
2026-04-28 10:49:50,155 - INFO - [35/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 10:50:33,767 - INFO - [35/50] Done in 43.6s | Speed: 59.4 t/s | Tokens: 2537
2026-04-28 10:50:34,270 - INFO - [36/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 10:51:41,183 - INFO - [36/50] Done in 66.9s | Speed: 57.2 t/s | Tokens: 3769
2026-04-28 10:51:41,686 - INFO - [37/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 10:52:31,764 - INFO - [37/50] Done in 50.1s | Speed: 57.4 t/s | Tokens: 2821
2026-04-28 10:52:32,268 - INFO - [38/50] Starting inference for Tag: 3FW-H070 (Risk: Medium)
2026-04-28 10:53:01,440 - INFO - [38/50] Done in 29.2s | Speed: 59.1 t/s | Tokens: 1683
2026-04-28 10:53:01,943 - INFO - [39/50] Starting inference for Tag: 3FW-H070 (Risk: Low)
2026-04-28 10:54:09,660 - INFO - [39/50] Done in 67.7s | Speed: 57.1 t/s | Tokens: 3811
2026-04-28 10:54:10,164 - INFO - [40/50] Starting inference for Tag: 3FW-H070 (Risk: Low)
2026-04-28 10:55:21,702 - INFO - [40/50] Done in 71.5s | Speed: 57.5 t/s | Tokens: 4054
2026-04-28 10:55:22,204 - INFO - [41/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 10:56:39,060 - INFO - [41/50] Done in 76.8s | Speed: 56.7 t/s | Tokens: 4300
2026-04-28 10:56:39,563 - INFO - [42/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 10:57:22,982 - INFO - [42/50] Done in 43.4s | Speed: 59.2 t/s | Tokens: 2525
2026-04-28 10:57:23,483 - INFO - [43/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 10:58:13,813 - INFO - [43/50] Done in 50.3s | Speed: 58.5 t/s | Tokens: 2899
2026-04-28 10:58:14,316 - INFO - [44/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 10:58:51,186 - INFO - [44/50] Done in 36.9s | Speed: 60.3 t/s | Tokens: 2178
2026-04-28 10:58:51,689 - INFO - [45/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 10:59:38,904 - INFO - [45/50] Done in 47.2s | Speed: 59.3 t/s | Tokens: 2754
2026-04-28 10:59:39,406 - INFO - [46/50] Starting inference for Tag: 3FW-H070 (Risk: Low)
2026-04-28 11:00:26,778 - INFO - [46/50] Done in 47.3s | Speed: 59.6 t/s | Tokens: 2774
2026-04-28 11:00:27,279 - INFO - [47/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:01:06,581 - INFO - [47/50] Done in 39.3s | Speed: 59.4 t/s | Tokens: 2287
2026-04-28 11:01:07,083 - INFO - [48/50] Starting inference for Tag: 3FW-H070 (Risk: High)
2026-04-28 11:01:39,855 - INFO - [48/50] Done in 32.7s | Speed: 59.9 t/s | Tokens: 1924
2026-04-28 11:01:40,357 - INFO - [49/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:02:35,861 - INFO - [49/50] Done in 55.5s | Speed: 58.2 t/s | Tokens: 3181
2026-04-28 11:02:36,364 - INFO - [50/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:03:14,405 - INFO - [50/50] Done in 38.0s | Speed: 60.5 t/s | Tokens: 2253
2026-04-28 11:03:14,908 - INFO - Benchmark run finished successfully.
2026-04-28 11:06:06,207 - INFO - Starting benchmark run. Model: qwen3:8b, Input: c:\Users\Daniel\Desktop\TAM-AI-Engineer-Assessment\root_cause\user_conv_log\hph_inference_test_set_50.jsonl
2026-04-28 11:06:06,210 - INFO - [1/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:06:57,254 - INFO - [1/50] Done in 51.0s | Speed: 40.9 t/s | Tokens: 1512
2026-04-28 11:06:57,755 - INFO - [2/50] Starting inference for Tag: 3FW-H070 (Risk: High)
2026-04-28 11:07:32,731 - INFO - [2/50] Done in 35.0s | Speed: 41.4 t/s | Tokens: 1413
2026-04-28 11:07:33,233 - INFO - [3/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:08:01,840 - INFO - [3/50] Done in 28.6s | Speed: 41.0 t/s | Tokens: 1147
2026-04-28 11:08:02,342 - INFO - [4/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:08:46,926 - INFO - [4/50] Done in 44.6s | Speed: 40.7 t/s | Tokens: 1783
2026-04-28 11:08:47,428 - INFO - [5/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:09:18,599 - INFO - [5/50] Done in 31.2s | Speed: 40.7 t/s | Tokens: 1238
2026-04-28 11:09:19,101 - INFO - [6/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:09:54,497 - INFO - [6/50] Done in 35.4s | Speed: 40.7 t/s | Tokens: 1409
2026-04-28 11:09:55,000 - INFO - [7/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:10:40,000 - INFO - [7/50] Done in 45.0s | Speed: 42.2 t/s | Tokens: 1868
2026-04-28 11:10:40,503 - INFO - [8/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:11:06,401 - INFO - [8/50] Done in 25.9s | Speed: 40.9 t/s | Tokens: 1030
2026-04-28 11:11:06,904 - INFO - [9/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:11:41,980 - INFO - [9/50] Done in 35.1s | Speed: 40.1 t/s | Tokens: 1378
2026-04-28 11:11:42,483 - INFO - [10/50] Starting inference for Tag: 3FW-H070 (Risk: High)
2026-04-28 11:12:17,721 - INFO - [10/50] Done in 35.2s | Speed: 40.3 t/s | Tokens: 1394
2026-04-28 11:12:18,224 - INFO - [11/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:12:48,319 - INFO - [11/50] Done in 30.1s | Speed: 40.6 t/s | Tokens: 1191
2026-04-28 11:12:48,823 - INFO - [12/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:13:21,300 - INFO - [12/50] Done in 32.5s | Speed: 40.7 t/s | Tokens: 1291
2026-04-28 11:13:21,802 - INFO - [13/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:14:04,610 - INFO - [13/50] Done in 42.8s | Speed: 40.6 t/s | Tokens: 1704
2026-04-28 11:14:05,113 - INFO - [14/50] Starting inference for Tag: 3FW-H050 (Risk: Low)
2026-04-28 11:14:45,129 - INFO - [14/50] Done in 40.0s | Speed: 40.5 t/s | Tokens: 1596
2026-04-28 11:14:45,631 - INFO - [15/50] Starting inference for Tag: 3FW-H070 (Risk: Medium)
2026-04-28 11:15:12,008 - INFO - [15/50] Done in 26.4s | Speed: 40.6 t/s | Tokens: 1045
2026-04-28 11:15:12,510 - INFO - [16/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:15:38,881 - INFO - [16/50] Done in 26.4s | Speed: 40.6 t/s | Tokens: 1043
2026-04-28 11:15:39,384 - INFO - [17/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:16:13,522 - INFO - [17/50] Done in 34.1s | Speed: 40.2 t/s | Tokens: 1340
2026-04-28 11:16:14,025 - INFO - [18/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:16:45,174 - INFO - [18/50] Done in 31.1s | Speed: 40.9 t/s | Tokens: 1247
2026-04-28 11:16:45,677 - INFO - [19/50] Starting inference for Tag: 3FW-H050 (Risk: Low)
2026-04-28 11:17:22,272 - INFO - [19/50] Done in 36.6s | Speed: 41.5 t/s | Tokens: 1497
2026-04-28 11:17:22,774 - INFO - [20/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:17:59,749 - INFO - [20/50] Done in 37.0s | Speed: 43.7 t/s | Tokens: 1587
2026-04-28 11:18:00,252 - INFO - [21/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:18:35,648 - INFO - [21/50] Done in 35.4s | Speed: 43.5 t/s | Tokens: 1513
2026-04-28 11:18:36,151 - INFO - [22/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 11:19:02,572 - INFO - [22/50] Done in 26.4s | Speed: 42.8 t/s | Tokens: 1102
2026-04-28 11:19:03,074 - INFO - [23/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:19:27,727 - INFO - [23/50] Done in 24.6s | Speed: 43.8 t/s | Tokens: 1047
2026-04-28 11:19:28,230 - INFO - [24/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 11:20:06,000 - INFO - [24/50] Done in 37.8s | Speed: 43.0 t/s | Tokens: 1593
2026-04-28 11:20:06,501 - INFO - [25/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 11:20:46,372 - INFO - [25/50] Done in 39.9s | Speed: 41.8 t/s | Tokens: 1638
2026-04-28 11:20:46,875 - INFO - [26/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:21:11,517 - INFO - [26/50] Done in 24.6s | Speed: 41.3 t/s | Tokens: 992
2026-04-28 11:21:12,020 - INFO - [27/50] Starting inference for Tag: 3FW-H070 (Risk: High)
2026-04-28 11:21:46,582 - INFO - [27/50] Done in 34.5s | Speed: 40.7 t/s | Tokens: 1375
2026-04-28 11:21:47,084 - INFO - [28/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:22:26,659 - INFO - [28/50] Done in 39.6s | Speed: 40.7 t/s | Tokens: 1580
2026-04-28 11:22:27,163 - INFO - [29/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:22:59,709 - INFO - [29/50] Done in 32.5s | Speed: 40.7 t/s | Tokens: 1291
2026-04-28 11:23:00,211 - INFO - [30/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:23:28,731 - INFO - [30/50] Done in 28.5s | Speed: 41.0 t/s | Tokens: 1141
2026-04-28 11:23:29,234 - INFO - [31/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:24:06,144 - INFO - [31/50] Done in 36.9s | Speed: 40.5 t/s | Tokens: 1462
2026-04-28 11:24:06,647 - INFO - [32/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:24:35,149 - INFO - [32/50] Done in 28.5s | Speed: 41.0 t/s | Tokens: 1139
2026-04-28 11:24:35,652 - INFO - [33/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 11:25:11,845 - INFO - [33/50] Done in 36.2s | Speed: 40.1 t/s | Tokens: 1420
2026-04-28 11:25:12,349 - INFO - [34/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:25:53,430 - INFO - [34/50] Done in 41.1s | Speed: 40.3 t/s | Tokens: 1618
2026-04-28 11:25:53,934 - INFO - [35/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:26:29,690 - INFO - [35/50] Done in 35.7s | Speed: 40.3 t/s | Tokens: 1415
2026-04-28 11:26:30,193 - INFO - [36/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 11:26:58,871 - INFO - [36/50] Done in 28.7s | Speed: 40.3 t/s | Tokens: 1131
2026-04-28 11:26:59,373 - INFO - [37/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:27:31,889 - INFO - [37/50] Done in 32.5s | Speed: 40.5 t/s | Tokens: 1290
2026-04-28 11:27:32,392 - INFO - [38/50] Starting inference for Tag: 3FW-H070 (Risk: Medium)
2026-04-28 11:28:06,696 - INFO - [38/50] Done in 34.3s | Speed: 40.8 t/s | Tokens: 1371
2026-04-28 11:28:07,198 - INFO - [39/50] Starting inference for Tag: 3FW-H070 (Risk: Low)
2026-04-28 11:28:39,960 - INFO - [39/50] Done in 32.8s | Speed: 40.5 t/s | Tokens: 1298
2026-04-28 11:28:40,462 - INFO - [40/50] Starting inference for Tag: 3FW-H070 (Risk: Low)
2026-04-28 11:29:12,690 - INFO - [40/50] Done in 32.2s | Speed: 40.2 t/s | Tokens: 1264
2026-04-28 11:29:13,192 - INFO - [41/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:29:50,504 - INFO - [41/50] Done in 37.3s | Speed: 40.3 t/s | Tokens: 1475
2026-04-28 11:29:51,007 - INFO - [42/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:30:28,396 - INFO - [42/50] Done in 37.4s | Speed: 40.4 t/s | Tokens: 1479
2026-04-28 11:30:28,898 - INFO - [43/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:30:58,559 - INFO - [43/50] Done in 29.7s | Speed: 40.8 t/s | Tokens: 1182
2026-04-28 11:30:59,062 - INFO - [44/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:31:26,603 - INFO - [44/50] Done in 27.5s | Speed: 41.2 t/s | Tokens: 1108
2026-04-28 11:31:27,105 - INFO - [45/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:32:06,271 - INFO - [45/50] Done in 39.2s | Speed: 40.4 t/s | Tokens: 1553
2026-04-28 11:32:06,774 - INFO - [46/50] Starting inference for Tag: 3FW-H070 (Risk: Low)
2026-04-28 11:32:39,566 - INFO - [46/50] Done in 32.8s | Speed: 40.7 t/s | Tokens: 1308
2026-04-28 11:32:40,067 - INFO - [47/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:33:15,474 - INFO - [47/50] Done in 35.4s | Speed: 40.7 t/s | Tokens: 1407
2026-04-28 11:33:15,975 - INFO - [48/50] Starting inference for Tag: 3FW-H070 (Risk: High)
2026-04-28 11:33:43,595 - INFO - [48/50] Done in 27.6s | Speed: 40.6 t/s | Tokens: 1100
2026-04-28 11:33:44,097 - INFO - [49/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:34:20,426 - INFO - [49/50] Done in 36.3s | Speed: 40.4 t/s | Tokens: 1436
2026-04-28 11:34:20,929 - INFO - [50/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:35:08,689 - INFO - [50/50] Done in 47.7s | Speed: 40.1 t/s | Tokens: 1879
2026-04-28 11:35:09,192 - INFO - Benchmark run finished successfully.
2026-04-28 11:38:52,198 - INFO - Starting benchmark run. Model: gemma4:e2b, Input: c:\Users\Daniel\Desktop\TAM-AI-Engineer-Assessment\root_cause\user_conv_log\hph_inference_test_set_50.jsonl
2026-04-28 11:38:52,202 - INFO - [1/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:39:40,980 - INFO - [1/50] Done in 48.8s | Speed: 39.6 t/s | Tokens: 1358
2026-04-28 11:39:41,484 - INFO - [2/50] Starting inference for Tag: 3FW-H070 (Risk: High)
2026-04-28 11:40:14,069 - INFO - [2/50] Done in 32.6s | Speed: 39.5 t/s | Tokens: 1237
2026-04-28 11:40:14,573 - INFO - [3/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:40:50,511 - INFO - [3/50] Done in 35.9s | Speed: 40.7 t/s | Tokens: 1394
2026-04-28 11:40:51,015 - INFO - [4/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:41:27,080 - INFO - [4/50] Done in 36.0s | Speed: 42.9 t/s | Tokens: 1475
2026-04-28 11:41:27,584 - INFO - [5/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:42:00,093 - INFO - [5/50] Done in 32.5s | Speed: 42.9 t/s | Tokens: 1328
2026-04-28 11:42:00,596 - INFO - [6/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:42:35,237 - INFO - [6/50] Done in 34.6s | Speed: 43.1 t/s | Tokens: 1415
2026-04-28 11:42:35,740 - INFO - [7/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:43:09,202 - INFO - [7/50] Done in 33.4s | Speed: 43.2 t/s | Tokens: 1374
2026-04-28 11:43:09,705 - INFO - [8/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:43:38,744 - INFO - [8/50] Done in 29.0s | Speed: 41.1 t/s | Tokens: 1127
2026-04-28 11:43:39,246 - INFO - [9/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:44:07,241 - INFO - [9/50] Done in 28.0s | Speed: 43.2 t/s | Tokens: 1144
2026-04-28 11:44:07,745 - INFO - [10/50] Starting inference for Tag: 3FW-H070 (Risk: High)
2026-04-28 11:44:32,605 - INFO - [10/50] Done in 24.8s | Speed: 41.1 t/s | Tokens: 965
2026-04-28 11:44:33,108 - INFO - [11/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:45:02,353 - INFO - [11/50] Done in 29.2s | Speed: 41.0 t/s | Tokens: 1139
2026-04-28 11:45:02,856 - INFO - [12/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:45:29,687 - INFO - [12/50] Done in 26.8s | Speed: 42.4 t/s | Tokens: 1076
2026-04-28 11:45:30,193 - INFO - [13/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:46:06,514 - INFO - [13/50] Done in 36.3s | Speed: 43.1 t/s | Tokens: 1495
2026-04-28 11:46:07,017 - INFO - [14/50] Starting inference for Tag: 3FW-H050 (Risk: Low)
2026-04-28 11:46:39,443 - INFO - [14/50] Done in 32.4s | Speed: 44.1 t/s | Tokens: 1359
2026-04-28 11:46:39,946 - INFO - [15/50] Starting inference for Tag: 3FW-H070 (Risk: Medium)
2026-04-28 11:47:13,240 - INFO - [15/50] Done in 33.3s | Speed: 41.7 t/s | Tokens: 1317
2026-04-28 11:47:13,744 - INFO - [16/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:47:39,525 - INFO - [16/50] Done in 25.8s | Speed: 42.9 t/s | Tokens: 1052
2026-04-28 11:47:40,029 - INFO - [17/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:48:16,765 - INFO - [17/50] Done in 36.7s | Speed: 42.8 t/s | Tokens: 1507
2026-04-28 11:48:17,269 - INFO - [18/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:48:49,480 - INFO - [18/50] Done in 32.2s | Speed: 43.5 t/s | Tokens: 1336
2026-04-28 11:48:49,984 - INFO - [19/50] Starting inference for Tag: 3FW-H050 (Risk: Low)
2026-04-28 11:49:26,932 - INFO - [19/50] Done in 36.9s | Speed: 43.0 t/s | Tokens: 1518
2026-04-28 11:49:27,436 - INFO - [20/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:49:55,322 - INFO - [20/50] Done in 27.9s | Speed: 43.1 t/s | Tokens: 1138
2026-04-28 11:49:55,825 - INFO - [21/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:50:22,915 - INFO - [21/50] Done in 27.1s | Speed: 43.5 t/s | Tokens: 1115
2026-04-28 11:50:23,417 - INFO - [22/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 11:50:48,919 - INFO - [22/50] Done in 25.5s | Speed: 43.4 t/s | Tokens: 1047
2026-04-28 11:50:49,423 - INFO - [23/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 11:51:29,171 - INFO - [23/50] Done in 39.7s | Speed: 40.8 t/s | Tokens: 1547
2026-04-28 11:51:29,674 - INFO - [24/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 11:51:57,875 - INFO - [24/50] Done in 28.2s | Speed: 41.0 t/s | Tokens: 1095
2026-04-28 11:51:58,378 - INFO - [25/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 11:52:26,736 - INFO - [25/50] Done in 28.3s | Speed: 40.1 t/s | Tokens: 1077
2026-04-28 11:52:27,239 - INFO - [26/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:52:57,308 - INFO - [26/50] Done in 30.0s | Speed: 40.8 t/s | Tokens: 1167
2026-04-28 11:52:57,810 - INFO - [27/50] Starting inference for Tag: 3FW-H070 (Risk: High)
2026-04-28 11:53:23,601 - INFO - [27/50] Done in 25.8s | Speed: 40.7 t/s | Tokens: 990
2026-04-28 11:53:24,104 - INFO - [28/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:53:50,899 - INFO - [28/50] Done in 26.8s | Speed: 40.7 t/s | Tokens: 1034
2026-04-28 11:53:51,402 - INFO - [29/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:54:20,505 - INFO - [29/50] Done in 29.1s | Speed: 41.0 t/s | Tokens: 1129
2026-04-28 11:54:21,008 - INFO - [30/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:54:45,796 - INFO - [30/50] Done in 24.8s | Speed: 40.6 t/s | Tokens: 950
2026-04-28 11:54:46,300 - INFO - [31/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:55:24,291 - INFO - [31/50] Done in 38.0s | Speed: 40.3 t/s | Tokens: 1463
2026-04-28 11:55:24,793 - INFO - [32/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 11:55:57,111 - INFO - [32/50] Done in 32.3s | Speed: 40.9 t/s | Tokens: 1258
2026-04-28 11:55:57,614 - INFO - [33/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 11:56:34,027 - INFO - [33/50] Done in 36.4s | Speed: 40.6 t/s | Tokens: 1408
2026-04-28 11:56:34,531 - INFO - [34/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:57:08,708 - INFO - [34/50] Done in 34.2s | Speed: 40.5 t/s | Tokens: 1321
2026-04-28 11:57:09,211 - INFO - [35/50] Starting inference for Tag: 3FW-H050 (Risk: Medium)
2026-04-28 11:57:44,668 - INFO - [35/50] Done in 35.4s | Speed: 41.3 t/s | Tokens: 1396
2026-04-28 11:57:45,173 - INFO - [36/50] Starting inference for Tag: 3FW-H060 (Risk: Low)
2026-04-28 11:58:13,043 - INFO - [36/50] Done in 27.9s | Speed: 41.8 t/s | Tokens: 1104
2026-04-28 11:58:13,548 - INFO - [37/50] Starting inference for Tag: 3FW-H060 (Risk: Medium)
2026-04-28 11:58:48,796 - INFO - [37/50] Done in 35.2s | Speed: 41.6 t/s | Tokens: 1395
2026-04-28 11:58:49,299 - INFO - [38/50] Starting inference for Tag: 3FW-H070 (Risk: Medium)
2026-04-28 11:59:22,173 - INFO - [38/50] Done in 32.9s | Speed: 41.4 t/s | Tokens: 1293
2026-04-28 11:59:22,676 - INFO - [39/50] Starting inference for Tag: 3FW-H070 (Risk: Low)
2026-04-28 11:59:57,866 - INFO - [39/50] Done in 35.2s | Speed: 41.1 t/s | Tokens: 1381
2026-04-28 11:59:58,370 - INFO - [40/50] Starting inference for Tag: 3FW-H070 (Risk: Low)
2026-04-28 12:00:28,507 - INFO - [40/50] Done in 30.1s | Speed: 40.9 t/s | Tokens: 1167
2026-04-28 12:00:29,009 - INFO - [41/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 12:01:06,104 - INFO - [41/50] Done in 37.1s | Speed: 40.5 t/s | Tokens: 1434
2026-04-28 12:01:06,607 - INFO - [42/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 12:01:34,731 - INFO - [42/50] Done in 28.1s | Speed: 40.7 t/s | Tokens: 1080
2026-04-28 12:01:35,234 - INFO - [43/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 12:02:07,797 - INFO - [43/50] Done in 32.5s | Speed: 41.3 t/s | Tokens: 1280
2026-04-28 12:02:08,299 - INFO - [44/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 12:02:37,070 - INFO - [44/50] Done in 28.8s | Speed: 42.0 t/s | Tokens: 1145
2026-04-28 12:02:37,573 - INFO - [45/50] Starting inference for Tag: 3FW-H060 (Risk: High)
2026-04-28 12:03:04,553 - INFO - [45/50] Done in 27.0s | Speed: 41.1 t/s | Tokens: 1057
2026-04-28 12:03:05,055 - INFO - [46/50] Starting inference for Tag: 3FW-H070 (Risk: Low)
2026-04-28 12:03:33,037 - INFO - [46/50] Done in 28.0s | Speed: 41.5 t/s | Tokens: 1097
2026-04-28 12:03:33,540 - INFO - [47/50] Starting inference for Tag: 3FW-H050 (Risk: High)
2026-04-28 12:04:09,606 - INFO - [47/50] Done in 36.0s | Speed: 41.3 t/s | Tokens: 1418
2026-04-28 12:04:10,111 - INFO - [48/50] Starting inference for Tag: 3FW-H070 (Risk: High)