Skip to content

Reconcile the unit test inventory with renamed cases and current sources #338

Reconcile the unit test inventory with renamed cases and current sources

Reconcile the unit test inventory with renamed cases and current sources #338

Triggered via push October 23, 2026 23:20
Status Failure
Total duration 2h 42m 37s
Artifacts 47

benchmarks.yml

on: push
Prepare comparison runtime
18m 15s
Prepare comparison runtime
Matrix: comparison-helixdb
Matrix: comparison-keyload
Matrix: comparison-kurrentdb
Matrix: comparison-mongodb
Matrix: comparison-neo4j
Matrix: comparison-opensearch
Matrix: comparison-postgresql
Matrix: comparison-qdrant
Matrix: comparison-rabbitmq
Matrix: comparison-redis
Matrix: comparison-surrealdb
KeyLoad functional CLUSTER million-record ingestion
5m 34s
KeyLoad functional CLUSTER million-record ingestion
Combine benchmark results
18s
Combine benchmark results
Trigger Website
0s
Trigger Website
Fit to window
Zoom out
Zoom in

Annotations

33 errors and 25 notices
Neo4j / Session / 3 nodes
No files were found with the provided path: artifacts/comparisons/sessions/workers/neo4j-n3/**. No artifacts will be uploaded.
Neo4j / Session / 3 nodes
Process completed with exit code 1.
Neo4j / Session / 1 node
No files were found with the provided path: artifacts/comparisons/sessions/workers/neo4j-n1/**. No artifacts will be uploaded.
Neo4j / Session / 1 node
Process completed with exit code 1.
MongoDB / Session / 1 node
Process completed with exit code 1.
MongoDB / Session / 1 node
Process completed with exit code 2.
Redis / Session / 3 nodes
Process completed with exit code 1.
Redis / Session / 3 nodes
Process completed with exit code 2.
SurrealDB / Session / 1 node
Process completed with exit code 1.
SurrealDB / Session / 1 node
Process completed with exit code 2.
MongoDB / Session / 3 nodes
Process completed with exit code 1.
MongoDB / Session / 3 nodes
Process completed with exit code 2.
RabbitMQ / Session / 1 node
Process completed with exit code 1.
KurrentDB / Session / 1 node
Process completed with exit code 1.
KurrentDB / Session / 3 nodes
Process completed with exit code 1.
KeyLoad / Session / 3 nodes
Process completed with exit code 1.
KeyLoad / Session / 3 nodes
Process completed with exit code 2.
KeyLoad / Session / 1 node
Process completed with exit code 1.
KeyLoad / Session / 1 node
Process completed with exit code 2.
Qdrant / Session / 1 node
Process completed with exit code 1.
Qdrant / Session / 3 nodes
Process completed with exit code 1.
KeyLoad functional CLUSTER million-record ingestion
Process completed with exit code 2.
RabbitMQ / Session / 3 nodes
Process completed with exit code 1.
PostgreSQL + pgvector / Session / 1 node
Process completed with exit code 1.
PostgreSQL + pgvector / Session / 3 nodes
Process completed with exit code 1.
OpenSearch / Session / 1 node
Process completed with exit code 1.
OpenSearch / Session / 1 node
Process completed with exit code 2.
Redis / Session / 1 node
Process completed with exit code 1.
OpenSearch / Session / 3 nodes
Process completed with exit code 1.
OpenSearch / Session / 3 nodes
Process completed with exit code 2.
HelixDB / Session / 1 node
Process completed with exit code 1.
HelixDB / Session / 1 node
Process completed with exit code 2.
Combine benchmark results
Process completed with exit code 1.
Prepare comparison runtime
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Neo4j / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Neo4j / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
MongoDB / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
SurrealDB / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Redis / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
HelixDB / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
SurrealDB / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
MongoDB / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
RabbitMQ / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
KurrentDB / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
KurrentDB / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
KeyLoad / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
KeyLoad / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Qdrant / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Qdrant / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
KeyLoad functional CLUSTER million-record ingestion
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
RabbitMQ / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
PostgreSQL + pgvector / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
PostgreSQL + pgvector / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
OpenSearch / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Redis / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
OpenSearch / Session / 3 nodes
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
HelixDB / Session / 1 node
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Combine benchmark results
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"

Artifacts

Produced during runtime
Name Size Digest
comparison-case-qualification-session-helixdb-n1
117 KB
sha256:3a8f51e747f021490d500b2859f67b2e71817e1d1821dd6444bb18d816a62de5
comparison-case-qualification-session-helixdb-n3
90.8 KB
sha256:6f21e6b388df9362211cab1260cf10de3e10243d14f1a724da9cb769ebb4343f
comparison-case-qualification-session-keyload-n1
110 KB
sha256:5914023549adb80eb306bec989ed2412aaa80c19de30697b6563ba6c069a2383
comparison-case-qualification-session-keyload-n3
116 KB
sha256:05d629d31a2593a84fa265bad6acffbee63a0899bc8977c7278725878ff3a3aa
comparison-case-qualification-session-kurrentdb-n1
100 KB
sha256:f174f9c2108453647a7f845e72528a6722bd3f89e83ff17f78b15981e4dbcc0e
comparison-case-qualification-session-kurrentdb-n3
106 KB
sha256:1ed8b87bc2ffbbd07cd86e679881c311143e75a83bdcd62faa415dfb6fe2439c
comparison-case-qualification-session-mongodb-n1
103 KB
sha256:b194818dcf7444959816addaf391d2904872836b69ef8e70cb9ac75b4006f399
comparison-case-qualification-session-mongodb-n3
106 KB
sha256:e6208523c3cd9575713ce4df756d2117f5777156d4dfd33d33dc897b8c746ba1
comparison-case-qualification-session-neo4j-n1
13.6 KB
sha256:366c54e92c19e8bc26e20639af6008032a38413cb35f1599884bb3c5ba27134a
comparison-case-qualification-session-neo4j-n3
13.6 KB
sha256:3d1ffd806fdf4a5a5b8bff79e7854019a0e1e761e35cca11f3e35b0c6c52f3cb
comparison-case-qualification-session-opensearch-n1
112 KB
sha256:db7250c3638211074563a0bd7e1f3259a50962a4cdf1901a55dd24e254663579
comparison-case-qualification-session-opensearch-n3
121 KB
sha256:40bc9abb6230b74166f08e81232fff76779e5f3d3e9459a60e4da4596cf0edc8
comparison-case-qualification-session-postgresql-n1
106 KB
sha256:f6fb8544a0337312487bcb84bd8f2a9af5d9b2df8f42f701359adc4b9dd8cadb
comparison-case-qualification-session-postgresql-n3
117 KB
sha256:695f28fe7c96c790bcf71b247e859b10365ffd976420b620675fbc6a70e2b8b3
comparison-case-qualification-session-qdrant-n1
95.9 KB
sha256:cd1ba01cc03b64380c92a0cb747190c776da9616bed025cf74a589f913171dbd
comparison-case-qualification-session-qdrant-n3
100 KB
sha256:74f2ba6ef0f43e1a885af9efc447e71c107daa863b23e316f1f020a45a3f0426
comparison-case-qualification-session-rabbitmq-n1
100 KB
sha256:2f5b36a147ae26aa8953e7641631bfc1e210d226d83a711168b705c2af3567b2
comparison-case-qualification-session-rabbitmq-n3
107 KB
sha256:6fb6ef8f359b4b22ad6bba9fbc8e9e399d2b35a66a5e4b3862a9d2e7f7d8cb05
comparison-case-qualification-session-redis-n1
100 KB
sha256:f033b4ffea96f1225a192fca86b33084135544a0eb153ebdaf8efbcd99712305
comparison-case-qualification-session-redis-n3
105 KB
sha256:9193c34c895607e08ec3c1506e8629fa5ae82c4df09f63238d92ef26eb21072d
comparison-case-qualification-session-surrealdb-n1
100 KB
sha256:d69445697bd174b1e5ab816aa56ef726ca9fee7409511b49404f0758a0457689
comparison-case-qualification-session-surrealdb-n3
90.8 KB
sha256:7b28842174e535fdad70dadffd6cab1090c448ead5e317420d9dc505bf45e978
comparison-compiled-runtime-identity
436 KB
sha256:fed20900db0ef2dcd5d64747afd07bf982acbc3dd4b4b0ae62fbceb05da6c019
comparison-compiled-test-bundle
1.92 GB
sha256:bbf77705cebdaa8508e67e087826ee9e852b2bee0488c6815c3880c928ea41a4
comparison-plan
810 Bytes
sha256:cf706d1f566edf61ef803f3b29e7cf8bd482fbe47bfd1952259096484b3497d3
comparison-runtime-qualification
1.99 MB
sha256:f3a83ff5b0d797daca5e4e245206866b68ec27a9c4f0c2a5448160d3534efcd9
comparison-session-helixdb-n1
9.13 MB
sha256:89436737df8391bd95c07aa2087924124df84d1615ca82be7a2e28e08b8a2ca4
comparison-session-helixdb-n3
163 KB
sha256:774c7fefcfd0f8c33a2f2ee1b6b80e583ae96c8c87a1f869f010c60bcddd991b
comparison-session-keyload-n1
177 KB
sha256:2973a38efae70ef46d97d94875d7004a62d95575569df3170db936a0516d81b9
comparison-session-keyload-n3
185 KB
sha256:73bb83bcedf6bbe5e6c360d0f09401f6db880345a545271cc3080974b7de1f45
comparison-session-kurrentdb-n1
188 KB
sha256:fdbd29d0d76749ffb75723b187e43b2572149fa8cd5d20f8f6f3087c35e7ccfc
comparison-session-kurrentdb-n3
225 KB
sha256:c4e039a5fbba613b4ad3a0d85a43ca168e9821c3836dce3a13e5aa9a1ba8be58
comparison-session-mongodb-n1
91.7 KB
sha256:b3ecba43f386f4c6f5f9dcf456681d33e5d114c74c15f3ebbc546c82ff1d0fb7
comparison-session-mongodb-n3
97.5 KB
sha256:956abfb533f76cc7685db0f8dc36bae66c47db72e482d7b943f0ff9d00bff377
comparison-session-opensearch-n1
13.6 MB
sha256:25bd3032b9cad8942a1d38ac5a0c606ad6e16b5eb60eacbc72635e4d0f46efed
comparison-session-opensearch-n3
14.1 MB
sha256:c126c8dc8be70e6cb9d19d2544af00397d48f6e565d86b2ff4c119b2dc481a7d
comparison-session-postgresql-n1
22.8 MB
sha256:08e5a002f85664525caec42bf9ffb0aaec64de7b5d54e21cb0b8773b46c75abb
comparison-session-postgresql-n3
22.5 MB
sha256:3abc8cfb9689b8d1bfdceed5e65e756cbdb8dabf792aa2dc84f422c61a9439e9
comparison-session-qdrant-n1
170 KB
sha256:4286301f081e4a287decb385dbaeca6bcaf372a631686d3ef8cfad8044936da5
comparison-session-qdrant-n3
175 KB
sha256:3cea54afc413375e5ca7cfd42ea08d46289508aa0eab9c9ad1fd0cc38456bea0
comparison-session-rabbitmq-n1
180 KB
sha256:2c35f585491a4ae57cfc4063530a66dfe5d9d1075bb74a4f27eda537250f15e1
comparison-session-rabbitmq-n3
205 KB
sha256:e39fdd8fde69b6c1f903531d569383bc75afe86b8cebb66220dbbecbfcbd0dd9
comparison-session-redis-n1
21.4 MB
sha256:2d828982e2a56c268ac60ce3d60ccc333cf3abc87e887ba4df4ab3390527fbf5
comparison-session-redis-n3
195 KB
sha256:54bb88eed6eac8bbf51c8434b1874666764df8f3a0e87401bec4cc7f3aacfdf6
comparison-session-surrealdb-n1
90.2 KB
sha256:9ec227e69f245d687dbb046c30930d5ae9ffe388448bf710acc33855c44cc43b
comparison-session-surrealdb-n3
163 KB
sha256:eba20bb9670e82f5f69faaadccd5285a8df0da8a12fa4ea3c66855628734b21d
keyload-functional-heavy-load
1.11 MB
sha256:ffad892fd1251a855382e5ac797cc984f07dc770b1370cfa8df42ddb5c575653