Skip to content

Analyzers — v0.5.0

Each scorecard is one frozen report: one analyzer, one track, one score dimension, one model profile. Scorecards are independent result populations and are never combined into a leaderboard. TPR/FPR are macro-averages over templates, then semantic dimensions; incomplete outcomes are coverage, never negatives.

This snapshot’s scorecards span two model profiles, and every card below states its own. A benchmark-controlled card and a tool-native card answer different questions on different populations: the first measures the engine with the benchmark’s model supplied, the second measures the product with nothing supplied. Do not read them against each other.

bifrost-c-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-c-kernel.json (db4a8415f86f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 48 20 20 8 0 0 100.0% 0.0%
c language-extension 2 1 0 1 0 0 100.0% n/a

bifrost-cpp-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-cpp-kernel.json (1398c72370cd…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 56 15 15 26 0 0 100.0% 0.0%

bifrost-csharp-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-csharp-kernel.json (2fe19dbf7e5a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
csharp core 58 19 15 24 0 0 100.0% 18.4%

bifrost-go-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-go-kernel.json (919e62b265d1…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 58 19 17 22 0 0 100.0% 10.1%

bifrost-java-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-java-kernel.json (ff99ba2ee4f4…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 18 20 20 0 0 98.6% 0.0%

bifrost-java-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-java-modeling.json (2e6e38e4cfd5…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 4 4 0 16 0 100.0% 0.0%

bifrost-java-native-taint-taint-tool-native

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-java-native.json (5add3826fa45…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

bifrost-javascript-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-javascript-kernel.json (58675cdd313b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 18 18 22 0 0 100.0% 0.0%

bifrost-javascript-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-javascript-modeling.json (751d5ae5412e…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 2 3 3 16 0 100.0% 0.0%

bifrost-javascript-native-taint-taint-tool-native

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-javascript-native.json (0a2ca366a08c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

bifrost-kotlin-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-kotlin-kernel.json (db5e0633a131…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 14 14 30 0 0 100.0% 0.0%

bifrost-php-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-php-kernel.json (ad17e035ecfa…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 58 16 16 26 0 0 100.0% 0.0%

bifrost-python-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-python-kernel.json (d0c713ed0b7f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 18 18 22 0 0 100.0% 0.0%

bifrost-python-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-python-modeling.json (ce470da59780…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 4 4 0 16 0 100.0% 0.0%

bifrost-python-native-taint-taint-tool-native

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-python-native.json (ae24e34efe49…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 0 0 12 0 n/a n/a

bifrost-ruby-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-ruby-kernel.json (afab27546ffb…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 12 10 36 0 0 100.0% 14.0%

bifrost-rust-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-rust-kernel.json (340d6104d3ec…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 18 18 18 0 0 100.0% 0.0%
rust language-extension 2 0 0 2 0 0 n/a n/a

bifrost-scala-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-scala-kernel.json (67fe1b3d9a7c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
scala core 58 19 19 20 0 0 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-smoke.json (c78ed974f229…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 2 1 1 0 0 0 100.0% 0.0%
cpp core 2 1 1 0 0 0 100.0% 0.0%
csharp core 2 1 1 0 0 0 100.0% 0.0%
go core 2 1 1 0 0 0 100.0% 0.0%
java calibration 2 1 0 0 1 0 not scored not scored
java core 32 16 16 0 0 0 100.0% 0.0%
javascript core 32 16 16 0 0 0 100.0% 0.0%
kotlin core 2 1 1 0 0 0 100.0% 0.0%
php core 2 1 1 0 0 0 100.0% 0.0%
python core 32 16 16 0 0 0 100.0% 0.0%
ruby core 2 1 1 0 0 0 100.0% 0.0%
rust core 2 1 1 0 0 0 100.0% 0.0%
scala core 2 1 1 0 0 0 100.0% 0.0%
typescript core 2 1 1 0 0 0 100.0% 0.0%

bifrost-typescript-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-typescript-kernel.json (c4bca856809d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 58 17 17 24 0 0 100.0% 0.0%

codeql-c-kernel-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-c-kernel.json (9ed3846bd073…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 48 23 25 0 0 0 75.6% 14.0%
c language-extension 2 2 0 0 0 0 100.0% n/a

codeql-cpp-kernel-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-cpp-kernel.json (4053f81a192b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 56 18 38 0 0 0 53.2% 8.9%

codeql-csharp-kernel-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-csharp-kernel.json (69c0f67040a5…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
csharp core 58 24 34 0 0 0 69.4% 11.8%

codeql-go-kernel-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-go-kernel.json (715946c2e018…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 58 24 34 0 0 0 66.6% 16.7%

codeql-java-kernel-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-java-kernel.json (f13a11290939…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 29 29 0 0 0 79.6% 19.8%

codeql-java-modeling-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-java-modeling.json (c76aac2e4bf8…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-java-native-taint-taint-tool-native

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-java-native.json (16e2ca2ea4e7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 7 5 0 0 0 100.0% 29.2%

codeql-javascript-kernel-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-javascript-kernel.json (48c18bb0c559…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 23 35 0 0 0 77.4% 9.0%

codeql-javascript-modeling-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-javascript-modeling.json (a3e6f90dd6f0…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-javascript-native-taint-taint-tool-native

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-javascript-native.json (a9889691d7da…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 7 5 0 0 0 70.8% 58.3%

codeql-kotlin-kernel-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-kotlin-kernel.json (170d5b9c7b8c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 25 33 0 0 0 68.3% 17.1%

codeql-python-kernel-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-python-kernel.json (20291cc4a6a5…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 23 35 0 0 0 70.5% 10.9%

codeql-python-modeling-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-python-modeling.json (b9a3c13de153…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-python-native-taint-taint-tool-native

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-python-native.json (21a2e4136756…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 8 4 0 0 0 100.0% 58.3%

codeql-ruby-kernel-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-ruby-kernel.json (7aab3f0f9fe5…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 22 36 0 0 0 64.3% 7.9%

codeql-rust-kernel-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-rust-kernel.json (02625bfd21b8…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 21 33 0 0 0 71.4% 10.4%
rust language-extension 2 0 2 0 0 0 0.0% 0.0%

codeql-typescript-kernel-taint-taint-benchmark-controlled

codeql 2.26.3 (build 7d097a43199e, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-typescript-kernel.json (f702e16cc3cf…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 58 23 35 0 0 0 77.4% 9.0%

joern-java-kernel-taint-taint-benchmark-controlled

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-java-kernel.json (e9b98b262970…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 26 32 0 0 0 71.8% 18.4%

joern-java-modeling-taint-taint-benchmark-controlled

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-java-modeling.json (062de7777d60…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 6 10 0 8 0 50.0% 0.0%

joern-java-native-taint-taint-tool-native

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-java-native.json (a2bd1c79179c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

joern-javascript-kernel-taint-taint-benchmark-controlled

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-javascript-kernel.json (2303345687cf…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 27 31 0 0 0 68.1% 18.6%

joern-javascript-modeling-taint-taint-benchmark-controlled

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-javascript-modeling.json (b560ae830e00…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 6 10 0 8 0 50.0% 0.0%

joern-javascript-native-taint-taint-tool-native

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-javascript-native.json (ca750185e576…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

joern-php-kernel-taint-taint-benchmark-controlled

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-php-kernel.json (6339d32f63c6…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 58 25 33 0 0 0 70.2% 16.7%

joern-python-kernel-taint-taint-benchmark-controlled

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-python-kernel.json (a47e6d4d97f6…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 25 33 0 0 0 70.2% 14.9%

joern-python-modeling-taint-taint-benchmark-controlled

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-python-modeling.json (6f7ea2ece57f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 6 10 0 8 0 50.0% 0.0%

joern-python-native-taint-taint-tool-native

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-python-native.json (d9612e60a439…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 0 0 12 0 n/a n/a

joern-ruby-kernel-taint-taint-benchmark-controlled

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-ruby-kernel.json (0ea9e3469ffe…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 23 35 0 0 0 54.8% 31.2%

joern-rust-kernel-taint-taint-benchmark-controlled

joern 4.0.610 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-rust-kernel.json (696e306951c9…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 20 34 0 0 0 70.3% 14.3%

semgrep-c-kernel-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-c-kernel.json (8b1978f8a418…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 48 9 5 0 34 0 100.0% 42.9%

semgrep-cpp-kernel-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-cpp-kernel.json (7a4eb1bdabed…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 56 9 5 0 42 0 100.0% 42.9%

semgrep-go-kernel-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-go-kernel.json (001ee7a2b34c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 58 9 5 0 44 0 100.0% 42.9%

semgrep-java-kernel-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-java-kernel.json (669920574d8e…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 9 5 0 44 0 100.0% 42.9%

semgrep-java-modeling-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-java-modeling.json (8af4d45c830f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-java-native-taint-taint-tool-native

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-java-native.json (ef0ec5c9bcb7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

semgrep-javascript-kernel-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-javascript-kernel.json (216f093f4a5f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 9 5 0 44 0 100.0% 42.9%

semgrep-javascript-modeling-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-javascript-modeling.json (c11bf5343af3…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-javascript-native-taint-taint-tool-native

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-javascript-native.json (f2c815b3b80d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

semgrep-kotlin-kernel-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-kotlin-kernel.json (88def9a78099…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 9 5 0 44 0 100.0% 42.9%

semgrep-php-kernel-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-php-kernel.json (c265ac735c38…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 58 9 5 0 44 0 100.0% 42.9%

semgrep-python-kernel-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-python-kernel.json (d047262d8a19…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 9 5 0 44 0 100.0% 42.9%

semgrep-python-modeling-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-python-modeling.json (9c4bc7eac5d7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-python-native-taint-taint-tool-native

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-python-native.json (b807832c6dfa…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 10 2 0 0 0 100.0% 91.7%

semgrep-ruby-kernel-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-ruby-kernel.json (375458b3da81…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 9 5 0 44 0 100.0% 42.9%

semgrep-rust-kernel-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-rust-kernel.json (25192435fb10…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 9 5 0 40 0 100.0% 42.9%

semgrep-typescript-kernel-taint-taint-benchmark-controlled

semgrep 1.174.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-typescript-kernel.json (7ea8aaf04089…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 58 9 5 0 44 0 100.0% 42.9%

bifrost-c-kernel-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 2 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 4 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 6 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 0 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-c-kernel-taint-taint-benchmark-controlledc, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
flow-sensitivity 0 0 0 0 1 0 0 n/a n/a n/a n/a
heap-field-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
interprocedural-flow 0 0 0 0 1 0 0 n/a n/a n/a n/a
local-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a

bifrost-cpp-kernel-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 4 0 0 4 12 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 14 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-csharp-kernel-taint-taint-benchmark-controlledcsharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 4 0 0 4 10 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 10 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 7 0 2 5 2 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-go-kernel-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 4 0 0 4 8 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 8 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 0 1 6 2 0 0 7/7 (100.0%) 1/7 (14.3%) 100.0% 14.3%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 10 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 4 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 1 0 8 0 0 0 7/8 (87.5%) 0/8 (0.0%) 87.5% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 10 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 0 0 0 1 3 0 0 n/a 0/1 (0.0%) n/a 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 20 0 0 n/a n/a n/a n/a
interprocedural-flow 7 0 0 7 12 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-php-kernel-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 10 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 5 0 0 5 6 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 10 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 20 0 0 n/a n/a n/a n/a
interprocedural-flow 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 5 0 1 4 6 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 2 0 1 1 2 0 0 2/2 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 6 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 8 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 0 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-rust-kernel-taint-taint-benchmark-controlledrust, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 0 0 0 2 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-scala-kernel-taint-taint-benchmark-controlledscala, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 10 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 12 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledcsharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledscala, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-typescript-kernel-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 4 0 0 4 10 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 10 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

codeql-c-kernel-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 1 0 4 0 0 0 3/4 (75.0%) 0/4 (0.0%) 75.0% 0.0%
dynamic-dispatch 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 2 2 6 0 0 0 6/8 (75.0%) 2/8 (25.0%) 75.0% 25.0%
interprocedural-flow 7 3 0 10 0 0 0 7/10 (70.0%) 0/10 (0.0%) 70.0% 0.0%
local-flow 7 0 1 6 0 0 0 7/7 (100.0%) 1/7 (14.3%) 100.0% 14.3%
object-sensitivity 3 2 1 4 0 0 0 3/5 (60.0%) 1/5 (20.0%) 60.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-c-kernel-taint-taint-benchmark-controlledc, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
flow-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
heap-field-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
interprocedural-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
local-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a

codeql-cpp-kernel-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 3 7 1 9 0 0 0 3/10 (30.0%) 1/10 (10.0%) 30.0% 10.0%
interprocedural-flow 6 5 0 11 0 0 0 6/11 (54.5%) 0/11 (0.0%) 54.5% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 1 4 0 5 0 0 0 1/5 (20.0%) 0/5 (0.0%) 20.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-csharp-kernel-taint-taint-benchmark-controlledcsharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 2 7 0 0 0 6/9 (66.7%) 2/9 (22.2%) 66.7% 22.2%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 2 1 5 0 0 0 4/6 (66.7%) 1/6 (16.7%) 66.7% 16.7%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-go-kernel-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 1 5 0 6 0 0 0 1/6 (16.7%) 0/6 (0.0%) 16.7% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 2 2 6 0 0 0 6/8 (75.0%) 2/8 (25.0%) 75.0% 25.0%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 6 2 2 6 0 0 0 6/8 (75.0%) 2/8 (25.0%) 75.0% 25.0%
object-sensitivity 4 2 1 5 0 0 0 4/6 (66.7%) 1/6 (16.7%) 66.7% 16.7%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 5 2 2 5 0 0 0 5/7 (71.4%) 2/7 (28.6%) 71.4% 28.6%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 3 7 0 0 0 7/10 (70.0%) 3/10 (30.0%) 70.0% 30.0%
interprocedural-flow 9 0 0 9 0 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 1 2 3 0 0 0 4/5 (80.0%) 2/5 (40.0%) 80.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 1 5 0 0 0 6/6 (100.0%) 1/6 (16.7%) 100.0% 16.7%
sanitizer 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 1 8 0 0 0 6/9 (66.7%) 1/9 (11.1%) 66.7% 11.1%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 1 0 0 0 0 0/1 (0.0%) 1/1 (100.0%) 0.0% 100.0%
local-flow 5 1 2 4 0 0 0 5/6 (83.3%) 2/6 (33.3%) 83.3% 33.3%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

codeql-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 2 5 1 6 0 0 0 2/7 (28.6%) 1/7 (14.3%) 28.6% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 3 7 0 0 0 7/10 (70.0%) 3/10 (30.0%) 70.0% 30.0%
interprocedural-flow 9 4 1 12 0 0 0 9/13 (69.2%) 1/13 (7.7%) 69.2% 7.7%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 1 2 3 0 0 0 4/5 (80.0%) 2/5 (40.0%) 80.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 5 0 7 0 0 0 2/7 (28.6%) 0/7 (0.0%) 28.6% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 4 1 9 0 0 0 6/10 (60.0%) 1/10 (10.0%) 60.0% 10.0%
interprocedural-flow 9 4 0 13 0 0 0 9/13 (69.2%) 0/13 (0.0%) 69.2% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

codeql-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 1 6 0 7 0 0 0 1/7 (14.3%) 0/7 (0.0%) 14.3% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 4 0 10 0 0 0 6/10 (60.0%) 0/10 (0.0%) 60.0% 0.0%
interprocedural-flow 8 5 0 13 0 0 0 8/13 (61.5%) 0/13 (0.0%) 61.5% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 5 3 1 7 0 0 0 5/8 (62.5%) 1/8 (12.5%) 62.5% 12.5%
interprocedural-flow 7 3 0 10 0 0 0 7/10 (70.0%) 0/10 (0.0%) 70.0% 0.0%
local-flow 7 0 1 6 0 0 0 7/7 (100.0%) 1/7 (14.3%) 100.0% 14.3%
object-sensitivity 3 3 0 6 0 0 0 3/6 (50.0%) 0/6 (0.0%) 50.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-rust-kernel-taint-taint-benchmark-controlledrust, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

codeql-typescript-kernel-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 1 8 0 0 0 6/9 (66.7%) 1/9 (11.1%) 66.7% 11.1%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 2 5 0 0 0 3/7 (42.9%) 2/7 (28.6%) 42.9% 28.6%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 1 9 0 0 0 7/10 (70.0%) 1/10 (10.0%) 70.0% 10.0%
interprocedural-flow 7 2 0 9 0 0 0 7/9 (77.8%) 0/9 (0.0%) 77.8% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 4 5 0 0 0 6/9 (66.7%) 4/9 (44.4%) 66.7% 44.4%
interprocedural-flow 7 4 0 11 0 0 0 7/11 (63.6%) 0/11 (0.0%) 63.6% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 3 1 5 0 0 0 3/6 (50.0%) 1/6 (16.7%) 50.0% 16.7%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-php-kernel-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 1 6 0 0 0 3/7 (42.9%) 1/7 (14.3%) 42.9% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 0 10 0 0 0 7/10 (70.0%) 0/10 (0.0%) 70.0% 0.0%
interprocedural-flow 8 5 1 12 0 0 0 8/13 (61.5%) 1/13 (7.7%) 61.5% 7.7%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 3 4 1 6 0 0 0 3/7 (42.9%) 1/7 (14.3%) 42.9% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 1 9 0 0 0 7/10 (70.0%) 1/10 (10.0%) 70.0% 10.0%
interprocedural-flow 8 5 0 13 0 0 0 8/13 (61.5%) 0/13 (0.0%) 61.5% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 3 2 3 0 0 0 2/5 (40.0%) 2/5 (40.0%) 40.0% 40.0%
dynamic-dispatch 1 6 1 6 0 0 0 1/7 (14.3%) 1/7 (14.3%) 14.3% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 4 6 1 9 0 0 0 4/10 (40.0%) 1/10 (10.0%) 40.0% 10.0%
interprocedural-flow 6 7 3 10 0 0 0 6/13 (46.2%) 3/13 (23.1%) 46.2% 23.1%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 1 4 0 5 0 0 0 1/5 (20.0%) 0/5 (0.0%) 20.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

joern-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 5 3 0 8 0 0 0 5/8 (62.5%) 0/8 (0.0%) 62.5% 0.0%
interprocedural-flow 6 4 0 10 0 0 0 6/10 (60.0%) 0/10 (0.0%) 60.0% 0.0%
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 3 3 0 6 0 0 0 3/6 (50.0%) 0/6 (0.0%) 50.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-c-kernel-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 8 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 16 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 20 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-cpp-kernel-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 10 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-go-kernel-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 16 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 18 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 18 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-php-kernel-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 2 0 0 0 0 2/2 (100.0%) 2/2 (100.0%) 100.0% 100.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 4 2 0 0 0 6/6 (100.0%) 4/6 (66.7%) 100.0% 66.7%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

semgrep-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 10 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 16 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 20 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-typescript-kernel-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 18 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a