Skip to content

Analyzers — v0.7.1

Each scorecard is one frozen report: one analyzer, one track, one score dimension, and one model profile. Scorecards are independent result populations and are never combined into a leaderboard. TPR/FPR are macro-averages over templates and then semantic dimensions; incomplete outcomes are coverage, never negatives.

All 82 reports in this snapshot were freshly rerun over the unchanged 852-case population. This includes the sixteen tool-native reports. The freshness claim is evidence-backed: the measurement audit records 82 fresh reports and 3,480 results.

The four changed cells are all in Java. Bifrost’s anonymous-implementation pair changed from inconclusive to reached / not-reached; OpenTaint’s callback-registration and map-iteration positive cells changed from not-reached to reached. The per-scorecard tables below are the authority for rates and denominators.

The two model profiles answer different questions. A benchmark-controlled card measures an engine with the benchmark’s model supplied; a tool-native card measures the product with nothing supplied. Native unsupported outcomes are declared capability boundaries and do not mean two wrong answers.

bifrost-c-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-c-kernel.json (41713490c402…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 48 20 20 8 0 0 100.0% 0.0%
c language-extension 2 1 0 1 0 0 100.0% n/a

bifrost-cpp-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-cpp-kernel.json (a6f05a8fbd87…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 56 15 15 26 0 0 100.0% 0.0%

bifrost-csharp-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-csharp-kernel.json (d429b9058879…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
csharp core 58 17 17 24 0 0 100.0% 0.0%

bifrost-go-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-go-kernel.json (b9e8c94bd033…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 58 18 18 22 0 0 100.0% 0.0%

bifrost-java-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-java-kernel.json (9bb51f339543…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 21 21 16 0 0 100.0% 0.0%

bifrost-java-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-java-modeling.json (49c2ffa6b912…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 4 3 1 16 0 100.0% 0.0%

bifrost-java-native-taint-taint-tool-native

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-java-native.json (505a1e07f165…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

bifrost-javascript-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-javascript-kernel.json (7d63063c5bde…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 19 19 20 0 0 100.0% 0.0%

bifrost-javascript-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-javascript-modeling.json (dde4c418f9d0…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 2 2 4 16 0 100.0% 0.0%

bifrost-javascript-native-taint-taint-tool-native

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-javascript-native.json (062f96e4537d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

bifrost-kotlin-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-kotlin-kernel.json (6aa93b6c2757…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 14 14 30 0 0 100.0% 0.0%

bifrost-php-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-php-kernel.json (055ac686a0e8…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 58 17 17 24 0 0 100.0% 0.0%

bifrost-python-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-python-kernel.json (a326d44a4847…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 18 18 22 0 0 100.0% 0.0%

bifrost-python-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-python-modeling.json (258e3bfb9823…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 4 3 1 16 0 100.0% 0.0%

bifrost-python-native-taint-taint-tool-native

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-python-native.json (e41b7689b10a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 0 0 12 0 n/a n/a

bifrost-ruby-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-ruby-kernel.json (ac3e4fc92494…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 11 11 36 0 0 100.0% 0.0%

bifrost-rust-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-rust-kernel.json (54cfc84db71e…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 19 19 16 0 0 100.0% 0.0%
rust language-extension 2 0 0 2 0 0 n/a n/a

bifrost-scala-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-scala-kernel.json (63da300b2138…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
scala core 58 19 19 20 0 0 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-smoke.json (40430c845adf…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 2 1 1 0 0 0 100.0% 0.0%
cpp core 2 1 1 0 0 0 100.0% 0.0%
csharp core 2 1 1 0 0 0 100.0% 0.0%
go core 2 1 1 0 0 0 100.0% 0.0%
java calibration 2 1 0 0 1 0 not scored not scored
java core 32 16 16 0 0 0 100.0% 0.0%
javascript core 32 16 16 0 0 0 100.0% 0.0%
kotlin core 2 1 1 0 0 0 100.0% 0.0%
php core 2 1 1 0 0 0 100.0% 0.0%
python core 32 16 16 0 0 0 100.0% 0.0%
ruby core 2 1 1 0 0 0 100.0% 0.0%
rust core 2 1 1 0 0 0 100.0% 0.0%
scala core 2 1 1 0 0 0 100.0% 0.0%
typescript core 2 1 1 0 0 0 100.0% 0.0%

bifrost-typescript-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.11.0 (build bd77fd7e47c1, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-typescript-kernel.json (d4b9ab940ef7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 58 18 18 22 0 0 100.0% 0.0%

codeql-c-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-c-kernel.json (bf7d2c046e26…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 48 23 24 1 0 0 75.6% 16.1%
c language-extension 2 2 0 0 0 0 100.0% n/a

codeql-cpp-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-cpp-kernel.json (73a40bf1258a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 56 18 37 1 0 0 53.2% 10.8%

codeql-csharp-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-csharp-kernel.json (77bee41d73f5…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
csharp core 58 24 33 1 0 0 69.4% 13.7%

codeql-go-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-go-kernel.json (bcacea95d44f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 58 24 34 0 0 0 66.6% 16.7%

codeql-java-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-java-kernel.json (bea06d23735c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 29 29 0 0 0 79.6% 19.8%

codeql-java-modeling-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-java-modeling.json (e8a1d5d6e4c2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-java-native-taint-taint-tool-native

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-java-native.json (d6df797021b6…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 7 5 0 0 0 100.0% 29.2%

codeql-javascript-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-javascript-kernel.json (2c9e02d8820b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 23 35 0 0 0 77.4% 9.0%

codeql-javascript-modeling-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-javascript-modeling.json (acd4495aadbc…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-javascript-native-taint-taint-tool-native

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-javascript-native.json (bdd4c4642649…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 7 5 0 0 0 70.8% 58.3%

codeql-kotlin-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-kotlin-kernel.json (35da5030e395…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 25 33 0 0 0 68.3% 17.1%

codeql-python-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-python-kernel.json (f4dae64dd7b1…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 23 34 1 0 0 70.5% 12.8%

codeql-python-modeling-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-python-modeling.json (63a1406a605f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-python-native-taint-taint-tool-native

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-python-native.json (0366d0521736…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 8 4 0 0 0 100.0% 58.3%

codeql-ruby-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-ruby-kernel.json (69b06df66907…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 22 35 1 0 0 64.3% 9.8%

codeql-rust-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-rust-kernel.json (ba05e002a47f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 21 33 0 0 0 71.4% 10.4%
rust language-extension 2 0 2 0 0 0 0.0% 0.0%

codeql-typescript-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-typescript-kernel.json (7eeb8c037543…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 58 23 35 0 0 0 77.4% 9.0%

flowdroid-java-kernel-taint-taint-benchmark-controlled

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/flowdroid-java-kernel.json (de78805a4e85…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 28 30 0 0 0 85.6% 14.3%

flowdroid-java-modeling-taint-taint-benchmark-controlled

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/flowdroid-java-modeling.json (51dd054808a9…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 7 7 0 10 0 100.0% 0.0%

flowdroid-java-native-taint-taint-tool-native

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/flowdroid-java-native.json (27678765cf4a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

flowdroid-kotlin-kernel-taint-taint-benchmark-controlled

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/flowdroid-kotlin-kernel.json (3c1466fd7945…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 30 28 0 0 0 89.0% 21.3%

infer-c-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/infer-c-kernel.json (6486e611e6b7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 48 21 27 0 0 0 72.4% 7.6%

infer-cpp-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/infer-cpp-kernel.json (b36c1bf27f4f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 56 19 37 0 0 0 52.9% 0.0%

infer-java-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/infer-java-kernel.json (9f707f11b630…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 21 37 0 0 0 66.9% 0.0%

infer-java-modeling-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/infer-java-modeling.json (2b0df6dfa8a7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 5 5 0 14 0 100.0% 0.0%

infer-java-native-taint-taint-tool-native

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/infer-java-native.json (13e3be0fab60…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

joern-java-kernel-taint-taint-benchmark-controlled

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-java-kernel.json (cc6cd2b96e55…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 26 32 0 0 0 71.8% 18.4%

joern-java-modeling-taint-taint-benchmark-controlled

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-java-modeling.json (9eb2e6cbb7f2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 6 10 0 8 0 50.0% 0.0%

joern-java-native-taint-taint-tool-native

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-java-native.json (0506cbb5fd53…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

joern-javascript-kernel-taint-taint-benchmark-controlled

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-javascript-kernel.json (ae36a6389035…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 27 31 0 0 0 68.1% 18.6%

joern-javascript-modeling-taint-taint-benchmark-controlled

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-javascript-modeling.json (5c6521100088…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 6 10 0 8 0 50.0% 0.0%

joern-javascript-native-taint-taint-tool-native

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-javascript-native.json (db92d4b76374…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

joern-php-kernel-taint-taint-benchmark-controlled

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-php-kernel.json (e1f9b3f0da16…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 58 25 33 0 0 0 70.2% 16.7%

joern-python-kernel-taint-taint-benchmark-controlled

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-python-kernel.json (838b2a50df7a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 25 33 0 0 0 70.2% 14.9%

joern-python-modeling-taint-taint-benchmark-controlled

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-python-modeling.json (300b351dbe09…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 6 10 0 8 0 50.0% 0.0%

joern-python-native-taint-taint-tool-native

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-python-native.json (a6a307052b7d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 0 0 12 0 n/a n/a

joern-ruby-kernel-taint-taint-benchmark-controlled

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-ruby-kernel.json (4984f62f0b2b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 23 35 0 0 0 54.8% 31.2%

joern-rust-kernel-taint-taint-benchmark-controlled

joern 4.0.621 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-rust-kernel.json (567b0fb00d02…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 20 34 0 0 0 70.3% 14.3%

opentaint-java-kernel-taint-taint-benchmark-controlled

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/opentaint-java-kernel.json (33ef292f0166…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 32 26 0 0 0 86.3% 17.8%

opentaint-java-modeling-taint-taint-benchmark-controlled

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/opentaint-java-modeling.json (2ad1060823a5…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 6 6 0 12 0 100.0% 0.0%

opentaint-java-native-taint-taint-tool-native

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/opentaint-java-native.json (e3456ec9661c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

opentaint-kotlin-kernel-taint-taint-benchmark-controlled

opentaint v0.4.6 (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/opentaint-kotlin-kernel.json (2904ae19a176…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 33 25 0 0 0 85.5% 23.7%

pysa-python-kernel-taint-taint-benchmark-controlled

pysa 0.10.0 (build pyre-check:0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/pysa-python-kernel.json (d97985a57e65…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 20 38 0 0 0 59.1% 7.9%

pysa-python-modeling-taint-taint-benchmark-controlled

pysa 0.10.0 (build pyre-check:0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/pysa-python-modeling.json (fb08e2fc7158…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 10 10 0 4 0 100.0% 0.0%

pysa-python-native-taint-taint-tool-native

pysa 0.10.0 (build pyre-check:0, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/pysa-python-native.json (64adb1284a96…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 12 0 0 0 0.0% 0.0%

semgrep-c-kernel-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-c-kernel.json (bf29d50fdea0…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 48 9 5 0 34 0 100.0% 42.9%

semgrep-cpp-kernel-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-cpp-kernel.json (6588c08b7628…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 56 9 5 0 42 0 100.0% 42.9%

semgrep-go-kernel-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-go-kernel.json (984dfbc4fb77…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 58 9 5 0 44 0 100.0% 42.9%

semgrep-java-kernel-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-java-kernel.json (1a8d4dfe44b9…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 9 5 0 44 0 100.0% 42.9%

semgrep-java-modeling-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-java-modeling.json (7cb186748186…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-java-native-taint-taint-tool-native

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-java-native.json (2b9b2ee794ce…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

semgrep-javascript-kernel-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-javascript-kernel.json (3bf590f88c5d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 9 5 0 44 0 100.0% 42.9%

semgrep-javascript-modeling-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-javascript-modeling.json (157275adc56b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-javascript-native-taint-taint-tool-native

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-javascript-native.json (367d6cf4371e…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

semgrep-kotlin-kernel-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-kotlin-kernel.json (f6fef39bcf82…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 9 5 0 44 0 100.0% 42.9%

semgrep-php-kernel-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-php-kernel.json (e35ba046d60a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 58 9 5 0 44 0 100.0% 42.9%

semgrep-python-kernel-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-python-kernel.json (51a5cd87f400…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 9 5 0 44 0 100.0% 42.9%

semgrep-python-modeling-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-python-modeling.json (c52d98d574fd…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-python-native-taint-taint-tool-native

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-python-native.json (ad9dc1a0ab69…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 10 2 0 0 0 100.0% 91.7%

semgrep-ruby-kernel-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-ruby-kernel.json (9580ceba4210…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 9 5 0 44 0 100.0% 42.9%

semgrep-rust-kernel-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-rust-kernel.json (a8a9672f2ffb…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 9 5 0 40 0 100.0% 42.9%

semgrep-typescript-kernel-taint-taint-benchmark-controlled

semgrep 1.176.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-typescript-kernel.json (22ebaece8440…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 58 9 5 0 44 0 100.0% 42.9%

bifrost-c-kernel-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 2 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 4 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 6 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 0 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-c-kernel-taint-taint-benchmark-controlledc, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
flow-sensitivity 0 0 0 0 1 0 0 n/a n/a n/a n/a
heap-field-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
interprocedural-flow 0 0 0 0 1 0 0 n/a n/a n/a n/a
local-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a

bifrost-cpp-kernel-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 4 0 0 4 12 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 14 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-csharp-kernel-taint-taint-benchmark-controlledcsharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 4 0 0 4 10 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 10 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-go-kernel-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 4 0 0 4 8 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 8 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 0 0 4 2 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
dynamic-dispatch 1 0 0 1 12 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 8 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 4 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 1 1 0 0 2/2 (100.0%) 0/1 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 6 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 10 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 0 0 0 0 4 0 0 n/a n/a n/a n/a
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 20 0 0 n/a n/a n/a n/a
interprocedural-flow 7 0 0 7 12 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-php-kernel-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 8 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 5 0 0 5 6 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 10 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 1 1 0 0 2/2 (100.0%) 0/1 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 20 0 0 n/a n/a n/a n/a
interprocedural-flow 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 5 0 0 5 6 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 6 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 6 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 0 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-rust-kernel-taint-taint-benchmark-controlledrust, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 0 0 0 2 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-scala-kernel-taint-taint-benchmark-controlledscala, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 10 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 12 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledcsharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledscala, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-typescript-kernel-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 10 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

codeql-c-kernel-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 1 0 4 0 0 0 3/4 (75.0%) 0/4 (0.0%) 75.0% 0.0%
dynamic-dispatch 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 2 2 6 0 0 0 6/8 (75.0%) 2/8 (25.0%) 75.0% 25.0%
interprocedural-flow 7 3 0 10 0 0 0 7/10 (70.0%) 0/10 (0.0%) 70.0% 0.0%
local-flow 7 0 1 5 1 0 0 7/7 (100.0%) 1/6 (16.7%) 100.0% 16.7%
object-sensitivity 3 2 1 4 0 0 0 3/5 (60.0%) 1/5 (20.0%) 60.0% 20.0%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-c-kernel-taint-taint-benchmark-controlledc, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
flow-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
heap-field-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
interprocedural-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
local-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a

codeql-cpp-kernel-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 3 7 1 9 0 0 0 3/10 (30.0%) 1/10 (10.0%) 30.0% 10.0%
interprocedural-flow 6 5 0 11 0 0 0 6/11 (54.5%) 0/11 (0.0%) 54.5% 0.0%
local-flow 7 1 1 6 1 0 0 7/8 (87.5%) 1/7 (14.3%) 87.5% 14.3%
object-sensitivity 1 4 0 5 0 0 0 1/5 (20.0%) 0/5 (0.0%) 20.0% 0.0%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-csharp-kernel-taint-taint-benchmark-controlledcsharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 2 7 0 0 0 6/9 (66.7%) 2/9 (22.2%) 66.7% 22.2%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 6 2 1 6 1 0 0 6/8 (75.0%) 1/7 (14.3%) 75.0% 14.3%
object-sensitivity 4 2 1 5 0 0 0 4/6 (66.7%) 1/6 (16.7%) 66.7% 16.7%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-go-kernel-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 1 5 0 6 0 0 0 1/6 (16.7%) 0/6 (0.0%) 16.7% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 2 2 6 0 0 0 6/8 (75.0%) 2/8 (25.0%) 75.0% 25.0%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 6 2 2 6 0 0 0 6/8 (75.0%) 2/8 (25.0%) 75.0% 25.0%
object-sensitivity 4 2 1 5 0 0 0 4/6 (66.7%) 1/6 (16.7%) 66.7% 16.7%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 5 2 2 5 0 0 0 5/7 (71.4%) 2/7 (28.6%) 71.4% 28.6%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 3 7 0 0 0 7/10 (70.0%) 3/10 (30.0%) 70.0% 30.0%
interprocedural-flow 9 0 0 9 0 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 1 2 3 0 0 0 4/5 (80.0%) 2/5 (40.0%) 80.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 1 5 0 0 0 6/6 (100.0%) 1/6 (16.7%) 100.0% 16.7%
sanitizer 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 1 8 0 0 0 6/9 (66.7%) 1/9 (11.1%) 66.7% 11.1%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 1 0 0 0 0 0/1 (0.0%) 1/1 (100.0%) 0.0% 100.0%
local-flow 5 1 2 4 0 0 0 5/6 (83.3%) 2/6 (33.3%) 83.3% 33.3%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

codeql-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 2 5 1 6 0 0 0 2/7 (28.6%) 1/7 (14.3%) 28.6% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 3 7 0 0 0 7/10 (70.0%) 3/10 (30.0%) 70.0% 30.0%
interprocedural-flow 9 4 1 12 0 0 0 9/13 (69.2%) 1/13 (7.7%) 69.2% 7.7%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 1 2 3 0 0 0 4/5 (80.0%) 2/5 (40.0%) 80.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 5 0 7 0 0 0 2/7 (28.6%) 0/7 (0.0%) 28.6% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 4 1 9 0 0 0 6/10 (60.0%) 1/10 (10.0%) 60.0% 10.0%
interprocedural-flow 9 4 0 13 0 0 0 9/13 (69.2%) 0/13 (0.0%) 69.2% 0.0%
local-flow 7 1 1 6 1 0 0 7/8 (87.5%) 1/7 (14.3%) 87.5% 14.3%
object-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

codeql-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 1 6 0 7 0 0 0 1/7 (14.3%) 0/7 (0.0%) 14.3% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 4 0 10 0 0 0 6/10 (60.0%) 0/10 (0.0%) 60.0% 0.0%
interprocedural-flow 8 5 0 13 0 0 0 8/13 (61.5%) 0/13 (0.0%) 61.5% 0.0%
local-flow 7 1 1 6 1 0 0 7/8 (87.5%) 1/7 (14.3%) 87.5% 14.3%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 1 1 1 0 0 3/3 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 5 3 1 7 0 0 0 5/8 (62.5%) 1/8 (12.5%) 62.5% 12.5%
interprocedural-flow 7 3 0 10 0 0 0 7/10 (70.0%) 0/10 (0.0%) 70.0% 0.0%
local-flow 7 0 1 6 0 0 0 7/7 (100.0%) 1/7 (14.3%) 100.0% 14.3%
object-sensitivity 3 3 0 6 0 0 0 3/6 (50.0%) 0/6 (0.0%) 50.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-rust-kernel-taint-taint-benchmark-controlledrust, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

codeql-typescript-kernel-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 1 8 0 0 0 6/9 (66.7%) 1/9 (11.1%) 66.7% 11.1%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

flowdroid-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 5 1 6 0 0 0 2/7 (28.6%) 1/7 (14.3%) 28.6% 14.3%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 9 1 3 7 0 0 0 9/10 (90.0%) 3/10 (30.0%) 90.0% 30.0%
interprocedural-flow 7 2 0 9 0 0 0 7/9 (77.8%) 0/9 (0.0%) 77.8% 0.0%
local-flow 8 0 1 7 0 0 0 8/8 (100.0%) 1/8 (12.5%) 100.0% 12.5%
object-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

flowdroid-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 4 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

flowdroid-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

flowdroid-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 2 5 0 0 0 3/7 (42.9%) 2/7 (28.6%) 42.9% 28.6%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 9 1 3 7 0 0 0 9/10 (90.0%) 3/10 (30.0%) 90.0% 30.0%
interprocedural-flow 10 3 2 11 0 0 0 10/13 (76.9%) 2/13 (15.4%) 76.9% 15.4%
local-flow 8 0 1 7 0 0 0 8/8 (100.0%) 1/8 (12.5%) 100.0% 12.5%
object-sensitivity 5 0 2 3 0 0 0 5/5 (100.0%) 2/5 (40.0%) 100.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

infer-c-kernel-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 0 1 3 0 0 0 4/4 (100.0%) 1/4 (25.0%) 100.0% 25.0%
dynamic-dispatch 2 1 1 2 0 0 0 2/3 (66.7%) 1/3 (33.3%) 66.7% 33.3%
flow-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
heap-field-sensitivity 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
interprocedural-flow 8 2 1 9 0 0 0 8/10 (80.0%) 1/10 (10.0%) 80.0% 10.0%
local-flow 5 2 0 7 0 0 0 5/7 (71.4%) 0/7 (0.0%) 71.4% 0.0%
object-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

infer-cpp-kernel-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
heap-field-sensitivity 7 3 0 10 0 0 0 7/10 (70.0%) 0/10 (0.0%) 70.0% 0.0%
interprocedural-flow 7 4 0 11 0 0 0 7/11 (63.6%) 0/11 (0.0%) 63.6% 0.0%
local-flow 5 3 0 8 0 0 0 5/8 (62.5%) 0/8 (0.0%) 62.5% 0.0%
object-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

infer-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 3 4 0 7 0 0 0 3/7 (42.9%) 0/7 (0.0%) 42.9% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
heap-field-sensitivity 8 2 0 10 0 0 0 8/10 (80.0%) 0/10 (0.0%) 80.0% 0.0%
interprocedural-flow 7 2 0 9 0 0 0 7/9 (77.8%) 0/9 (0.0%) 77.8% 0.0%
local-flow 6 2 0 8 0 0 0 6/8 (75.0%) 0/8 (0.0%) 75.0% 0.0%
object-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

infer-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 1 0 0 1 0 10 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

infer-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 2 5 0 0 0 3/7 (42.9%) 2/7 (28.6%) 42.9% 28.6%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 1 9 0 0 0 7/10 (70.0%) 1/10 (10.0%) 70.0% 10.0%
interprocedural-flow 7 2 0 9 0 0 0 7/9 (77.8%) 0/9 (0.0%) 77.8% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 4 5 0 0 0 6/9 (66.7%) 4/9 (44.4%) 66.7% 44.4%
interprocedural-flow 7 4 0 11 0 0 0 7/11 (63.6%) 0/11 (0.0%) 63.6% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 3 1 5 0 0 0 3/6 (50.0%) 1/6 (16.7%) 50.0% 16.7%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-php-kernel-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 1 6 0 0 0 3/7 (42.9%) 1/7 (14.3%) 42.9% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 0 10 0 0 0 7/10 (70.0%) 0/10 (0.0%) 70.0% 0.0%
interprocedural-flow 8 5 1 12 0 0 0 8/13 (61.5%) 1/13 (7.7%) 61.5% 7.7%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 3 4 1 6 0 0 0 3/7 (42.9%) 1/7 (14.3%) 42.9% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 1 9 0 0 0 7/10 (70.0%) 1/10 (10.0%) 70.0% 10.0%
interprocedural-flow 8 5 0 13 0 0 0 8/13 (61.5%) 0/13 (0.0%) 61.5% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 3 2 3 0 0 0 2/5 (40.0%) 2/5 (40.0%) 40.0% 40.0%
dynamic-dispatch 1 6 1 6 0 0 0 1/7 (14.3%) 1/7 (14.3%) 14.3% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 4 6 1 9 0 0 0 4/10 (40.0%) 1/10 (10.0%) 40.0% 10.0%
interprocedural-flow 6 7 3 10 0 0 0 6/13 (46.2%) 3/13 (23.1%) 46.2% 23.1%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 1 4 0 5 0 0 0 1/5 (20.0%) 0/5 (0.0%) 20.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

joern-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 5 3 0 8 0 0 0 5/8 (62.5%) 0/8 (0.0%) 62.5% 0.0%
interprocedural-flow 6 4 0 10 0 0 0 6/10 (60.0%) 0/10 (0.0%) 60.0% 0.0%
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 3 3 0 6 0 0 0 3/6 (50.0%) 0/6 (0.0%) 50.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

opentaint-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 6 1 2 5 0 0 0 6/7 (85.7%) 2/7 (28.6%) 85.7% 28.6%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 9 1 3 7 0 0 0 9/10 (90.0%) 3/10 (30.0%) 90.0% 30.0%
interprocedural-flow 9 0 0 9 0 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

opentaint-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 2 0 0 2 0 8 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

opentaint-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

opentaint-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 6 1 3 4 0 0 0 6/7 (85.7%) 3/7 (42.9%) 85.7% 42.9%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 9 1 4 6 0 0 0 9/10 (90.0%) 4/10 (40.0%) 90.0% 40.0%
interprocedural-flow 12 1 2 11 0 0 0 12/13 (92.3%) 2/13 (15.4%) 92.3% 15.4%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 5 0 2 3 0 0 0 5/5 (100.0%) 2/5 (40.0%) 100.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

pysa-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 7 0 7 0 0 0 0/7 (0.0%) 0/7 (0.0%) 0.0% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 5 5 0 10 0 0 0 5/10 (50.0%) 0/10 (0.0%) 50.0% 0.0%
interprocedural-flow 7 6 0 13 0 0 0 7/13 (53.8%) 0/13 (0.0%) 53.8% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

pysa-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 4 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

pysa-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 2 0 2 0 0 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
local-flow 0 6 0 6 0 0 0 0/6 (0.0%) 0/6 (0.0%) 0.0% 0.0%
sanitizer 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

semgrep-c-kernel-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 8 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 16 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 20 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-cpp-kernel-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 10 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-go-kernel-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 16 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 18 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 18 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-php-kernel-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 2 0 0 0 0 2/2 (100.0%) 2/2 (100.0%) 100.0% 100.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 4 2 0 0 0 6/6 (100.0%) 4/6 (66.7%) 100.0% 66.7%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

semgrep-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 10 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 16 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 20 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-typescript-kernel-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 18 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a