Skip to content

Analyzers — v0.6.0

Each scorecard is one frozen report: one analyzer, one track, one score dimension, one model profile. Scorecards are independent result populations and are never combined into a leaderboard. TPR/FPR are macro-averages over templates, then semantic dimensions; incomplete outcomes are coverage, never negatives.

This snapshot’s scorecards span two model profiles, and every card below states its own. A benchmark-controlled card and a tool-native card answer different questions on different populations: the first measures the engine with the benchmark’s model supplied, the second measures the product with nothing supplied. Do not read them against each other.

Eight analyzers appear here, and they do not cover the same languages. The number of cards an analyzer has is its coverage in this freeze, not its quality: Bifrost has a card for every kernel, Pysa has one. Comparing card counts is comparing footprints.

bifrost-c-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-c-kernel.json (8148bfd8f2b9…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 48 20 20 8 0 0 100.0% 0.0%
c language-extension 2 1 0 1 0 0 100.0% n/a

bifrost-cpp-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-cpp-kernel.json (13995907b442…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 56 15 15 26 0 0 100.0% 0.0%

bifrost-csharp-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-csharp-kernel.json (fba07c6c710d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
csharp core 58 19 15 24 0 0 100.0% 18.4%

bifrost-go-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-go-kernel.json (010ac34f973a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 58 19 17 22 0 0 100.0% 10.1%

bifrost-java-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-java-kernel.json (1cf243b3b656…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 18 20 20 0 0 98.6% 0.0%

bifrost-java-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-java-modeling.json (e3826115c7c9…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 4 4 0 16 0 100.0% 0.0%

bifrost-java-native-taint-taint-tool-native

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-java-native.json (1958c07c4a2f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

bifrost-javascript-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-javascript-kernel.json (ae46adf16ba8…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 18 18 22 0 0 100.0% 0.0%

bifrost-javascript-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-javascript-modeling.json (e9919e1dbc30…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 2 3 3 16 0 100.0% 0.0%

bifrost-javascript-native-taint-taint-tool-native

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-javascript-native.json (79002ce778c6…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

bifrost-kotlin-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-kotlin-kernel.json (5015b8561bcf…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 14 14 30 0 0 100.0% 0.0%

bifrost-php-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-php-kernel.json (39bb8476a9bf…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 58 16 16 26 0 0 100.0% 0.0%

bifrost-python-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-python-kernel.json (ea4d22001898…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 18 18 22 0 0 100.0% 0.0%

bifrost-python-modeling-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-python-modeling.json (7c60420cf77a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 4 4 0 16 0 100.0% 0.0%

bifrost-python-native-taint-taint-tool-native

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/bifrost-python-native.json (005c3ea542b2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 0 0 12 0 n/a n/a

bifrost-ruby-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-ruby-kernel.json (0c20d8e951de…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 12 10 36 0 0 100.0% 14.0%

bifrost-rust-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-rust-kernel.json (633c21813ff3…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 18 18 18 0 0 100.0% 0.0%
rust language-extension 2 0 0 2 0 0 n/a n/a

bifrost-scala-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-scala-kernel.json (992a0bc3467c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
scala core 58 19 19 20 0 0 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-smoke.json (1e123684a11d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 2 1 1 0 0 0 100.0% 0.0%
cpp core 2 1 1 0 0 0 100.0% 0.0%
csharp core 2 1 1 0 0 0 100.0% 0.0%
go core 2 1 1 0 0 0 100.0% 0.0%
java calibration 2 1 0 0 1 0 not scored not scored
java core 32 16 16 0 0 0 100.0% 0.0%
javascript core 32 16 16 0 0 0 100.0% 0.0%
kotlin core 2 1 1 0 0 0 100.0% 0.0%
php core 2 1 1 0 0 0 100.0% 0.0%
python core 32 16 16 0 0 0 100.0% 0.0%
ruby core 2 1 1 0 0 0 100.0% 0.0%
rust core 2 1 1 0 0 0 100.0% 0.0%
scala core 2 1 1 0 0 0 100.0% 0.0%
typescript core 2 1 1 0 0 0 100.0% 0.0%

bifrost-typescript-kernel-taint-taint-benchmark-controlled

bifrost bifrost 0.10.7 (build 44d9a5be4164, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/bifrost-typescript-kernel.json (1bfa7b0604d8…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 58 17 17 24 0 0 100.0% 0.0%

codeql-c-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-c-kernel.json (0bbf4766f6a5…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 48 23 25 0 0 0 75.6% 14.0%
c language-extension 2 2 0 0 0 0 100.0% n/a

codeql-cpp-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-cpp-kernel.json (f314c4185eae…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 56 18 38 0 0 0 53.2% 8.9%

codeql-csharp-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-csharp-kernel.json (313b44a93327…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
csharp core 58 24 34 0 0 0 69.4% 11.8%

codeql-go-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-go-kernel.json (99dc5a3c7c17…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 58 24 34 0 0 0 66.6% 16.7%

codeql-java-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-java-kernel.json (50418965ee29…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 29 29 0 0 0 79.6% 19.8%

codeql-java-modeling-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-java-modeling.json (14c991ee939e…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-java-native-taint-taint-tool-native

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-java-native.json (5d7d7b152c93…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 7 5 0 0 0 100.0% 29.2%

codeql-javascript-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-javascript-kernel.json (78ad35bbf788…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 23 35 0 0 0 77.4% 9.0%

codeql-javascript-modeling-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-javascript-modeling.json (3a908bdc80fb…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-javascript-native-taint-taint-tool-native

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-javascript-native.json (bd5fe87f32f7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 7 5 0 0 0 70.8% 58.3%

codeql-kotlin-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-kotlin-kernel.json (ee7720f6d318…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 25 33 0 0 0 68.3% 17.1%

codeql-python-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-python-kernel.json (cd304f94b4d9…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 23 35 0 0 0 70.5% 10.9%

codeql-python-modeling-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-python-modeling.json (60ff9613a8e5…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 12 12 0 0 0 100.0% 0.0%

codeql-python-native-taint-taint-tool-native

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/codeql-python-native.json (2958f4e44c40…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 8 4 0 0 0 100.0% 58.3%

codeql-ruby-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-ruby-kernel.json (10fb9cc1a8d2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 22 36 0 0 0 64.3% 7.9%

codeql-rust-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-rust-kernel.json (b98733c392bc…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 21 33 0 0 0 71.4% 10.4%
rust language-extension 2 0 2 0 0 0 0.0% 0.0%

codeql-typescript-kernel-taint-taint-benchmark-controlled

codeql 2.26.4 (build 6b1e4dee94ad, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/codeql-typescript-kernel.json (49eaacb9cf7e…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 58 23 35 0 0 0 77.4% 9.0%

flowdroid-java-kernel-taint-taint-benchmark-controlled

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/flowdroid-java-kernel.json (df7fbd5263d3…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 28 30 0 0 0 85.6% 14.3%

flowdroid-kotlin-kernel-taint-taint-benchmark-controlled

flowdroid 2.15.1 (build soot-infoflo, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/flowdroid-kotlin-kernel.json (44bb26f4541c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 30 28 0 0 0 89.0% 21.3%

infer-c-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/infer-c-kernel.json (35a5f9de818f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 48 21 27 0 0 0 72.4% 7.6%

infer-cpp-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/infer-cpp-kernel.json (fc3b5fd70a89…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 56 19 37 0 0 0 52.9% 0.0%

infer-java-kernel-taint-taint-benchmark-controlled

infer v1.3.0 (build infer:v1.3.0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/infer-java-kernel.json (9eb9d7ce745f…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 21 37 0 0 0 66.9% 0.0%

joern-java-kernel-taint-taint-benchmark-controlled

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-java-kernel.json (8f74bb4d958b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 26 32 0 0 0 71.8% 18.4%

joern-java-modeling-taint-taint-benchmark-controlled

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-java-modeling.json (21fb1d444a2d…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 6 10 0 8 0 50.0% 0.0%

joern-java-native-taint-taint-tool-native

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-java-native.json (a438c1ecdc09…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

joern-javascript-kernel-taint-taint-benchmark-controlled

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-javascript-kernel.json (9f54af854f6b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 27 31 0 0 0 68.1% 18.6%

joern-javascript-modeling-taint-taint-benchmark-controlled

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-javascript-modeling.json (cd6372a8fc9b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 6 10 0 8 0 50.0% 0.0%

joern-javascript-native-taint-taint-tool-native

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-javascript-native.json (b8f493cdb376…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

joern-php-kernel-taint-taint-benchmark-controlled

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-php-kernel.json (153d0fb50e2c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 58 25 33 0 0 0 70.2% 16.7%

joern-python-kernel-taint-taint-benchmark-controlled

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-python-kernel.json (811b6d11d5f9…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 25 33 0 0 0 70.2% 14.9%

joern-python-modeling-taint-taint-benchmark-controlled

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-python-modeling.json (3e05499c361b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 6 10 0 8 0 50.0% 0.0%

joern-python-native-taint-taint-tool-native

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/joern-python-native.json (d7015cc6c9b1…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 0 0 0 12 0 n/a n/a

joern-ruby-kernel-taint-taint-benchmark-controlled

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-ruby-kernel.json (9f2b18c4d168…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 23 35 0 0 0 54.8% 31.2%

joern-rust-kernel-taint-taint-benchmark-controlled

joern 4.0.614 (build joern-cli:4., adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/joern-rust-kernel.json (465269d73a07…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 20 34 0 0 0 70.3% 14.3%

opentaint-java-kernel-taint-taint-benchmark-controlled

opentaint analyzer/2026.08.27.17eb0fe (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/opentaint-java-kernel.json (de32158291e6…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 30 28 0 0 0 80.8% 17.8%

opentaint-kotlin-kernel-taint-taint-benchmark-controlled

opentaint analyzer/2026.08.27.17eb0fe (build opentaint-pr, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/opentaint-kotlin-kernel.json (1fb872fea820…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 33 25 0 0 0 85.5% 23.7%

pysa-python-kernel-taint-taint-benchmark-controlled

pysa 0.10.0 (build pyre-check:0, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/pysa-python-kernel.json (125faf9d9127…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 20 38 0 0 0 59.1% 7.9%

semgrep-c-kernel-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-c-kernel.json (5192f0b66650…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
c core 48 9 5 0 34 0 100.0% 42.9%

semgrep-cpp-kernel-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-cpp-kernel.json (40de77a28a69…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
cpp core 56 9 5 0 42 0 100.0% 42.9%

semgrep-go-kernel-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-go-kernel.json (77d87ca7eee6…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
go core 58 9 5 0 44 0 100.0% 42.9%

semgrep-java-kernel-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-java-kernel.json (05ab32127cb7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java core 58 9 5 0 44 0 100.0% 42.9%

semgrep-java-modeling-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-java-modeling.json (94a5eda43ab2…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-java-native-taint-taint-tool-native

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-java-native.json (f20ab62be7d8…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
java modeling 12 0 0 0 12 0 n/a n/a

semgrep-javascript-kernel-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-javascript-kernel.json (ae4527e7a74c…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript core 58 9 5 0 44 0 100.0% 42.9%

semgrep-javascript-modeling-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-javascript-modeling.json (5745951d82b9…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-javascript-native-taint-taint-tool-native

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-javascript-native.json (249bd7e02095…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
javascript modeling 12 0 0 0 12 0 n/a n/a

semgrep-kotlin-kernel-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-kotlin-kernel.json (3fd452bdb1b7…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
kotlin core 58 9 5 0 44 0 100.0% 42.9%

semgrep-php-kernel-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-php-kernel.json (b04ee7111c66…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
php core 58 9 5 0 44 0 100.0% 42.9%

semgrep-python-kernel-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-python-kernel.json (6341e3f6321e…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python core 58 9 5 0 44 0 100.0% 42.9%

semgrep-python-modeling-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-python-modeling.json (a269705d853a…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 24 5 5 0 14 0 100.0% 0.0%

semgrep-python-native-taint-taint-tool-native

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile tool-native. Normalized report: reports/semgrep-python-native.json (a0187f8a2fb1…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
python modeling 12 10 2 0 0 0 100.0% 91.7%

semgrep-ruby-kernel-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-ruby-kernel.json (deae3cd4a04b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
ruby core 58 9 5 0 44 0 100.0% 42.9%

semgrep-rust-kernel-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-rust-kernel.json (7b93011a586b…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
rust core 54 9 5 0 40 0 100.0% 42.9%

semgrep-typescript-kernel-taint-taint-benchmark-controlled

semgrep 1.175.0 (build semgrep-oss:, adapter 0.1.0) — track taint, dimension taint, model profile benchmark-controlled. Normalized report: reports/semgrep-typescript-kernel.json (691658e531af…).

Language Tier Cases Reached Not reached Inconclusive Unsupported Runner error TPR (macro) FPR (macro)
typescript core 58 9 5 0 44 0 100.0% 42.9%

bifrost-c-kernel-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 2 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 6 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 6 0 0 6 4 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 6 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 0 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-c-kernel-taint-taint-benchmark-controlledc, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
flow-sensitivity 0 0 0 0 1 0 0 n/a n/a n/a n/a
heap-field-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
interprocedural-flow 0 0 0 0 1 0 0 n/a n/a n/a n/a
local-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a

bifrost-cpp-kernel-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 4 0 0 4 12 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 14 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-csharp-kernel-taint-taint-benchmark-controlledcsharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 4 0 0 4 10 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 10 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 7 0 2 5 2 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-go-kernel-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 4 0 0 4 8 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 8 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 0 1 6 2 0 0 7/7 (100.0%) 1/7 (14.3%) 100.0% 14.3%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 10 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 4 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 1 0 8 0 0 0 7/8 (87.5%) 0/8 (0.0%) 87.5% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 8 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 10 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 0 0 0 1 3 0 0 n/a 0/1 (0.0%) n/a 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 20 0 0 n/a n/a n/a n/a
interprocedural-flow 7 0 0 7 12 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-php-kernel-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 10 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 5 0 0 5 6 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 10 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 8 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

bifrost-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

bifrost-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 2 0 0 2 2 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 20 0 0 n/a n/a n/a n/a
interprocedural-flow 6 0 0 6 14 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 5 0 1 4 6 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
object-sensitivity 0 0 0 0 10 0 0 n/a n/a n/a n/a
path-sensitivity 2 0 1 1 2 0 0 2/2 (100.0%) 1/2 (50.0%) 100.0% 50.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 10 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 6 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 8 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 0 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 3 0 0 3 6 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-rust-kernel-taint-taint-benchmark-controlledrust, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 0 0 0 2 0 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a

bifrost-scala-kernel-taint-taint-benchmark-controlledscala, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 14 0 0 n/a n/a n/a n/a
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 10 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 7 0 0 7 12 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 6 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledcsharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
interprocedural-flow 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
local-flow 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledscala, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-smoke-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
local-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

bifrost-typescript-kernel-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 0 0 3 4 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
dynamic-dispatch 0 0 0 0 12 0 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 2 0 0 n/a n/a n/a n/a
flow-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
heap-field-sensitivity 4 0 0 4 10 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 10 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 7 0 0 7 2 0 0 7/7 (100.0%) 0/7 (0.0%) 100.0% 0.0%
object-sensitivity 2 0 0 2 8 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
path-sensitivity 3 0 0 3 0 0 0 3/3 (100.0%) 0/3 (0.0%) 100.0% 0.0%
recursion 0 0 0 0 2 0 0 n/a n/a n/a n/a

codeql-c-kernel-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 1 0 4 0 0 0 3/4 (75.0%) 0/4 (0.0%) 75.0% 0.0%
dynamic-dispatch 0 3 0 3 0 0 0 0/3 (0.0%) 0/3 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 2 2 6 0 0 0 6/8 (75.0%) 2/8 (25.0%) 75.0% 25.0%
interprocedural-flow 7 3 0 10 0 0 0 7/10 (70.0%) 0/10 (0.0%) 70.0% 0.0%
local-flow 7 0 1 6 0 0 0 7/7 (100.0%) 1/7 (14.3%) 100.0% 14.3%
object-sensitivity 3 2 1 4 0 0 0 3/5 (60.0%) 1/5 (20.0%) 60.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-c-kernel-taint-taint-benchmark-controlledc, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
flow-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
heap-field-sensitivity 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
interprocedural-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a
local-flow 1 0 0 0 0 0 0 1/1 (100.0%) n/a 100.0% n/a

codeql-cpp-kernel-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 3 7 1 9 0 0 0 3/10 (30.0%) 1/10 (10.0%) 30.0% 10.0%
interprocedural-flow 6 5 0 11 0 0 0 6/11 (54.5%) 0/11 (0.0%) 54.5% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 1 4 0 5 0 0 0 1/5 (20.0%) 0/5 (0.0%) 20.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-csharp-kernel-taint-taint-benchmark-controlledcsharp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 2 7 0 0 0 6/9 (66.7%) 2/9 (22.2%) 66.7% 22.2%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 2 1 5 0 0 0 4/6 (66.7%) 1/6 (16.7%) 66.7% 16.7%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-go-kernel-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 1 5 0 6 0 0 0 1/6 (16.7%) 0/6 (0.0%) 16.7% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 2 2 6 0 0 0 6/8 (75.0%) 2/8 (25.0%) 75.0% 25.0%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 6 2 2 6 0 0 0 6/8 (75.0%) 2/8 (25.0%) 75.0% 25.0%
object-sensitivity 4 2 1 5 0 0 0 4/6 (66.7%) 1/6 (16.7%) 66.7% 16.7%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 5 2 2 5 0 0 0 5/7 (71.4%) 2/7 (28.6%) 71.4% 28.6%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 3 7 0 0 0 7/10 (70.0%) 3/10 (30.0%) 70.0% 30.0%
interprocedural-flow 9 0 0 9 0 0 0 9/9 (100.0%) 0/9 (0.0%) 100.0% 0.0%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 1 2 3 0 0 0 4/5 (80.0%) 2/5 (40.0%) 80.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 1 5 0 0 0 6/6 (100.0%) 1/6 (16.7%) 100.0% 16.7%
sanitizer 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 1 8 0 0 0 6/9 (66.7%) 1/9 (11.1%) 66.7% 11.1%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 1 0 0 0 0 0/1 (0.0%) 1/1 (100.0%) 0.0% 100.0%
local-flow 5 1 2 4 0 0 0 5/6 (83.3%) 2/6 (33.3%) 83.3% 33.3%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

codeql-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 2 5 1 6 0 0 0 2/7 (28.6%) 1/7 (14.3%) 28.6% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 3 7 0 0 0 7/10 (70.0%) 3/10 (30.0%) 70.0% 30.0%
interprocedural-flow 9 4 1 12 0 0 0 9/13 (69.2%) 1/13 (7.7%) 69.2% 7.7%
local-flow 6 2 1 7 0 0 0 6/8 (75.0%) 1/8 (12.5%) 75.0% 12.5%
object-sensitivity 4 1 2 3 0 0 0 4/5 (80.0%) 2/5 (40.0%) 80.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 5 0 7 0 0 0 2/7 (28.6%) 0/7 (0.0%) 28.6% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 4 1 9 0 0 0 6/10 (60.0%) 1/10 (10.0%) 60.0% 10.0%
interprocedural-flow 9 4 0 13 0 0 0 9/13 (69.2%) 0/13 (0.0%) 69.2% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 4 0 0 4 0 0 0 4/4 (100.0%) 0/4 (0.0%) 100.0% 0.0%
heap-field-sensitivity 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
interprocedural-flow 6 0 0 6 0 0 0 6/6 (100.0%) 0/6 (0.0%) 100.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

codeql-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 2 4 0 0 0 6/6 (100.0%) 2/6 (33.3%) 100.0% 33.3%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

codeql-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 1 6 0 7 0 0 0 1/7 (14.3%) 0/7 (0.0%) 14.3% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 4 0 10 0 0 0 6/10 (60.0%) 0/10 (0.0%) 60.0% 0.0%
interprocedural-flow 8 5 0 13 0 0 0 8/13 (61.5%) 0/13 (0.0%) 61.5% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 5 3 1 7 0 0 0 5/8 (62.5%) 1/8 (12.5%) 62.5% 12.5%
interprocedural-flow 7 3 0 10 0 0 0 7/10 (70.0%) 0/10 (0.0%) 70.0% 0.0%
local-flow 7 0 1 6 0 0 0 7/7 (100.0%) 1/7 (14.3%) 100.0% 14.3%
object-sensitivity 3 3 0 6 0 0 0 3/6 (50.0%) 0/6 (0.0%) 50.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

codeql-rust-kernel-taint-taint-benchmark-controlledrust, language-extension

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
heap-field-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

codeql-typescript-kernel-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 1 8 0 0 0 6/9 (66.7%) 1/9 (11.1%) 66.7% 11.1%
interprocedural-flow 8 3 0 11 0 0 0 8/11 (72.7%) 0/11 (0.0%) 72.7% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

flowdroid-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 5 1 6 0 0 0 2/7 (28.6%) 1/7 (14.3%) 28.6% 14.3%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 9 1 3 7 0 0 0 9/10 (90.0%) 3/10 (30.0%) 90.0% 30.0%
interprocedural-flow 7 2 0 9 0 0 0 7/9 (77.8%) 0/9 (0.0%) 77.8% 0.0%
local-flow 8 0 1 7 0 0 0 8/8 (100.0%) 1/8 (12.5%) 100.0% 12.5%
object-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

flowdroid-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 2 5 0 0 0 3/7 (42.9%) 2/7 (28.6%) 42.9% 28.6%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 9 1 3 7 0 0 0 9/10 (90.0%) 3/10 (30.0%) 90.0% 30.0%
interprocedural-flow 10 3 2 11 0 0 0 10/13 (76.9%) 2/13 (15.4%) 76.9% 15.4%
local-flow 8 0 1 7 0 0 0 8/8 (100.0%) 1/8 (12.5%) 100.0% 12.5%
object-sensitivity 5 0 2 3 0 0 0 5/5 (100.0%) 2/5 (40.0%) 100.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

infer-c-kernel-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 0 1 3 0 0 0 4/4 (100.0%) 1/4 (25.0%) 100.0% 25.0%
dynamic-dispatch 2 1 1 2 0 0 0 2/3 (66.7%) 1/3 (33.3%) 66.7% 33.3%
flow-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
heap-field-sensitivity 8 0 0 8 0 0 0 8/8 (100.0%) 0/8 (0.0%) 100.0% 0.0%
interprocedural-flow 8 2 1 9 0 0 0 8/10 (80.0%) 1/10 (10.0%) 80.0% 10.0%
local-flow 5 2 0 7 0 0 0 5/7 (71.4%) 0/7 (0.0%) 71.4% 0.0%
object-sensitivity 5 0 0 5 0 0 0 5/5 (100.0%) 0/5 (0.0%) 100.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

infer-cpp-kernel-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
heap-field-sensitivity 7 3 0 10 0 0 0 7/10 (70.0%) 0/10 (0.0%) 70.0% 0.0%
interprocedural-flow 7 4 0 11 0 0 0 7/11 (63.6%) 0/11 (0.0%) 63.6% 0.0%
local-flow 5 3 0 8 0 0 0 5/8 (62.5%) 0/8 (0.0%) 62.5% 0.0%
object-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

infer-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 3 4 0 7 0 0 0 3/7 (42.9%) 0/7 (0.0%) 42.9% 0.0%
exceptional-flow 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%
flow-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
heap-field-sensitivity 8 2 0 10 0 0 0 8/10 (80.0%) 0/10 (0.0%) 80.0% 0.0%
interprocedural-flow 7 2 0 9 0 0 0 7/9 (77.8%) 0/9 (0.0%) 77.8% 0.0%
local-flow 6 2 0 8 0 0 0 6/8 (75.0%) 0/8 (0.0%) 75.0% 0.0%
object-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
path-sensitivity 2 1 0 3 0 0 0 2/3 (66.7%) 0/3 (0.0%) 66.7% 0.0%
recursion 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%

joern-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 2 5 0 0 0 3/7 (42.9%) 2/7 (28.6%) 42.9% 28.6%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 1 9 0 0 0 7/10 (70.0%) 1/10 (10.0%) 70.0% 10.0%
interprocedural-flow 7 2 0 9 0 0 0 7/9 (77.8%) 0/9 (0.0%) 77.8% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 2 4 0 6 0 0 0 2/6 (33.3%) 0/6 (0.0%) 33.3% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 6 3 4 5 0 0 0 6/9 (66.7%) 4/9 (44.4%) 66.7% 44.4%
interprocedural-flow 7 4 0 11 0 0 0 7/11 (63.6%) 0/11 (0.0%) 63.6% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 3 1 5 0 0 0 3/6 (50.0%) 1/6 (16.7%) 50.0% 16.7%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-php-kernel-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
dynamic-dispatch 3 4 1 6 0 0 0 3/7 (42.9%) 1/7 (14.3%) 42.9% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 0 10 0 0 0 7/10 (70.0%) 0/10 (0.0%) 70.0% 0.0%
interprocedural-flow 8 5 1 12 0 0 0 8/13 (61.5%) 1/13 (7.7%) 61.5% 7.7%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 4 1 0 5 0 0 0 4/5 (80.0%) 0/5 (0.0%) 80.0% 0.0%
dynamic-dispatch 3 4 1 6 0 0 0 3/7 (42.9%) 1/7 (14.3%) 42.9% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 7 3 1 9 0 0 0 7/10 (70.0%) 1/10 (10.0%) 70.0% 10.0%
interprocedural-flow 8 5 0 13 0 0 0 8/13 (61.5%) 0/13 (0.0%) 61.5% 0.0%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

joern-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 1 0 1 0 2 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
interprocedural-flow 0 2 0 2 0 8 0 0/2 (0.0%) 0/2 (0.0%) 0.0% 0.0%
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
sanitizer 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%

joern-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

joern-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 2 3 2 3 0 0 0 2/5 (40.0%) 2/5 (40.0%) 40.0% 40.0%
dynamic-dispatch 1 6 1 6 0 0 0 1/7 (14.3%) 1/7 (14.3%) 14.3% 14.3%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 4 6 1 9 0 0 0 4/10 (40.0%) 1/10 (10.0%) 40.0% 10.0%
interprocedural-flow 6 7 3 10 0 0 0 6/13 (46.2%) 3/13 (23.1%) 46.2% 23.1%
local-flow 7 1 2 6 0 0 0 7/8 (87.5%) 2/8 (25.0%) 87.5% 25.0%
object-sensitivity 1 4 0 5 0 0 0 1/5 (20.0%) 0/5 (0.0%) 20.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

joern-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 5 0 5 0 0 0 0/5 (0.0%) 0/5 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 5 3 0 8 0 0 0 5/8 (62.5%) 0/8 (0.0%) 62.5% 0.0%
interprocedural-flow 6 4 0 10 0 0 0 6/10 (60.0%) 0/10 (0.0%) 60.0% 0.0%
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 3 3 0 6 0 0 0 3/6 (50.0%) 0/6 (0.0%) 50.0% 0.0%
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

opentaint-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 5 2 2 5 0 0 0 5/7 (71.4%) 2/7 (28.6%) 71.4% 28.6%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 8 2 3 7 0 0 0 8/10 (80.0%) 3/10 (30.0%) 80.0% 30.0%
interprocedural-flow 8 1 0 9 0 0 0 8/9 (88.9%) 0/9 (0.0%) 88.9% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 4 1 1 4 0 0 0 4/5 (80.0%) 1/5 (20.0%) 80.0% 20.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

opentaint-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 5 0 1 4 0 0 0 5/5 (100.0%) 1/5 (20.0%) 100.0% 20.0%
dynamic-dispatch 6 1 3 4 0 0 0 6/7 (85.7%) 3/7 (42.9%) 85.7% 42.9%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 9 1 4 6 0 0 0 9/10 (90.0%) 4/10 (40.0%) 90.0% 40.0%
interprocedural-flow 12 1 2 11 0 0 0 12/13 (92.3%) 2/13 (15.4%) 92.3% 15.4%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 5 0 2 3 0 0 0 5/5 (100.0%) 2/5 (40.0%) 100.0% 40.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

pysa-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 3 2 0 5 0 0 0 3/5 (60.0%) 0/5 (0.0%) 60.0% 0.0%
dynamic-dispatch 0 7 0 7 0 0 0 0/7 (0.0%) 0/7 (0.0%) 0.0% 0.0%
exceptional-flow 0 1 0 1 0 0 0 0/1 (0.0%) 0/1 (0.0%) 0.0% 0.0%
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 5 5 0 10 0 0 0 5/10 (50.0%) 0/10 (0.0%) 50.0% 0.0%
interprocedural-flow 7 6 0 13 0 0 0 7/13 (53.8%) 0/13 (0.0%) 53.8% 0.0%
local-flow 7 1 1 7 0 0 0 7/8 (87.5%) 1/8 (12.5%) 87.5% 12.5%
object-sensitivity 2 3 0 5 0 0 0 2/5 (40.0%) 0/5 (0.0%) 40.0% 0.0%
path-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
recursion 1 0 0 1 0 0 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-c-kernel-taint-taint-benchmark-controlledc, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 8 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 6 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 16 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 20 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-cpp-kernel-taint-taint-benchmark-controlledcpp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 10 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-go-kernel-taint-taint-benchmark-controlledgo, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 16 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-java-kernel-taint-taint-benchmark-controlledjava, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 18 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-java-modeling-taint-taint-benchmark-controlledjava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-java-native-taint-taint-tool-nativejava, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-javascript-kernel-taint-taint-benchmark-controlledjavascript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 18 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-javascript-modeling-taint-taint-benchmark-controlledjavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-javascript-native-taint-taint-tool-nativejavascript, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 0 0 0 0 0 4 0 n/a n/a n/a n/a
heap-field-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
local-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
sanitizer 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-kotlin-kernel-taint-taint-benchmark-controlledkotlin, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-php-kernel-taint-taint-benchmark-controlledphp, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-python-kernel-taint-taint-benchmark-controlledpython, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-python-modeling-taint-taint-benchmark-controlledpython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 0 2 0 4 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
heap-field-sensitivity 0 0 0 0 0 4 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 12 0 n/a n/a n/a n/a
local-flow 2 0 0 2 0 0 0 2/2 (100.0%) 0/2 (0.0%) 100.0% 0.0%
object-sensitivity 0 0 0 0 0 2 0 n/a n/a n/a n/a
sanitizer 1 0 0 1 0 2 0 1/1 (100.0%) 0/1 (0.0%) 100.0% 0.0%

semgrep-python-native-taint-taint-tool-nativepython, modeling

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
external-summary 2 0 2 0 0 0 0 2/2 (100.0%) 2/2 (100.0%) 100.0% 100.0%
heap-field-sensitivity 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%
local-flow 6 0 4 2 0 0 0 6/6 (100.0%) 4/6 (66.7%) 100.0% 66.7%
sanitizer 1 0 1 0 0 0 0 1/1 (100.0%) 1/1 (100.0%) 100.0% 100.0%

semgrep-ruby-kernel-taint-taint-benchmark-controlledruby, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 14 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 20 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 26 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-rust-kernel-taint-taint-benchmark-controlledrust, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 10 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 16 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 20 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 0 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a

semgrep-typescript-kernel-taint-taint-benchmark-controlledtypescript, core

Semantic dimension TP FN FP TN Inconclusive Unsupported Runner error TPR FPR TPR (template macro) FPR (template macro)
context-sensitivity 0 0 0 0 0 10 0 n/a n/a n/a n/a
dynamic-dispatch 0 0 0 0 0 12 0 n/a n/a n/a n/a
exceptional-flow 0 0 0 0 0 2 0 n/a n/a n/a n/a
flow-sensitivity 3 0 1 2 0 0 0 3/3 (100.0%) 1/3 (33.3%) 100.0% 33.3%
heap-field-sensitivity 0 0 0 0 0 18 0 n/a n/a n/a n/a
interprocedural-flow 0 0 0 0 0 22 0 n/a n/a n/a n/a
local-flow 7 0 2 5 0 2 0 7/7 (100.0%) 2/7 (28.6%) 100.0% 28.6%
object-sensitivity 0 0 0 0 0 12 0 n/a n/a n/a n/a
path-sensitivity 3 0 2 1 0 0 0 3/3 (100.0%) 2/3 (66.7%) 100.0% 66.7%
recursion 0 0 0 0 0 2 0 n/a n/a n/a n/a