Analyzers — v0.7.0
Each scorecard is one frozen report: one analyzer, one track, one score
dimension, one model profile. Scorecards are independent result populations
and are never combined into a leaderboard. TPR/FPR are macro-averages
over templates, then semantic dimensions; incomplete outcomes are coverage,
never negatives.
This snapshot’s scorecards span two model profiles, and every card below
states its own. A benchmark-controlled card and a tool-native card answer
different questions on different populations: the first measures the engine
with the benchmark’s model supplied, the second measures the product with
nothing supplied. Do not read them against each other.
Eight analyzers appear here, and they do not cover the same languages. The number of cards an analyzer has is its coverage in this freeze, not its quality: Bifrost has a card for every kernel, Pysa has three. Comparing card counts is comparing footprints.
The version each card states is the version that produced it. Five
analyzers re-ran for this release — Bifrost on v0.10.9, Semgrep CE on 1.176.0,
Joern on 4.0.617, OpenTaint on analyzer/2026.09.03.9752bd2, and the eleven
CodeQL kernel populations on the unchanged CLI 2.26.4 under the endpoint probe
(A30). The other eighteen cards are the reports v0.6.1 bound, carried over
byte-identical and re-digested into this manifest: CodeQL’s six modeling and
tool-native populations, Infer’s five, FlowDroid’s four, and Pysa’s three.
Two of the re-runs are worth reading against each other on this page. Semgrep
CE, Joern and OpenTaint each moved a pin and reproduced every committed
outcome exactly, so their cards below are numerically identical to v0.6.1’s
under a new build identity — which is what a currency bump is supposed to look
like, and is only knowable because the slices were actually re-run. CodeQL’s
kernel cards, by contrast, moved without the engine moving at all: the pin is
the same 2.26.4, and five not-reached results became inconclusive because
A30 stopped scoring a negative whose source endpoint the retained SARIF shows
was never observed.
bifrost-c-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-c-kernel.json
(916c781a2721…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 48 | 20 | 20 | 8 | 0 | 0 | 100.0% | 0.0% |
c | language-extension | 2 | 1 | 0 | 1 | 0 | 0 | 100.0% | n/a |
bifrost-cpp-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-cpp-kernel.json
(19f918df7d89…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 56 | 15 | 15 | 26 | 0 | 0 | 100.0% | 0.0% |
bifrost-csharp-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-csharp-kernel.json
(70de3ea1cf92…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
csharp | core | 58 | 17 | 17 | 24 | 0 | 0 | 100.0% | 0.0% |
bifrost-go-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-go-kernel.json
(ff421b409c3c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 58 | 18 | 18 | 22 | 0 | 0 | 100.0% | 0.0% |
bifrost-java-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-java-kernel.json
(0b4c777351d6…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 20 | 20 | 18 | 0 | 0 | 100.0% | 0.0% |
bifrost-java-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-java-modeling.json
(282d0c4aa045…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 4 | 3 | 1 | 16 | 0 | 100.0% | 0.0% |
bifrost-java-native-taint-taint-tool-native
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/bifrost-java-native.json
(56967b512b53…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-javascript-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-javascript-kernel.json
(6707c1539cb0…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 19 | 19 | 20 | 0 | 0 | 100.0% | 0.0% |
bifrost-javascript-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-javascript-modeling.json
(cf474ca44a49…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 2 | 2 | 4 | 16 | 0 | 100.0% | 0.0% |
bifrost-javascript-native-taint-taint-tool-native
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/bifrost-javascript-native.json
(07588477a1d7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-kotlin-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-kotlin-kernel.json
(6bb944126dd0…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 14 | 14 | 30 | 0 | 0 | 100.0% | 0.0% |
bifrost-php-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-php-kernel.json
(be0e4aad6b45…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 58 | 17 | 17 | 24 | 0 | 0 | 100.0% | 0.0% |
bifrost-python-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-python-kernel.json
(5863eba75be0…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 18 | 18 | 22 | 0 | 0 | 100.0% | 0.0% |
bifrost-python-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-python-modeling.json
(8f4a5853d164…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 4 | 3 | 1 | 16 | 0 | 100.0% | 0.0% |
bifrost-python-native-taint-taint-tool-native
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/bifrost-python-native.json
(af7024b7bda9…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-ruby-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-ruby-kernel.json
(7e20332c7dec…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 11 | 11 | 36 | 0 | 0 | 100.0% | 0.0% |
bifrost-rust-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-rust-kernel.json
(e00bcdc488fc…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 19 | 19 | 16 | 0 | 0 | 100.0% | 0.0% |
rust | language-extension | 2 | 0 | 0 | 2 | 0 | 0 | n/a | n/a |
bifrost-scala-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-scala-kernel.json
(f0f4b1edaf66…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
scala | core | 58 | 19 | 19 | 20 | 0 | 0 | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-smoke.json
(750aac6c3b9a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
cpp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
csharp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
go | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
java | calibration | 2 | 1 | 0 | 0 | 1 | 0 | not scored | not scored |
java | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
javascript | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
kotlin | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
php | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
python | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
ruby | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
rust | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
scala | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
typescript | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
bifrost-typescript-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.10.9 (build
04775a7b38c9, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-typescript-kernel.json
(5d23bd4bfea0…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 58 | 18 | 18 | 22 | 0 | 0 | 100.0% | 0.0% |
codeql-c-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-c-kernel.json
(c09c75740d65…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 48 | 23 | 24 | 1 | 0 | 0 | 75.6% | 16.1% |
c | language-extension | 2 | 2 | 0 | 0 | 0 | 0 | 100.0% | n/a |
codeql-cpp-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-cpp-kernel.json
(7fce832ce98a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 56 | 18 | 37 | 1 | 0 | 0 | 53.2% | 10.8% |
codeql-csharp-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-csharp-kernel.json
(7a4fda34130b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
csharp | core | 58 | 24 | 33 | 1 | 0 | 0 | 69.4% | 13.7% |
codeql-go-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-go-kernel.json
(7ea689a75279…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 58 | 24 | 34 | 0 | 0 | 0 | 66.6% | 16.7% |
codeql-java-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-java-kernel.json
(6a2854456105…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 29 | 29 | 0 | 0 | 0 | 79.6% | 19.8% |
codeql-java-modeling-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-java-modeling.json
(14c991ee939e…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-java-native-taint-taint-tool-native
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/codeql-java-native.json
(5d7d7b152c93…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 7 | 5 | 0 | 0 | 0 | 100.0% | 29.2% |
codeql-javascript-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-javascript-kernel.json
(1212cce085e7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 23 | 35 | 0 | 0 | 0 | 77.4% | 9.0% |
codeql-javascript-modeling-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-javascript-modeling.json
(3a908bdc80fb…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-javascript-native-taint-taint-tool-native
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/codeql-javascript-native.json
(bd5fe87f32f7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 7 | 5 | 0 | 0 | 0 | 70.8% | 58.3% |
codeql-kotlin-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-kotlin-kernel.json
(8f657c13f95c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 25 | 33 | 0 | 0 | 0 | 68.3% | 17.1% |
codeql-python-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-python-kernel.json
(703eb7f473b7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 23 | 34 | 1 | 0 | 0 | 70.5% | 12.8% |
codeql-python-modeling-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-python-modeling.json
(60ff9613a8e5…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-python-native-taint-taint-tool-native
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/codeql-python-native.json
(2958f4e44c40…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 8 | 4 | 0 | 0 | 0 | 100.0% | 58.3% |
codeql-ruby-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-ruby-kernel.json
(738343f12f40…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 22 | 35 | 1 | 0 | 0 | 64.3% | 9.8% |
codeql-rust-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-rust-kernel.json
(8415b80fbe4b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 21 | 33 | 0 | 0 | 0 | 71.4% | 10.4% |
rust | language-extension | 2 | 0 | 2 | 0 | 0 | 0 | 0.0% | 0.0% |
codeql-typescript-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-typescript-kernel.json
(0ae5a9e811cc…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 58 | 23 | 35 | 0 | 0 | 0 | 77.4% | 9.0% |
flowdroid-java-kernel-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/flowdroid-java-kernel.json
(df7fbd5263d3…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 28 | 30 | 0 | 0 | 0 | 85.6% | 14.3% |
flowdroid-java-modeling-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/flowdroid-java-modeling.json
(b54c7a9827d2…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 7 | 7 | 0 | 10 | 0 | 100.0% | 0.0% |
flowdroid-java-native-taint-taint-tool-native
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/flowdroid-java-native.json
(6671f301cdcf…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
flowdroid-kotlin-kernel-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/flowdroid-kotlin-kernel.json
(44bb26f4541c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 30 | 28 | 0 | 0 | 0 | 89.0% | 21.3% |
infer-c-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-c-kernel.json
(35a5f9de818f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 48 | 21 | 27 | 0 | 0 | 0 | 72.4% | 7.6% |
infer-cpp-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-cpp-kernel.json
(fc3b5fd70a89…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 56 | 19 | 37 | 0 | 0 | 0 | 52.9% | 0.0% |
infer-java-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-java-kernel.json
(9eb9d7ce745f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 21 | 37 | 0 | 0 | 0 | 66.9% | 0.0% |
infer-java-modeling-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-java-modeling.json
(8045827d04dd…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
infer-java-native-taint-taint-tool-native
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/infer-java-native.json
(ad6461b1b1fa…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-java-kernel-taint-taint-benchmark-controlled
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-java-kernel.json
(9e9444893976…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 26 | 32 | 0 | 0 | 0 | 71.8% | 18.4% |
joern-java-modeling-taint-taint-benchmark-controlled
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-java-modeling.json
(009a5fb9f523…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-java-native-taint-taint-tool-native
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/joern-java-native.json
(5cc36ea1cb3c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-javascript-kernel-taint-taint-benchmark-controlled
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-javascript-kernel.json
(526f96c7f92f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 27 | 31 | 0 | 0 | 0 | 68.1% | 18.6% |
joern-javascript-modeling-taint-taint-benchmark-controlled
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-javascript-modeling.json
(9912c4e6e183…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-javascript-native-taint-taint-tool-native
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/joern-javascript-native.json
(29e90f0eea40…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-php-kernel-taint-taint-benchmark-controlled
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-php-kernel.json
(f0cbbcf1d95d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 58 | 25 | 33 | 0 | 0 | 0 | 70.2% | 16.7% |
joern-python-kernel-taint-taint-benchmark-controlled
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-python-kernel.json
(287c97ae95f6…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 25 | 33 | 0 | 0 | 0 | 70.2% | 14.9% |
joern-python-modeling-taint-taint-benchmark-controlled
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-python-modeling.json
(c21908ad9580…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-python-native-taint-taint-tool-native
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/joern-python-native.json
(c2ea3397a8ae…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-ruby-kernel-taint-taint-benchmark-controlled
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-ruby-kernel.json
(bb1502c4db85…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 23 | 35 | 0 | 0 | 0 | 54.8% | 31.2% |
joern-rust-kernel-taint-taint-benchmark-controlled
joern 4.0.617 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-rust-kernel.json
(cd7400ca9619…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 20 | 34 | 0 | 0 | 0 | 70.3% | 14.3% |
opentaint-java-kernel-taint-taint-benchmark-controlled
opentaint analyzer/2026.09.03.9752bd2 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/opentaint-java-kernel.json
(797a748114ba…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 30 | 28 | 0 | 0 | 0 | 80.8% | 17.8% |
opentaint-java-modeling-taint-taint-benchmark-controlled
opentaint analyzer/2026.09.03.9752bd2 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/opentaint-java-modeling.json
(bd5030d1777f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 6 | 6 | 0 | 12 | 0 | 100.0% | 0.0% |
opentaint-java-native-taint-taint-tool-native
opentaint analyzer/2026.09.03.9752bd2 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/opentaint-java-native.json
(7d3f4037002c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
opentaint-kotlin-kernel-taint-taint-benchmark-controlled
opentaint analyzer/2026.09.03.9752bd2 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/opentaint-kotlin-kernel.json
(02b1514d747c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 33 | 25 | 0 | 0 | 0 | 85.5% | 23.7% |
pysa-python-kernel-taint-taint-benchmark-controlled
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/pysa-python-kernel.json
(125faf9d9127…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 20 | 38 | 0 | 0 | 0 | 59.1% | 7.9% |
pysa-python-modeling-taint-taint-benchmark-controlled
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/pysa-python-modeling.json
(32155b8d129b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 10 | 10 | 0 | 4 | 0 | 100.0% | 0.0% |
pysa-python-native-taint-taint-tool-native
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/pysa-python-native.json
(c3ad2ee142ea…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 12 | 0 | 0 | 0 | 0.0% | 0.0% |
semgrep-c-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-c-kernel.json
(a4c02829e87c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 48 | 9 | 5 | 0 | 34 | 0 | 100.0% | 42.9% |
semgrep-cpp-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-cpp-kernel.json
(2b7b7c583c09…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 56 | 9 | 5 | 0 | 42 | 0 | 100.0% | 42.9% |
semgrep-go-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-go-kernel.json
(37e1accba361…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-java-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-java-kernel.json
(43e50e6c36ff…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-java-modeling-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-java-modeling.json
(629d1247ceaa…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-java-native-taint-taint-tool-native
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/semgrep-java-native.json
(77f2501e818b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
semgrep-javascript-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-javascript-kernel.json
(abd636a005b9…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-javascript-modeling-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-javascript-modeling.json
(9bc8b0619b34…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-javascript-native-taint-taint-tool-native
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/semgrep-javascript-native.json
(417dab4e591b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
semgrep-kotlin-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-kotlin-kernel.json
(3275f4f50742…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-php-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-php-kernel.json
(13b3a1a33c8b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-python-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-python-kernel.json
(6e706575e250…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-python-modeling-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-python-modeling.json
(da47b6ec6eec…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-python-native-taint-taint-tool-native
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/semgrep-python-native.json
(47778dec953e…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 10 | 2 | 0 | 0 | 0 | 100.0% | 91.7% |
semgrep-ruby-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-ruby-kernel.json
(1ade4408d1be…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-rust-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-rust-kernel.json
(b3d8862e2b07…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 9 | 5 | 0 | 40 | 0 | 100.0% | 42.9% |
semgrep-typescript-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-typescript-kernel.json
(07b24d571bc3…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
Semantic dimension detail
Section titled “Semantic dimension detail”bifrost-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 2 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 4 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 7 | 0 | 0 | 7 | 6 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 0 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-c-kernel-taint-taint-benchmark-controlled — c, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
flow-sensitivity | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
bifrost-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 4 | 0 | 0 | 4 | 12 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 14 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-csharp-kernel-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 4 | 0 | 0 | 4 | 10 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 10 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 8 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 4 | 0 | 0 | 4 | 8 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 7 | 0 | 0 | 7 | 8 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 8 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 8 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 7 | 0 | 0 | 7 | 4 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 1 | 1 | 0 | 0 | 2/2 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 6 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 10 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 20 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 7 | 0 | 0 | 7 | 12 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 8 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 5 | 0 | 0 | 5 | 6 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 10 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 1 | 1 | 0 | 0 | 2/2 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 20 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 5 | 0 | 0 | 5 | 6 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 6 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 7 | 0 | 0 | 7 | 6 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 0 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-scala-kernel-taint-taint-benchmark-controlled — scala, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 10 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 7 | 0 | 0 | 7 | 12 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — scala, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 10 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
codeql-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 1 | 0 | 4 | 0 | 0 | 0 | 3/4 (75.0%) | 0/4 (0.0%) | 75.0% | 0.0% |
dynamic-dispatch | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 2 | 2 | 6 | 0 | 0 | 0 | 6/8 (75.0%) | 2/8 (25.0%) | 75.0% | 25.0% |
interprocedural-flow | 7 | 3 | 0 | 10 | 0 | 0 | 0 | 7/10 (70.0%) | 0/10 (0.0%) | 70.0% | 0.0% |
local-flow | 7 | 0 | 1 | 5 | 1 | 0 | 0 | 7/7 (100.0%) | 1/6 (16.7%) | 100.0% | 16.7% |
object-sensitivity | 3 | 2 | 1 | 4 | 0 | 0 | 0 | 3/5 (60.0%) | 1/5 (20.0%) | 60.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-c-kernel-taint-taint-benchmark-controlled — c, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
flow-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
heap-field-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
interprocedural-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
local-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
codeql-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 3 | 7 | 1 | 9 | 0 | 0 | 0 | 3/10 (30.0%) | 1/10 (10.0%) | 30.0% | 10.0% |
interprocedural-flow | 6 | 5 | 0 | 11 | 0 | 0 | 0 | 6/11 (54.5%) | 0/11 (0.0%) | 54.5% | 0.0% |
local-flow | 7 | 1 | 1 | 6 | 1 | 0 | 0 | 7/8 (87.5%) | 1/7 (14.3%) | 87.5% | 14.3% |
object-sensitivity | 1 | 4 | 0 | 5 | 0 | 0 | 0 | 1/5 (20.0%) | 0/5 (0.0%) | 20.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-csharp-kernel-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 2 | 7 | 0 | 0 | 0 | 6/9 (66.7%) | 2/9 (22.2%) | 66.7% | 22.2% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 6 | 2 | 1 | 6 | 1 | 0 | 0 | 6/8 (75.0%) | 1/7 (14.3%) | 75.0% | 14.3% |
object-sensitivity | 4 | 2 | 1 | 5 | 0 | 0 | 0 | 4/6 (66.7%) | 1/6 (16.7%) | 66.7% | 16.7% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 1 | 5 | 0 | 6 | 0 | 0 | 0 | 1/6 (16.7%) | 0/6 (0.0%) | 16.7% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 2 | 2 | 6 | 0 | 0 | 0 | 6/8 (75.0%) | 2/8 (25.0%) | 75.0% | 25.0% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 6 | 2 | 2 | 6 | 0 | 0 | 0 | 6/8 (75.0%) | 2/8 (25.0%) | 75.0% | 25.0% |
object-sensitivity | 4 | 2 | 1 | 5 | 0 | 0 | 0 | 4/6 (66.7%) | 1/6 (16.7%) | 66.7% | 16.7% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 5 | 2 | 2 | 5 | 0 | 0 | 0 | 5/7 (71.4%) | 2/7 (28.6%) | 71.4% | 28.6% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 3 | 7 | 0 | 0 | 0 | 7/10 (70.0%) | 3/10 (30.0%) | 70.0% | 30.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 0 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 4 | 1 | 2 | 3 | 0 | 0 | 0 | 4/5 (80.0%) | 2/5 (40.0%) | 80.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 1 | 5 | 0 | 0 | 0 | 6/6 (100.0%) | 1/6 (16.7%) | 100.0% | 16.7% |
sanitizer | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 1 | 8 | 0 | 0 | 0 | 6/9 (66.7%) | 1/9 (11.1%) | 66.7% | 11.1% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0/1 (0.0%) | 1/1 (100.0%) | 0.0% | 100.0% |
local-flow | 5 | 1 | 2 | 4 | 0 | 0 | 0 | 5/6 (83.3%) | 2/6 (33.3%) | 83.3% | 33.3% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
codeql-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 1 | 6 | 0 | 0 | 0 | 2/7 (28.6%) | 1/7 (14.3%) | 28.6% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 3 | 7 | 0 | 0 | 0 | 7/10 (70.0%) | 3/10 (30.0%) | 70.0% | 30.0% |
interprocedural-flow | 9 | 4 | 1 | 12 | 0 | 0 | 0 | 9/13 (69.2%) | 1/13 (7.7%) | 69.2% | 7.7% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 4 | 1 | 2 | 3 | 0 | 0 | 0 | 4/5 (80.0%) | 2/5 (40.0%) | 80.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 0 | 7 | 0 | 0 | 0 | 2/7 (28.6%) | 0/7 (0.0%) | 28.6% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 4 | 1 | 9 | 0 | 0 | 0 | 6/10 (60.0%) | 1/10 (10.0%) | 60.0% | 10.0% |
interprocedural-flow | 9 | 4 | 0 | 13 | 0 | 0 | 0 | 9/13 (69.2%) | 0/13 (0.0%) | 69.2% | 0.0% |
local-flow | 7 | 1 | 1 | 6 | 1 | 0 | 0 | 7/8 (87.5%) | 1/7 (14.3%) | 87.5% | 14.3% |
object-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
codeql-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 1 | 6 | 0 | 7 | 0 | 0 | 0 | 1/7 (14.3%) | 0/7 (0.0%) | 14.3% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 4 | 0 | 10 | 0 | 0 | 0 | 6/10 (60.0%) | 0/10 (0.0%) | 60.0% | 0.0% |
interprocedural-flow | 8 | 5 | 0 | 13 | 0 | 0 | 0 | 8/13 (61.5%) | 0/13 (0.0%) | 61.5% | 0.0% |
local-flow | 7 | 1 | 1 | 6 | 1 | 0 | 0 | 7/8 (87.5%) | 1/7 (14.3%) | 87.5% | 14.3% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 5 | 3 | 1 | 7 | 0 | 0 | 0 | 5/8 (62.5%) | 1/8 (12.5%) | 62.5% | 12.5% |
interprocedural-flow | 7 | 3 | 0 | 10 | 0 | 0 | 0 | 7/10 (70.0%) | 0/10 (0.0%) | 70.0% | 0.0% |
local-flow | 7 | 0 | 1 | 6 | 0 | 0 | 0 | 7/7 (100.0%) | 1/7 (14.3%) | 100.0% | 14.3% |
object-sensitivity | 3 | 3 | 0 | 6 | 0 | 0 | 0 | 3/6 (50.0%) | 0/6 (0.0%) | 50.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
codeql-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 1 | 8 | 0 | 0 | 0 | 6/9 (66.7%) | 1/9 (11.1%) | 66.7% | 11.1% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flowdroid-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 1 | 6 | 0 | 0 | 0 | 2/7 (28.6%) | 1/7 (14.3%) | 28.6% | 14.3% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 9 | 1 | 3 | 7 | 0 | 0 | 0 | 9/10 (90.0%) | 3/10 (30.0%) | 90.0% | 30.0% |
interprocedural-flow | 7 | 2 | 0 | 9 | 0 | 0 | 0 | 7/9 (77.8%) | 0/9 (0.0%) | 77.8% | 0.0% |
local-flow | 8 | 0 | 1 | 7 | 0 | 0 | 0 | 8/8 (100.0%) | 1/8 (12.5%) | 100.0% | 12.5% |
object-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flowdroid-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 4 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flowdroid-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flowdroid-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 2 | 5 | 0 | 0 | 0 | 3/7 (42.9%) | 2/7 (28.6%) | 42.9% | 28.6% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 9 | 1 | 3 | 7 | 0 | 0 | 0 | 9/10 (90.0%) | 3/10 (30.0%) | 90.0% | 30.0% |
interprocedural-flow | 10 | 3 | 2 | 11 | 0 | 0 | 0 | 10/13 (76.9%) | 2/13 (15.4%) | 76.9% | 15.4% |
local-flow | 8 | 0 | 1 | 7 | 0 | 0 | 0 | 8/8 (100.0%) | 1/8 (12.5%) | 100.0% | 12.5% |
object-sensitivity | 5 | 0 | 2 | 3 | 0 | 0 | 0 | 5/5 (100.0%) | 2/5 (40.0%) | 100.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
infer-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 0 | 1 | 3 | 0 | 0 | 0 | 4/4 (100.0%) | 1/4 (25.0%) | 100.0% | 25.0% |
dynamic-dispatch | 2 | 1 | 1 | 2 | 0 | 0 | 0 | 2/3 (66.7%) | 1/3 (33.3%) | 66.7% | 33.3% |
flow-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
heap-field-sensitivity | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 8 | 2 | 1 | 9 | 0 | 0 | 0 | 8/10 (80.0%) | 1/10 (10.0%) | 80.0% | 10.0% |
local-flow | 5 | 2 | 0 | 7 | 0 | 0 | 0 | 5/7 (71.4%) | 0/7 (0.0%) | 71.4% | 0.0% |
object-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
infer-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
heap-field-sensitivity | 7 | 3 | 0 | 10 | 0 | 0 | 0 | 7/10 (70.0%) | 0/10 (0.0%) | 70.0% | 0.0% |
interprocedural-flow | 7 | 4 | 0 | 11 | 0 | 0 | 0 | 7/11 (63.6%) | 0/11 (0.0%) | 63.6% | 0.0% |
local-flow | 5 | 3 | 0 | 8 | 0 | 0 | 0 | 5/8 (62.5%) | 0/8 (0.0%) | 62.5% | 0.0% |
object-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
infer-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 3 | 4 | 0 | 7 | 0 | 0 | 0 | 3/7 (42.9%) | 0/7 (0.0%) | 42.9% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
heap-field-sensitivity | 8 | 2 | 0 | 10 | 0 | 0 | 0 | 8/10 (80.0%) | 0/10 (0.0%) | 80.0% | 0.0% |
interprocedural-flow | 7 | 2 | 0 | 9 | 0 | 0 | 0 | 7/9 (77.8%) | 0/9 (0.0%) | 77.8% | 0.0% |
local-flow | 6 | 2 | 0 | 8 | 0 | 0 | 0 | 6/8 (75.0%) | 0/8 (0.0%) | 75.0% | 0.0% |
object-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
infer-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 1 | 0 | 0 | 1 | 0 | 10 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
infer-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 2 | 5 | 0 | 0 | 0 | 3/7 (42.9%) | 2/7 (28.6%) | 42.9% | 28.6% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 1 | 9 | 0 | 0 | 0 | 7/10 (70.0%) | 1/10 (10.0%) | 70.0% | 10.0% |
interprocedural-flow | 7 | 2 | 0 | 9 | 0 | 0 | 0 | 7/9 (77.8%) | 0/9 (0.0%) | 77.8% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 4 | 5 | 0 | 0 | 0 | 6/9 (66.7%) | 4/9 (44.4%) | 66.7% | 44.4% |
interprocedural-flow | 7 | 4 | 0 | 11 | 0 | 0 | 0 | 7/11 (63.6%) | 0/11 (0.0%) | 63.6% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 3 | 1 | 5 | 0 | 0 | 0 | 3/6 (50.0%) | 1/6 (16.7%) | 50.0% | 16.7% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 1 | 6 | 0 | 0 | 0 | 3/7 (42.9%) | 1/7 (14.3%) | 42.9% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 0 | 10 | 0 | 0 | 0 | 7/10 (70.0%) | 0/10 (0.0%) | 70.0% | 0.0% |
interprocedural-flow | 8 | 5 | 1 | 12 | 0 | 0 | 0 | 8/13 (61.5%) | 1/13 (7.7%) | 61.5% | 7.7% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 3 | 4 | 1 | 6 | 0 | 0 | 0 | 3/7 (42.9%) | 1/7 (14.3%) | 42.9% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 1 | 9 | 0 | 0 | 0 | 7/10 (70.0%) | 1/10 (10.0%) | 70.0% | 10.0% |
interprocedural-flow | 8 | 5 | 0 | 13 | 0 | 0 | 0 | 8/13 (61.5%) | 0/13 (0.0%) | 61.5% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 3 | 2 | 3 | 0 | 0 | 0 | 2/5 (40.0%) | 2/5 (40.0%) | 40.0% | 40.0% |
dynamic-dispatch | 1 | 6 | 1 | 6 | 0 | 0 | 0 | 1/7 (14.3%) | 1/7 (14.3%) | 14.3% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 4 | 6 | 1 | 9 | 0 | 0 | 0 | 4/10 (40.0%) | 1/10 (10.0%) | 40.0% | 10.0% |
interprocedural-flow | 6 | 7 | 3 | 10 | 0 | 0 | 0 | 6/13 (46.2%) | 3/13 (23.1%) | 46.2% | 23.1% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 1 | 4 | 0 | 5 | 0 | 0 | 0 | 1/5 (20.0%) | 0/5 (0.0%) | 20.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
joern-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 5 | 3 | 0 | 8 | 0 | 0 | 0 | 5/8 (62.5%) | 0/8 (0.0%) | 62.5% | 0.0% |
interprocedural-flow | 6 | 4 | 0 | 10 | 0 | 0 | 0 | 6/10 (60.0%) | 0/10 (0.0%) | 60.0% | 0.0% |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 3 | 3 | 0 | 6 | 0 | 0 | 0 | 3/6 (50.0%) | 0/6 (0.0%) | 50.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
opentaint-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 5 | 2 | 2 | 5 | 0 | 0 | 0 | 5/7 (71.4%) | 2/7 (28.6%) | 71.4% | 28.6% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 8 | 2 | 3 | 7 | 0 | 0 | 0 | 8/10 (80.0%) | 3/10 (30.0%) | 80.0% | 30.0% |
interprocedural-flow | 8 | 1 | 0 | 9 | 0 | 0 | 0 | 8/9 (88.9%) | 0/9 (0.0%) | 88.9% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
opentaint-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 2 | 0 | 0 | 2 | 0 | 8 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
opentaint-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
opentaint-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 6 | 1 | 3 | 4 | 0 | 0 | 0 | 6/7 (85.7%) | 3/7 (42.9%) | 85.7% | 42.9% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 9 | 1 | 4 | 6 | 0 | 0 | 0 | 9/10 (90.0%) | 4/10 (40.0%) | 90.0% | 40.0% |
interprocedural-flow | 12 | 1 | 2 | 11 | 0 | 0 | 0 | 12/13 (92.3%) | 2/13 (15.4%) | 92.3% | 15.4% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 5 | 0 | 2 | 3 | 0 | 0 | 0 | 5/5 (100.0%) | 2/5 (40.0%) | 100.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
pysa-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 7 | 0 | 7 | 0 | 0 | 0 | 0/7 (0.0%) | 0/7 (0.0%) | 0.0% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 5 | 5 | 0 | 10 | 0 | 0 | 0 | 5/10 (50.0%) | 0/10 (0.0%) | 50.0% | 0.0% |
interprocedural-flow | 7 | 6 | 0 | 13 | 0 | 0 | 0 | 7/13 (53.8%) | 0/13 (0.0%) | 53.8% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
pysa-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 4 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
pysa-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 2 | 0 | 2 | 0 | 0 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
local-flow | 0 | 6 | 0 | 6 | 0 | 0 | 0 | 0/6 (0.0%) | 0/6 (0.0%) | 0.0% | 0.0% |
sanitizer | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
semgrep-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 16 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 16 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 2 | 0 | 0 | 0 | 0 | 2/2 (100.0%) | 2/2 (100.0%) | 100.0% | 100.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 4 | 2 | 0 | 0 | 0 | 6/6 (100.0%) | 4/6 (66.7%) | 100.0% | 66.7% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
semgrep-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 16 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |