Analyzers — v0.7.1
Each scorecard is one frozen report: one analyzer, one track, one score
dimension, and one model profile. Scorecards are independent result
populations and are never combined into a leaderboard. TPR/FPR are
macro-averages over templates and then semantic dimensions; incomplete
outcomes are coverage, never negatives.
All 82 reports in this snapshot were freshly rerun over the unchanged 852-case population. This includes the sixteen tool-native reports. The freshness claim is evidence-backed: the measurement audit records 82 fresh reports and 3,480 results.
The four changed cells are all in Java. Bifrost’s anonymous-implementation
pair changed from inconclusive to reached / not-reached; OpenTaint’s
callback-registration and map-iteration positive cells changed from
not-reached to reached. The per-scorecard tables below are the authority
for rates and denominators.
The two model profiles answer different questions. A
benchmark-controlled card measures an engine with the benchmark’s model
supplied; a tool-native card measures the product with nothing supplied.
Native unsupported outcomes are declared capability boundaries and do not
mean two wrong answers.
bifrost-c-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-c-kernel.json
(41713490c402…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 48 | 20 | 20 | 8 | 0 | 0 | 100.0% | 0.0% |
c | language-extension | 2 | 1 | 0 | 1 | 0 | 0 | 100.0% | n/a |
bifrost-cpp-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-cpp-kernel.json
(a6f05a8fbd87…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 56 | 15 | 15 | 26 | 0 | 0 | 100.0% | 0.0% |
bifrost-csharp-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-csharp-kernel.json
(d429b9058879…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
csharp | core | 58 | 17 | 17 | 24 | 0 | 0 | 100.0% | 0.0% |
bifrost-go-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-go-kernel.json
(b9e8c94bd033…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 58 | 18 | 18 | 22 | 0 | 0 | 100.0% | 0.0% |
bifrost-java-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-java-kernel.json
(9bb51f339543…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 21 | 21 | 16 | 0 | 0 | 100.0% | 0.0% |
bifrost-java-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-java-modeling.json
(49c2ffa6b912…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 4 | 3 | 1 | 16 | 0 | 100.0% | 0.0% |
bifrost-java-native-taint-taint-tool-native
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/bifrost-java-native.json
(505a1e07f165…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-javascript-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-javascript-kernel.json
(7d63063c5bde…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 19 | 19 | 20 | 0 | 0 | 100.0% | 0.0% |
bifrost-javascript-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-javascript-modeling.json
(dde4c418f9d0…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 2 | 2 | 4 | 16 | 0 | 100.0% | 0.0% |
bifrost-javascript-native-taint-taint-tool-native
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/bifrost-javascript-native.json
(062f96e4537d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-kotlin-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-kotlin-kernel.json
(6aa93b6c2757…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 14 | 14 | 30 | 0 | 0 | 100.0% | 0.0% |
bifrost-php-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-php-kernel.json
(055ac686a0e8…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 58 | 17 | 17 | 24 | 0 | 0 | 100.0% | 0.0% |
bifrost-python-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-python-kernel.json
(a326d44a4847…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 18 | 18 | 22 | 0 | 0 | 100.0% | 0.0% |
bifrost-python-modeling-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-python-modeling.json
(258e3bfb9823…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 4 | 3 | 1 | 16 | 0 | 100.0% | 0.0% |
bifrost-python-native-taint-taint-tool-native
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/bifrost-python-native.json
(e41b7689b10a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
bifrost-ruby-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-ruby-kernel.json
(ac3e4fc92494…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 11 | 11 | 36 | 0 | 0 | 100.0% | 0.0% |
bifrost-rust-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-rust-kernel.json
(54cfc84db71e…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 19 | 19 | 16 | 0 | 0 | 100.0% | 0.0% |
rust | language-extension | 2 | 0 | 0 | 2 | 0 | 0 | n/a | n/a |
bifrost-scala-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-scala-kernel.json
(63da300b2138…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
scala | core | 58 | 19 | 19 | 20 | 0 | 0 | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-smoke.json
(40430c845adf…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
cpp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
csharp | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
go | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
java | calibration | 2 | 1 | 0 | 0 | 1 | 0 | not scored | not scored |
java | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
javascript | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
kotlin | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
php | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
python | core | 32 | 16 | 16 | 0 | 0 | 0 | 100.0% | 0.0% |
ruby | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
rust | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
scala | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
typescript | core | 2 | 1 | 1 | 0 | 0 | 0 | 100.0% | 0.0% |
bifrost-typescript-kernel-taint-taint-benchmark-controlled
bifrost bifrost 0.11.0 (build
bd77fd7e47c1, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/bifrost-typescript-kernel.json
(d4b9ab940ef7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 58 | 18 | 18 | 22 | 0 | 0 | 100.0% | 0.0% |
codeql-c-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-c-kernel.json
(bf7d2c046e26…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 48 | 23 | 24 | 1 | 0 | 0 | 75.6% | 16.1% |
c | language-extension | 2 | 2 | 0 | 0 | 0 | 0 | 100.0% | n/a |
codeql-cpp-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-cpp-kernel.json
(73a40bf1258a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 56 | 18 | 37 | 1 | 0 | 0 | 53.2% | 10.8% |
codeql-csharp-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-csharp-kernel.json
(77bee41d73f5…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
csharp | core | 58 | 24 | 33 | 1 | 0 | 0 | 69.4% | 13.7% |
codeql-go-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-go-kernel.json
(bcacea95d44f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 58 | 24 | 34 | 0 | 0 | 0 | 66.6% | 16.7% |
codeql-java-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-java-kernel.json
(bea06d23735c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 29 | 29 | 0 | 0 | 0 | 79.6% | 19.8% |
codeql-java-modeling-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-java-modeling.json
(e8a1d5d6e4c2…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-java-native-taint-taint-tool-native
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/codeql-java-native.json
(d6df797021b6…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 7 | 5 | 0 | 0 | 0 | 100.0% | 29.2% |
codeql-javascript-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-javascript-kernel.json
(2c9e02d8820b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 23 | 35 | 0 | 0 | 0 | 77.4% | 9.0% |
codeql-javascript-modeling-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-javascript-modeling.json
(acd4495aadbc…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-javascript-native-taint-taint-tool-native
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/codeql-javascript-native.json
(bdd4c4642649…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 7 | 5 | 0 | 0 | 0 | 70.8% | 58.3% |
codeql-kotlin-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-kotlin-kernel.json
(35da5030e395…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 25 | 33 | 0 | 0 | 0 | 68.3% | 17.1% |
codeql-python-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-python-kernel.json
(f4dae64dd7b1…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 23 | 34 | 1 | 0 | 0 | 70.5% | 12.8% |
codeql-python-modeling-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-python-modeling.json
(63a1406a605f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 12 | 12 | 0 | 0 | 0 | 100.0% | 0.0% |
codeql-python-native-taint-taint-tool-native
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/codeql-python-native.json
(0366d0521736…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 8 | 4 | 0 | 0 | 0 | 100.0% | 58.3% |
codeql-ruby-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-ruby-kernel.json
(69b06df66907…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 22 | 35 | 1 | 0 | 0 | 64.3% | 9.8% |
codeql-rust-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-rust-kernel.json
(ba05e002a47f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 21 | 33 | 0 | 0 | 0 | 71.4% | 10.4% |
rust | language-extension | 2 | 0 | 2 | 0 | 0 | 0 | 0.0% | 0.0% |
codeql-typescript-kernel-taint-taint-benchmark-controlled
codeql 2.26.4 (build
6b1e4dee94ad, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/codeql-typescript-kernel.json
(7eeb8c037543…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 58 | 23 | 35 | 0 | 0 | 0 | 77.4% | 9.0% |
flowdroid-java-kernel-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/flowdroid-java-kernel.json
(de78805a4e85…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 28 | 30 | 0 | 0 | 0 | 85.6% | 14.3% |
flowdroid-java-modeling-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/flowdroid-java-modeling.json
(51dd054808a9…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 7 | 7 | 0 | 10 | 0 | 100.0% | 0.0% |
flowdroid-java-native-taint-taint-tool-native
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/flowdroid-java-native.json
(27678765cf4a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
flowdroid-kotlin-kernel-taint-taint-benchmark-controlled
flowdroid 2.15.1 (build
soot-infoflo, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/flowdroid-kotlin-kernel.json
(3c1466fd7945…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 30 | 28 | 0 | 0 | 0 | 89.0% | 21.3% |
infer-c-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-c-kernel.json
(6486e611e6b7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 48 | 21 | 27 | 0 | 0 | 0 | 72.4% | 7.6% |
infer-cpp-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-cpp-kernel.json
(b36c1bf27f4f…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 56 | 19 | 37 | 0 | 0 | 0 | 52.9% | 0.0% |
infer-java-kernel-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-java-kernel.json
(9f707f11b630…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 21 | 37 | 0 | 0 | 0 | 66.9% | 0.0% |
infer-java-modeling-taint-taint-benchmark-controlled
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/infer-java-modeling.json
(2b0df6dfa8a7…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
infer-java-native-taint-taint-tool-native
infer v1.3.0 (build
infer:v1.3.0, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/infer-java-native.json
(13e3be0fab60…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-java-kernel-taint-taint-benchmark-controlled
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-java-kernel.json
(cc6cd2b96e55…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 26 | 32 | 0 | 0 | 0 | 71.8% | 18.4% |
joern-java-modeling-taint-taint-benchmark-controlled
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-java-modeling.json
(9eb2e6cbb7f2…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-java-native-taint-taint-tool-native
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/joern-java-native.json
(0506cbb5fd53…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-javascript-kernel-taint-taint-benchmark-controlled
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-javascript-kernel.json
(ae36a6389035…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 27 | 31 | 0 | 0 | 0 | 68.1% | 18.6% |
joern-javascript-modeling-taint-taint-benchmark-controlled
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-javascript-modeling.json
(5c6521100088…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-javascript-native-taint-taint-tool-native
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/joern-javascript-native.json
(db92d4b76374…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-php-kernel-taint-taint-benchmark-controlled
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-php-kernel.json
(e1f9b3f0da16…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 58 | 25 | 33 | 0 | 0 | 0 | 70.2% | 16.7% |
joern-python-kernel-taint-taint-benchmark-controlled
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-python-kernel.json
(838b2a50df7a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 25 | 33 | 0 | 0 | 0 | 70.2% | 14.9% |
joern-python-modeling-taint-taint-benchmark-controlled
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-python-modeling.json
(300b351dbe09…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 6 | 10 | 0 | 8 | 0 | 50.0% | 0.0% |
joern-python-native-taint-taint-tool-native
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/joern-python-native.json
(a6a307052b7d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
joern-ruby-kernel-taint-taint-benchmark-controlled
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-ruby-kernel.json
(4984f62f0b2b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 23 | 35 | 0 | 0 | 0 | 54.8% | 31.2% |
joern-rust-kernel-taint-taint-benchmark-controlled
joern 4.0.621 (build
joern-cli:4., adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/joern-rust-kernel.json
(567b0fb00d02…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 20 | 34 | 0 | 0 | 0 | 70.3% | 14.3% |
opentaint-java-kernel-taint-taint-benchmark-controlled
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/opentaint-java-kernel.json
(33ef292f0166…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 32 | 26 | 0 | 0 | 0 | 86.3% | 17.8% |
opentaint-java-modeling-taint-taint-benchmark-controlled
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/opentaint-java-modeling.json
(2ad1060823a5…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 6 | 6 | 0 | 12 | 0 | 100.0% | 0.0% |
opentaint-java-native-taint-taint-tool-native
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/opentaint-java-native.json
(e3456ec9661c…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
opentaint-kotlin-kernel-taint-taint-benchmark-controlled
opentaint v0.4.6 (build
opentaint-pr, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/opentaint-kotlin-kernel.json
(2904ae19a176…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 33 | 25 | 0 | 0 | 0 | 85.5% | 23.7% |
pysa-python-kernel-taint-taint-benchmark-controlled
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/pysa-python-kernel.json
(d97985a57e65…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 20 | 38 | 0 | 0 | 0 | 59.1% | 7.9% |
pysa-python-modeling-taint-taint-benchmark-controlled
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/pysa-python-modeling.json
(fb08e2fc7158…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 10 | 10 | 0 | 4 | 0 | 100.0% | 0.0% |
pysa-python-native-taint-taint-tool-native
pysa 0.10.0 (build
pyre-check:0, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/pysa-python-native.json
(64adb1284a96…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 0 | 12 | 0 | 0 | 0 | 0.0% | 0.0% |
semgrep-c-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-c-kernel.json
(bf29d50fdea0…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
c | core | 48 | 9 | 5 | 0 | 34 | 0 | 100.0% | 42.9% |
semgrep-cpp-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-cpp-kernel.json
(6588c08b7628…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
cpp | core | 56 | 9 | 5 | 0 | 42 | 0 | 100.0% | 42.9% |
semgrep-go-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-go-kernel.json
(984dfbc4fb77…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
go | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-java-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-java-kernel.json
(1a8d4dfe44b9…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-java-modeling-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-java-modeling.json
(7cb186748186…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-java-native-taint-taint-tool-native
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/semgrep-java-native.json
(2b9b2ee794ce…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
java | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
semgrep-javascript-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-javascript-kernel.json
(3bf590f88c5d…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-javascript-modeling-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-javascript-modeling.json
(157275adc56b…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-javascript-native-taint-taint-tool-native
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/semgrep-javascript-native.json
(367d6cf4371e…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
javascript | modeling | 12 | 0 | 0 | 0 | 12 | 0 | n/a | n/a |
semgrep-kotlin-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-kotlin-kernel.json
(f6fef39bcf82…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
kotlin | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-php-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-php-kernel.json
(e35ba046d60a…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
php | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-python-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-python-kernel.json
(51a5cd87f400…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-python-modeling-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-python-modeling.json
(c52d98d574fd…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 24 | 5 | 5 | 0 | 14 | 0 | 100.0% | 0.0% |
semgrep-python-native-taint-taint-tool-native
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
tool-native. Normalized report:
reports/semgrep-python-native.json
(ad9dc1a0ab69…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
python | modeling | 12 | 10 | 2 | 0 | 0 | 0 | 100.0% | 91.7% |
semgrep-ruby-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-ruby-kernel.json
(9580ceba4210…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
ruby | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
semgrep-rust-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-rust-kernel.json
(a8a9672f2ffb…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
rust | core | 54 | 9 | 5 | 0 | 40 | 0 | 100.0% | 42.9% |
semgrep-typescript-kernel-taint-taint-benchmark-controlled
semgrep 1.176.0 (build
semgrep-oss:, adapter
0.1.0) — track taint,
dimension taint, model profile
benchmark-controlled. Normalized report:
reports/semgrep-typescript-kernel.json
(22ebaece8440…).
| Language | Tier | Cases | Reached | Not reached | Inconclusive | Unsupported | Runner error | TPR (macro) | FPR (macro) |
|---|---|---|---|---|---|---|---|---|---|
typescript | core | 58 | 9 | 5 | 0 | 44 | 0 | 100.0% | 42.9% |
Semantic dimension detail
Section titled “Semantic dimension detail”bifrost-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 2 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 6 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 4 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 7 | 0 | 0 | 7 | 6 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 0 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-c-kernel-taint-taint-benchmark-controlled — c, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
flow-sensitivity | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 1 | 0 | 0 | n/a | n/a | n/a | n/a |
local-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
bifrost-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 4 | 0 | 0 | 4 | 12 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 14 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-csharp-kernel-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 4 | 0 | 0 | 4 | 10 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 10 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 8 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 4 | 0 | 0 | 4 | 8 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 7 | 0 | 0 | 7 | 8 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 8 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 0 | 0 | 4 | 2 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 1 | 0 | 0 | 1 | 12 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 8 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 7 | 0 | 0 | 7 | 4 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 1 | 1 | 0 | 0 | 2/2 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 6 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 10 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 4 | 0 | 0 | n/a | n/a | n/a | n/a |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 20 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 7 | 0 | 0 | 7 | 12 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 6 | 0 | 0 | 6 | 8 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 5 | 0 | 0 | 5 | 6 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 10 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 1 | 1 | 0 | 0 | 2/2 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
bifrost-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
bifrost-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 20 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 6 | 0 | 0 | 6 | 14 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 5 | 0 | 0 | 5 | 6 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 2 | 0 | 0 | 2 | 2 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 10 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 6 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 7 | 0 | 0 | 7 | 6 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 0 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
bifrost-scala-kernel-taint-taint-benchmark-controlled — scala, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 14 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 10 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 7 | 0 | 0 | 7 | 12 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 6 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — scala, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-smoke-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
local-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
bifrost-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 0 | 0 | 3 | 4 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
dynamic-dispatch | 0 | 0 | 0 | 0 | 12 | 0 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 5 | 0 | 0 | 5 | 8 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 10 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 0 | 0 | 7 | 2 | 0 | 0 | 7/7 (100.0%) | 0/7 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 3 | 0 | 0 | 3 | 6 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 3 | 0 | 0 | 3 | 0 | 0 | 0 | 3/3 (100.0%) | 0/3 (0.0%) | 100.0% | 0.0% |
recursion | 0 | 0 | 0 | 0 | 2 | 0 | 0 | n/a | n/a | n/a | n/a |
codeql-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 1 | 0 | 4 | 0 | 0 | 0 | 3/4 (75.0%) | 0/4 (0.0%) | 75.0% | 0.0% |
dynamic-dispatch | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 0/3 (0.0%) | 0/3 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 2 | 2 | 6 | 0 | 0 | 0 | 6/8 (75.0%) | 2/8 (25.0%) | 75.0% | 25.0% |
interprocedural-flow | 7 | 3 | 0 | 10 | 0 | 0 | 0 | 7/10 (70.0%) | 0/10 (0.0%) | 70.0% | 0.0% |
local-flow | 7 | 0 | 1 | 5 | 1 | 0 | 0 | 7/7 (100.0%) | 1/6 (16.7%) | 100.0% | 16.7% |
object-sensitivity | 3 | 2 | 1 | 4 | 0 | 0 | 0 | 3/5 (60.0%) | 1/5 (20.0%) | 60.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-c-kernel-taint-taint-benchmark-controlled — c, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
flow-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
heap-field-sensitivity | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
interprocedural-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
local-flow | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | n/a | 100.0% | n/a |
codeql-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 3 | 7 | 1 | 9 | 0 | 0 | 0 | 3/10 (30.0%) | 1/10 (10.0%) | 30.0% | 10.0% |
interprocedural-flow | 6 | 5 | 0 | 11 | 0 | 0 | 0 | 6/11 (54.5%) | 0/11 (0.0%) | 54.5% | 0.0% |
local-flow | 7 | 1 | 1 | 6 | 1 | 0 | 0 | 7/8 (87.5%) | 1/7 (14.3%) | 87.5% | 14.3% |
object-sensitivity | 1 | 4 | 0 | 5 | 0 | 0 | 0 | 1/5 (20.0%) | 0/5 (0.0%) | 20.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-csharp-kernel-taint-taint-benchmark-controlled — csharp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 2 | 7 | 0 | 0 | 0 | 6/9 (66.7%) | 2/9 (22.2%) | 66.7% | 22.2% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 6 | 2 | 1 | 6 | 1 | 0 | 0 | 6/8 (75.0%) | 1/7 (14.3%) | 75.0% | 14.3% |
object-sensitivity | 4 | 2 | 1 | 5 | 0 | 0 | 0 | 4/6 (66.7%) | 1/6 (16.7%) | 66.7% | 16.7% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 1 | 5 | 0 | 6 | 0 | 0 | 0 | 1/6 (16.7%) | 0/6 (0.0%) | 16.7% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 2 | 2 | 6 | 0 | 0 | 0 | 6/8 (75.0%) | 2/8 (25.0%) | 75.0% | 25.0% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 6 | 2 | 2 | 6 | 0 | 0 | 0 | 6/8 (75.0%) | 2/8 (25.0%) | 75.0% | 25.0% |
object-sensitivity | 4 | 2 | 1 | 5 | 0 | 0 | 0 | 4/6 (66.7%) | 1/6 (16.7%) | 66.7% | 16.7% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 5 | 2 | 2 | 5 | 0 | 0 | 0 | 5/7 (71.4%) | 2/7 (28.6%) | 71.4% | 28.6% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 3 | 7 | 0 | 0 | 0 | 7/10 (70.0%) | 3/10 (30.0%) | 70.0% | 30.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 0 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 4 | 1 | 2 | 3 | 0 | 0 | 0 | 4/5 (80.0%) | 2/5 (40.0%) | 80.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 1 | 5 | 0 | 0 | 0 | 6/6 (100.0%) | 1/6 (16.7%) | 100.0% | 16.7% |
sanitizer | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 1 | 8 | 0 | 0 | 0 | 6/9 (66.7%) | 1/9 (11.1%) | 66.7% | 11.1% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0/1 (0.0%) | 1/1 (100.0%) | 0.0% | 100.0% |
local-flow | 5 | 1 | 2 | 4 | 0 | 0 | 0 | 5/6 (83.3%) | 2/6 (33.3%) | 83.3% | 33.3% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
codeql-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 1 | 6 | 0 | 0 | 0 | 2/7 (28.6%) | 1/7 (14.3%) | 28.6% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 3 | 7 | 0 | 0 | 0 | 7/10 (70.0%) | 3/10 (30.0%) | 70.0% | 30.0% |
interprocedural-flow | 9 | 4 | 1 | 12 | 0 | 0 | 0 | 9/13 (69.2%) | 1/13 (7.7%) | 69.2% | 7.7% |
local-flow | 6 | 2 | 1 | 7 | 0 | 0 | 0 | 6/8 (75.0%) | 1/8 (12.5%) | 75.0% | 12.5% |
object-sensitivity | 4 | 1 | 2 | 3 | 0 | 0 | 0 | 4/5 (80.0%) | 2/5 (40.0%) | 80.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 0 | 7 | 0 | 0 | 0 | 2/7 (28.6%) | 0/7 (0.0%) | 28.6% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 4 | 1 | 9 | 0 | 0 | 0 | 6/10 (60.0%) | 1/10 (10.0%) | 60.0% | 10.0% |
interprocedural-flow | 9 | 4 | 0 | 13 | 0 | 0 | 0 | 9/13 (69.2%) | 0/13 (0.0%) | 69.2% | 0.0% |
local-flow | 7 | 1 | 1 | 6 | 1 | 0 | 0 | 7/8 (87.5%) | 1/7 (14.3%) | 87.5% | 14.3% |
object-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 6 | 0 | 0 | 6 | 0 | 0 | 0 | 6/6 (100.0%) | 0/6 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
codeql-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 2 | 4 | 0 | 0 | 0 | 6/6 (100.0%) | 2/6 (33.3%) | 100.0% | 33.3% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
codeql-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 1 | 6 | 0 | 7 | 0 | 0 | 0 | 1/7 (14.3%) | 0/7 (0.0%) | 14.3% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 4 | 0 | 10 | 0 | 0 | 0 | 6/10 (60.0%) | 0/10 (0.0%) | 60.0% | 0.0% |
interprocedural-flow | 8 | 5 | 0 | 13 | 0 | 0 | 0 | 8/13 (61.5%) | 0/13 (0.0%) | 61.5% | 0.0% |
local-flow | 7 | 1 | 1 | 6 | 1 | 0 | 0 | 7/8 (87.5%) | 1/7 (14.3%) | 87.5% | 14.3% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 1 | 1 | 0 | 0 | 3/3 (100.0%) | 1/2 (50.0%) | 100.0% | 50.0% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 5 | 3 | 1 | 7 | 0 | 0 | 0 | 5/8 (62.5%) | 1/8 (12.5%) | 62.5% | 12.5% |
interprocedural-flow | 7 | 3 | 0 | 10 | 0 | 0 | 0 | 7/10 (70.0%) | 0/10 (0.0%) | 70.0% | 0.0% |
local-flow | 7 | 0 | 1 | 6 | 0 | 0 | 0 | 7/7 (100.0%) | 1/7 (14.3%) | 100.0% | 14.3% |
object-sensitivity | 3 | 3 | 0 | 6 | 0 | 0 | 0 | 3/6 (50.0%) | 0/6 (0.0%) | 50.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
codeql-rust-kernel-taint-taint-benchmark-controlled — rust, language-extension
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
codeql-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 1 | 8 | 0 | 0 | 0 | 6/9 (66.7%) | 1/9 (11.1%) | 66.7% | 11.1% |
interprocedural-flow | 8 | 3 | 0 | 11 | 0 | 0 | 0 | 8/11 (72.7%) | 0/11 (0.0%) | 72.7% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flowdroid-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 5 | 1 | 6 | 0 | 0 | 0 | 2/7 (28.6%) | 1/7 (14.3%) | 28.6% | 14.3% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 9 | 1 | 3 | 7 | 0 | 0 | 0 | 9/10 (90.0%) | 3/10 (30.0%) | 90.0% | 30.0% |
interprocedural-flow | 7 | 2 | 0 | 9 | 0 | 0 | 0 | 7/9 (77.8%) | 0/9 (0.0%) | 77.8% | 0.0% |
local-flow | 8 | 0 | 1 | 7 | 0 | 0 | 0 | 8/8 (100.0%) | 1/8 (12.5%) | 100.0% | 12.5% |
object-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flowdroid-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 4 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flowdroid-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flowdroid-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 2 | 5 | 0 | 0 | 0 | 3/7 (42.9%) | 2/7 (28.6%) | 42.9% | 28.6% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 9 | 1 | 3 | 7 | 0 | 0 | 0 | 9/10 (90.0%) | 3/10 (30.0%) | 90.0% | 30.0% |
interprocedural-flow | 10 | 3 | 2 | 11 | 0 | 0 | 0 | 10/13 (76.9%) | 2/13 (15.4%) | 76.9% | 15.4% |
local-flow | 8 | 0 | 1 | 7 | 0 | 0 | 0 | 8/8 (100.0%) | 1/8 (12.5%) | 100.0% | 12.5% |
object-sensitivity | 5 | 0 | 2 | 3 | 0 | 0 | 0 | 5/5 (100.0%) | 2/5 (40.0%) | 100.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
infer-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 0 | 1 | 3 | 0 | 0 | 0 | 4/4 (100.0%) | 1/4 (25.0%) | 100.0% | 25.0% |
dynamic-dispatch | 2 | 1 | 1 | 2 | 0 | 0 | 0 | 2/3 (66.7%) | 1/3 (33.3%) | 66.7% | 33.3% |
flow-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
heap-field-sensitivity | 8 | 0 | 0 | 8 | 0 | 0 | 0 | 8/8 (100.0%) | 0/8 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 8 | 2 | 1 | 9 | 0 | 0 | 0 | 8/10 (80.0%) | 1/10 (10.0%) | 80.0% | 10.0% |
local-flow | 5 | 2 | 0 | 7 | 0 | 0 | 0 | 5/7 (71.4%) | 0/7 (0.0%) | 71.4% | 0.0% |
object-sensitivity | 5 | 0 | 0 | 5 | 0 | 0 | 0 | 5/5 (100.0%) | 0/5 (0.0%) | 100.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
infer-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
heap-field-sensitivity | 7 | 3 | 0 | 10 | 0 | 0 | 0 | 7/10 (70.0%) | 0/10 (0.0%) | 70.0% | 0.0% |
interprocedural-flow | 7 | 4 | 0 | 11 | 0 | 0 | 0 | 7/11 (63.6%) | 0/11 (0.0%) | 63.6% | 0.0% |
local-flow | 5 | 3 | 0 | 8 | 0 | 0 | 0 | 5/8 (62.5%) | 0/8 (0.0%) | 62.5% | 0.0% |
object-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
infer-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 3 | 4 | 0 | 7 | 0 | 0 | 0 | 3/7 (42.9%) | 0/7 (0.0%) | 42.9% | 0.0% |
exceptional-flow | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
flow-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
heap-field-sensitivity | 8 | 2 | 0 | 10 | 0 | 0 | 0 | 8/10 (80.0%) | 0/10 (0.0%) | 80.0% | 0.0% |
interprocedural-flow | 7 | 2 | 0 | 9 | 0 | 0 | 0 | 7/9 (77.8%) | 0/9 (0.0%) | 77.8% | 0.0% |
local-flow | 6 | 2 | 0 | 8 | 0 | 0 | 0 | 6/8 (75.0%) | 0/8 (0.0%) | 75.0% | 0.0% |
object-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
path-sensitivity | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 2/3 (66.7%) | 0/3 (0.0%) | 66.7% | 0.0% |
recursion | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
infer-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 1 | 0 | 0 | 1 | 0 | 10 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
infer-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 2 | 5 | 0 | 0 | 0 | 3/7 (42.9%) | 2/7 (28.6%) | 42.9% | 28.6% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 1 | 9 | 0 | 0 | 0 | 7/10 (70.0%) | 1/10 (10.0%) | 70.0% | 10.0% |
interprocedural-flow | 7 | 2 | 0 | 9 | 0 | 0 | 0 | 7/9 (77.8%) | 0/9 (0.0%) | 77.8% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 2 | 4 | 0 | 6 | 0 | 0 | 0 | 2/6 (33.3%) | 0/6 (0.0%) | 33.3% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 6 | 3 | 4 | 5 | 0 | 0 | 0 | 6/9 (66.7%) | 4/9 (44.4%) | 66.7% | 44.4% |
interprocedural-flow | 7 | 4 | 0 | 11 | 0 | 0 | 0 | 7/11 (63.6%) | 0/11 (0.0%) | 63.6% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 3 | 1 | 5 | 0 | 0 | 0 | 3/6 (50.0%) | 1/6 (16.7%) | 50.0% | 16.7% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 1 | 4 | 0 | 0 | 0 | 4/5 (80.0%) | 1/5 (20.0%) | 80.0% | 20.0% |
dynamic-dispatch | 3 | 4 | 1 | 6 | 0 | 0 | 0 | 3/7 (42.9%) | 1/7 (14.3%) | 42.9% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 0 | 10 | 0 | 0 | 0 | 7/10 (70.0%) | 0/10 (0.0%) | 70.0% | 0.0% |
interprocedural-flow | 8 | 5 | 1 | 12 | 0 | 0 | 0 | 8/13 (61.5%) | 1/13 (7.7%) | 61.5% | 7.7% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 4 | 1 | 0 | 5 | 0 | 0 | 0 | 4/5 (80.0%) | 0/5 (0.0%) | 80.0% | 0.0% |
dynamic-dispatch | 3 | 4 | 1 | 6 | 0 | 0 | 0 | 3/7 (42.9%) | 1/7 (14.3%) | 42.9% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 7 | 3 | 1 | 9 | 0 | 0 | 0 | 7/10 (70.0%) | 1/10 (10.0%) | 70.0% | 10.0% |
interprocedural-flow | 8 | 5 | 0 | 13 | 0 | 0 | 0 | 8/13 (61.5%) | 0/13 (0.0%) | 61.5% | 0.0% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
joern-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 2 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
interprocedural-flow | 0 | 2 | 0 | 2 | 0 | 8 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
joern-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
joern-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 2 | 3 | 2 | 3 | 0 | 0 | 0 | 2/5 (40.0%) | 2/5 (40.0%) | 40.0% | 40.0% |
dynamic-dispatch | 1 | 6 | 1 | 6 | 0 | 0 | 0 | 1/7 (14.3%) | 1/7 (14.3%) | 14.3% | 14.3% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 4 | 6 | 1 | 9 | 0 | 0 | 0 | 4/10 (40.0%) | 1/10 (10.0%) | 40.0% | 10.0% |
interprocedural-flow | 6 | 7 | 3 | 10 | 0 | 0 | 0 | 6/13 (46.2%) | 3/13 (23.1%) | 46.2% | 23.1% |
local-flow | 7 | 1 | 2 | 6 | 0 | 0 | 0 | 7/8 (87.5%) | 2/8 (25.0%) | 87.5% | 25.0% |
object-sensitivity | 1 | 4 | 0 | 5 | 0 | 0 | 0 | 1/5 (20.0%) | 0/5 (0.0%) | 20.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
joern-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 5 | 0 | 5 | 0 | 0 | 0 | 0/5 (0.0%) | 0/5 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 5 | 3 | 0 | 8 | 0 | 0 | 0 | 5/8 (62.5%) | 0/8 (0.0%) | 62.5% | 0.0% |
interprocedural-flow | 6 | 4 | 0 | 10 | 0 | 0 | 0 | 6/10 (60.0%) | 0/10 (0.0%) | 60.0% | 0.0% |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 3 | 3 | 0 | 6 | 0 | 0 | 0 | 3/6 (50.0%) | 0/6 (0.0%) | 50.0% | 0.0% |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
opentaint-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 6 | 1 | 2 | 5 | 0 | 0 | 0 | 6/7 (85.7%) | 2/7 (28.6%) | 85.7% | 28.6% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 9 | 1 | 3 | 7 | 0 | 0 | 0 | 9/10 (90.0%) | 3/10 (30.0%) | 90.0% | 30.0% |
interprocedural-flow | 9 | 0 | 0 | 9 | 0 | 0 | 0 | 9/9 (100.0%) | 0/9 (0.0%) | 100.0% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
opentaint-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 2 | 0 | 0 | 2 | 0 | 8 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
opentaint-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
opentaint-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 5/5 (100.0%) | 1/5 (20.0%) | 100.0% | 20.0% |
dynamic-dispatch | 6 | 1 | 3 | 4 | 0 | 0 | 0 | 6/7 (85.7%) | 3/7 (42.9%) | 85.7% | 42.9% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 9 | 1 | 4 | 6 | 0 | 0 | 0 | 9/10 (90.0%) | 4/10 (40.0%) | 90.0% | 40.0% |
interprocedural-flow | 12 | 1 | 2 | 11 | 0 | 0 | 0 | 12/13 (92.3%) | 2/13 (15.4%) | 92.3% | 15.4% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 5 | 0 | 2 | 3 | 0 | 0 | 0 | 5/5 (100.0%) | 2/5 (40.0%) | 100.0% | 40.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
pysa-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 3 | 2 | 0 | 5 | 0 | 0 | 0 | 3/5 (60.0%) | 0/5 (0.0%) | 60.0% | 0.0% |
dynamic-dispatch | 0 | 7 | 0 | 7 | 0 | 0 | 0 | 0/7 (0.0%) | 0/7 (0.0%) | 0.0% | 0.0% |
exceptional-flow | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 5 | 5 | 0 | 10 | 0 | 0 | 0 | 5/10 (50.0%) | 0/10 (0.0%) | 50.0% | 0.0% |
interprocedural-flow | 7 | 6 | 0 | 13 | 0 | 0 | 0 | 7/13 (53.8%) | 0/13 (0.0%) | 53.8% | 0.0% |
local-flow | 7 | 1 | 1 | 7 | 0 | 0 | 0 | 7/8 (87.5%) | 1/8 (12.5%) | 87.5% | 12.5% |
object-sensitivity | 2 | 3 | 0 | 5 | 0 | 0 | 0 | 2/5 (40.0%) | 0/5 (0.0%) | 40.0% | 0.0% |
path-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
recursion | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
pysa-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 4 | 0 | 0 | 4 | 0 | 0 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
interprocedural-flow | 4 | 0 | 0 | 4 | 0 | 4 | 0 | 4/4 (100.0%) | 0/4 (0.0%) | 100.0% | 0.0% |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
pysa-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 2 | 0 | 2 | 0 | 0 | 0 | 0/2 (0.0%) | 0/2 (0.0%) | 0.0% | 0.0% |
heap-field-sensitivity | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
local-flow | 0 | 6 | 0 | 6 | 0 | 0 | 0 | 0/6 (0.0%) | 0/6 (0.0%) | 0.0% | 0.0% |
sanitizer | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0/1 (0.0%) | 0/1 (0.0%) | 0.0% | 0.0% |
semgrep-c-kernel-taint-taint-benchmark-controlled — c, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 8 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 6 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 16 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-cpp-kernel-taint-taint-benchmark-controlled — cpp, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-go-kernel-taint-taint-benchmark-controlled — go, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 16 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-java-kernel-taint-taint-benchmark-controlled — java, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-java-modeling-taint-taint-benchmark-controlled — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-java-native-taint-taint-tool-native — java, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-javascript-kernel-taint-taint-benchmark-controlled — javascript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-javascript-modeling-taint-taint-benchmark-controlled — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-javascript-native-taint-taint-tool-native — javascript, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
local-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-kotlin-kernel-taint-taint-benchmark-controlled — kotlin, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-php-kernel-taint-taint-benchmark-controlled — php, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-python-kernel-taint-taint-benchmark-controlled — python, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-python-modeling-taint-taint-benchmark-controlled — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 0 | 2 | 0 | 4 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 4 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
local-flow | 2 | 0 | 0 | 2 | 0 | 0 | 0 | 2/2 (100.0%) | 0/2 (0.0%) | 100.0% | 0.0% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
sanitizer | 1 | 0 | 0 | 1 | 0 | 2 | 0 | 1/1 (100.0%) | 0/1 (0.0%) | 100.0% | 0.0% |
semgrep-python-native-taint-taint-tool-native — python, modeling
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
external-summary | 2 | 0 | 2 | 0 | 0 | 0 | 0 | 2/2 (100.0%) | 2/2 (100.0%) | 100.0% | 100.0% |
heap-field-sensitivity | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
local-flow | 6 | 0 | 4 | 2 | 0 | 0 | 0 | 6/6 (100.0%) | 4/6 (66.7%) | 100.0% | 66.7% |
sanitizer | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1/1 (100.0%) | 1/1 (100.0%) | 100.0% | 100.0% |
semgrep-ruby-kernel-taint-taint-benchmark-controlled — ruby, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 14 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 26 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-rust-kernel-taint-taint-benchmark-controlled — rust, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 16 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 20 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 0 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
semgrep-typescript-kernel-taint-taint-benchmark-controlled — typescript, core
| Semantic dimension | TP | FN | FP | TN | Inconclusive | Unsupported | Runner error | TPR | FPR | TPR (template macro) | FPR (template macro) |
|---|---|---|---|---|---|---|---|---|---|---|---|
context-sensitivity | 0 | 0 | 0 | 0 | 0 | 10 | 0 | n/a | n/a | n/a | n/a |
dynamic-dispatch | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
exceptional-flow | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |
flow-sensitivity | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 3/3 (100.0%) | 1/3 (33.3%) | 100.0% | 33.3% |
heap-field-sensitivity | 0 | 0 | 0 | 0 | 0 | 18 | 0 | n/a | n/a | n/a | n/a |
interprocedural-flow | 0 | 0 | 0 | 0 | 0 | 22 | 0 | n/a | n/a | n/a | n/a |
local-flow | 7 | 0 | 2 | 5 | 0 | 2 | 0 | 7/7 (100.0%) | 2/7 (28.6%) | 100.0% | 28.6% |
object-sensitivity | 0 | 0 | 0 | 0 | 0 | 12 | 0 | n/a | n/a | n/a | n/a |
path-sensitivity | 3 | 0 | 2 | 1 | 0 | 0 | 0 | 3/3 (100.0%) | 2/3 (66.7%) | 100.0% | 66.7% |
recursion | 0 | 0 | 0 | 0 | 0 | 2 | 0 | n/a | n/a | n/a | n/a |