privacyaudit New scan
Controlled Evaluation & Dynamic Testing Laboratory

Privacy Benchmark Lab

Evaluates detection pipelines against controlled, ground-truth-labeled synthetic Android test APKs, and houses the safety architecture for isolated dynamic sandbox execution.

Total Scenarios
5
Synthetic ground truth cases
Cases Passed
5
100% ground-truth alignment
Failed / Regressions
0
Zero false assertions
Accuracy Rate
100.0%
Deterministic verification

Controlled Ground-Truth Scenarios

Each test scenario proves a specific capability of the Android Privacy Auditor engine.

Test APK A: Manifest Declaration Only

App requests android.permission.ACCESS_FINE_LOCATION in manifest but never references location APIs in code.

Passed
Expected: Declared: True, Code Ref: False, IPC Risk: False
Actual Engine Outcome: Declaration detected in manifest; DEX inspection correctly reported 0 API callsites.
Test APK B: Confirmed API Reference

App requests android.permission.ACCESS_FINE_LOCATION and contains LocationManager.getLastKnownLocation() calls in DEX.

Passed
Expected: Declared: True, Code Ref: True, IPC Risk: False
Actual Engine Outcome: Declaration and Dalvik callsite (LocationManager->getLastKnownLocation) accurately discovered by Privacy X-Ray.
Test APK C: Source-to-Sink Data Flow

Synthetic data flow: Contact read source flows to network or storage sink.

Passed
Expected: Declared: True, Code Ref: True, IPC Risk: False
Actual Engine Outcome: Source and sink API points identified; static data flow mapped to synthetic test harness.
Test APK D: Exported Component Attack Surface

App declares an exported BroadcastReceiver with intent-filter and no android:permission protection.

Passed
Expected: Declared: False, Code Ref: False, IPC Risk: True
Actual Engine Outcome: Unguarded exported receiver detected and flagged as high-exposure IPC attack surface.
Test APK E: Release Differential Radar

v1 baseline vs v2 release with added permission and telemetry framework.

Passed
Expected: Declared: True, Code Ref: True, IPC Risk: False
Actual Engine Outcome: Update Radar successfully computed differential delta, isolating added permission and version metadata.