Where Does an LLM Fuzzer's Domain Knowledge Come From? Human, Code-Read, and Self-Acquired Knowledge for Differential Testing of Typed Deserializers
IEEE International Conference on Software Testing, Verification and Validation
A pre-registered study of 8 JSON libraries in Dart and Kotlin (55 seeded runs, 83,500 inputs) comparing knowledge written by a person, read from code, or learned from the agent's own experiments. Human-written knowledge worked best (30.9% vs. 1.5% of inputs exposing disagreements without it); the experimenting agent raised Kotlin's rate from 50% to 67% but missed rare failures.