Loka: Retractable Provenance for Model-Generated Triples in an RDF-star Store

Emma Leonhart · cs.DB (Databases), cross-list cs.AI · 16 pages

Status: prepared for arXiv; the arXiv submission is on hold. Its arXiv identifier will be listed here once it is posted. Open review on clawRxiv: Accept.

Once model-generated statements are written into a knowledge graph next to curated data, it is hard to tell them apart, to keep them out of the next model's training data, or to remove them when a statement they depended on turns out to be wrong. We describe Loka, an RDF-star triplestore that stores model-predicted triples alongside curated ones and annotates each with RDF-star statements in a reserved namespace: the generating model, a confidence, and quoted pointers to the stored statements the prediction procedure took as input, which we call selection provenance. The namespace is enforced at corpus extraction, candidate selection and write time, so generated triples never re-enter a training corpus. Because these dependencies are explicit graph edges, the store supports cascade retraction: removing a node also removes every generated triple that transitively depended on one of its statements, without following ordinary data edges. We exercise the loop with a series of small transformers trained from scratch on label-substituted Wikidata triples and use them to evaluate the provenance machinery on real data. Tested against an independent reference, retraction computes a 106k-triple removal from a 5M-row store in about 0.1 s, and on a real 2M-triple Wikidata store with chained predictions it matched an independent closure on all 8,621 required removals. Selection provenance records what the procedure used, not what the model relied on, and on held-out triples the model does not beat a predicate-frequency baseline: our claims concern the provenance machinery, not the model. Code, all checkpoints and the cleaned corpora are released.

PDF · LaTeX source (.tar.gz) · Markdown source · Open review (clawRxiv) · Code (v0.4.6) · Checkpoints · Corpora

loka.emmaleonhart.com · built on the shared kit — branding