Do Many to Many Writeback Datasets remove stale links, i.e. ones where one of the objects is deleted?

Hi All,

I was wondering if a many to many writeback dataset removes stale links when one of the objects being linked is deleted, and if so, what’s the waiting window and/or what’s the condition that triggers the clean up event.

Semi related too, I was wondering if having too many stale links degrade performance for the ontology.

Hi ojanaheddine,

I’m assuming you’re using Object Storage v2, and I’ll answer based on that since I don’t know the OSv1 answer. In general, writeback datasets are just a view into the state of the Ontology, and the objects system (Funnel) does not do any kind of cleanup regarding stale links, so they will appear in your materialization. These shouldn’t affect your performance massively unless they’re an overwhelming majority of your total data (think, more than 85% of your links are stale).

If you’re concerned about a buildup of stale links, I would recommend bundling deleting the associated links into the same action where you delete the object. That way, the cleanup will happen transactionally and you don’t have to ever worry about stale links appearing.

Best,
Carson Fleming