# \#data-lifetime **URL:** https://community.palantir.com/tag/data-lifetime/59.md [Latest](https://community.palantir.com/latest.md) · [Categories](https://community.palantir.com/categories.md) · [Tags](https://community.palantir.com/tags.md) --- ## [Incremental Pipeline w/ Media Sets and Catalog Datasets Limitation](https://community.palantir.com/t/incremental-pipeline-w-media-sets-and-catalog-datasets-limitation/4596)
**Author:** [@mfannin](https://community.palantir.com/u/mfannin)\ **Replies:** 5\ **Last updated:** [July 28, 2025, 5:15pm UTC](https://community.palantir.com/t/incremental-pipeline-w-media-sets-and-catalog-datasets-limitation/4596 "2025-07-28T17:15:50Z")
I am appending from my file sync pdf files from a SharePoint site. The data ingested is a list of file paths (no schema) and I get several hundred of these a day… Converting these to Media Sets Incrementally doesn’t seem… --- ## [Object Storage v1 to Object Storage v2](https://community.palantir.com/t/object-storage-v1-to-object-storage-v2/6984)
**Author:** [@matchatea](https://community.palantir.com/u/matchatea)\ **Replies:** 2\ **Last updated:** [July 30, 2026, 8:24am UTC](https://community.palantir.com/t/object-storage-v1-to-object-storage-v2/6984 "2026-07-30T08:24:06Z")
Hello everyone, My team manages Ontology for several clients, and we are currently planning a migration from Object Storage v1 to Object Storage v2. I wanted to reach out to the community to see if anyone has already g… --- ## [Rolling Window Dataset](https://community.palantir.com/t/rolling-window-dataset/6114)
**Author:** [@ggsmith842](https://community.palantir.com/u/ggsmith842)\ **Replies:** 2\ **Last updated:** [March 3, 2026, 11:55am UTC](https://community.palantir.com/t/rolling-window-dataset/6114 "2026-03-03T11:55:57Z")
What options are there for creating a rolling window dataset? In my scenario, I have an incremental pipeline that reads from a snapshot dataset that is updated daily and only the data for the current day is written to … --- ## [How can i remove and delete files from a dataset by filename?](https://community.palantir.com/t/how-can-i-remove-and-delete-files-from-a-dataset-by-filename/3119)
**Author:** [@jkane](https://community.palantir.com/u/jkane)\ **Replies:** 2\ **Last updated:** [March 11, 2025, 9:32am UTC](https://community.palantir.com/t/how-can-i-remove-and-delete-files-from-a-dataset-by-filename/3119 "2025-03-11T09:32:50Z")
I have a dataset with files in it. I want to remove some of the files within that dataset, and keep the remaining files in that dataset. Is there a way to remove the data from within a dataset by filename? --- ## [Enhancing Ontology Properties Through AI-Powered Insights](https://community.palantir.com/t/enhancing-ontology-properties-through-ai-powered-insights/2901)
**Author:** [@Nick\_Mainella](https://community.palantir.com/u/Nick_Mainella)\ **Replies:** 0\ **Last updated:** [February 16, 2025, 2:40am UTC](https://community.palantir.com/t/enhancing-ontology-properties-through-ai-powered-insights/2901 "2025-02-16T02:40:58Z")
Hello, Over the past week, I’ve had multiple discussions with our team, all converging on similar challenges: “Is this property being actually being used anywhere?” “Why are there two final boolean values on 1 object?… --- ## [How to download a dataset at a specific transaction?](https://community.palantir.com/t/how-to-download-a-dataset-at-a-specific-transaction/2177)
**Author:** [@wgentry](https://community.palantir.com/u/wgentry)\ **Replies:** 1\ **Last updated:** [December 11, 2024, 4:28pm UTC](https://community.palantir.com/t/how-to-download-a-dataset-at-a-specific-transaction/2177 "2024-12-11T16:28:07Z")
Under the “History” tab of a dataset, I see that you can view the data as it existed at a certain time in the past. Is there a way to download this data? --- ## [Is it possible to break the chain on lineage-aware retention policies?](https://community.palantir.com/t/is-it-possible-to-break-the-chain-on-lineage-aware-retention-policies/670)
**Author:** [@ajalba](https://community.palantir.com/u/ajalba)\ **Replies:** 2\ **Last updated:** [July 15, 2024, 1:34pm UTC](https://community.palantir.com/t/is-it-possible-to-break-the-chain-on-lineage-aware-retention-policies/670 "2024-07-15T13:34:56Z")
Hey, I have a pipeline where the source data can sometimes contain sensitive data and I need to make sure that that sensitive data isn’t kept on Foundry. I know that one option is to set up a lineage-aware retention pol…