Find project resources that have not been accessed/used for some time via logs

Hello Community team,

We have a use case where we want to be able to find for a specific project all the resources (dataset, workshop, restricted view, etc.) that have not been accessed/opened/used for some time by users.

In fact, we currently find ourselves in a situation where we have lots of projects containing lots of resources that have certainly not been used/accessed for some time (a year, for example).

We want to be able to identify them quickly so we can take the necessary action.

Ideally, we’re thinking of a chain of API calls where we pass in the project’s rid parameters to retrieve the logs of all resources from that project and store them in a dataset.

Has anyone worked on a similar case? Any pointers on specific call APIs to use, or other solutions to achieve this use-case will be greatly appreciated.

Best

Hello!

The difficulty here might be in defining “usage”. There are a number of ways to “use” a resource in Foundry without actually opening it and looking at it. For example:

  • Datasets can be the inputs to pipelines and the contents can be used without users looking at it directly.
  • Code repositories can publish functions that are used in a number of workshop modules, but users haven’t looked at the code repository in a while.
  • Workshop modules might be embedded in another workshop module instead of being used directly.
  • etc, etc

Your best starting place will probably be the Audit Logs. A platform administrator can generate an audit log dataset that contains a full log of all activity on the platform.

You could parse this dataset to identify when users look at various resources and inform your decisions.

If you’re looking for datasets that are “unused” in the sense that they are not inputs for any pipelines or Objects, you can use Linter.

1 Like

For a quick, limited view of usage, Data Lineage’s legend can be set to “User views” in the Node color options dropdown menu.

1 Like