Unable to create custom data retention policy for streaming dataset

Ask the Community
,
1

Hi guys,

Is anyone aware of how to create custom data retention policies for streaming datasets ?

In my case , i have a scenario where we have a streaming pipeline and we apply certain transformation of the consumed streamed data from Kafka and then creating a new streaming dataset which is then used in the Ontology Object.

Is there a way to create a retention policy to keep only last 1 or 2 hrs of data because i am unable to create a custom data retention policy

image
image1615×749 47.3 KB

Thanks in advance !