I would like to check all the packages my Java Transform depends on, and possibly pin the packages’ versions. I know I can pin versions in build.gradle for explicitly imported packages. What about ones that come with default setup? How could I view all dependencies?
You are able to see the external dependencies of your java transform by looking at the dependencies
tab from spark details. This is accessible from the finished job page → spark details → dependencies.
Unfortunately the internal dependencies will not be shown here. you can however see some of the details, like spark version or java module version, in the environment
tab of spark details
Thank you!
Can I safely assume internal dependencies stay the same unless the version of Transforms has been changed?
If the user code does not introduce any new dependencies (i.e. manual or with repository upgrades) and the sparkModuleVersion
outlined in the Environment
tab stays the same, it is safe to assume there will no dependency change.
Always check the sparkModuleVersion
though, as automatic upgrades of such version can come through and bring new dependencies.
You can find more information about transforms versioning system in public documentation https://www.palantir.com/docs/foundry/transforms-common/transforms-versions
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.