Identity Transform Build Fails - Module died. Exit reason: MODULE_UNREACHABLE

Ask the Community
1

Hi there,

I have an identity transform to keep an extra copy of materializations that is failing with the error:

Module died. Exit reason: UNKNOWN_REASON.

Message not helpful?
The driver running the job crashed, ran out of memory, was terminated, or otherwise became unresponsive while it was running; try rebuilding, and if the problem persists, try increasing driver memory. The exit reason for the crash was UNKNOWN_REASON.

I added an advanced compute profile which bumps the driver memory to Large, but I still am not seeing a difference. Is there something else I should bump? How can I get approval for an extra large driver memory profile? Thanks!

2

Hey, hard for us to debug something like this from a community forum perspective. If this is blocking and you have access, please file a ticket for tracking! I think there’s a special group you need to be in to be able to access the extra large compute profiles - something like spark-profile-admins.