Hi,
I’m trying to process and output data sets using pyspark on the Jupyter workspace.
Based on the documentation, I understood that I needed to install openjdk and the pyspark library to use pyspark, and I actually checked the pyspark transform on the cell.
However, when I try to sync the changes to convert the results to a dataset, publish fails.
The error statement is as follows, and it seems that I do not have the necessary permission to publish.
Do I need any additional settings?
Premise:
・Working on personal folder
・openjdk is version 22.0.1 (installed with conda)
・pyspark is 3.5.4 (installed with PyPi)
Thanks!
