I have questions about Object Storage V2 Changelog.
When I updated the Ontology of the following volume, I failed the first time and succeeded the second time.
I couldn’t get much information from the log.(only Failed) What is the difference between the first time and the second time? (Like adjusting spark params?)
Also, even if I fail the first time, if I succeed the second time or later, I don’t have to worry about it?
< volume >
・21 columns
・455,000,000 rows
・17.6 GB
Indeed, Funnel batch pipeline jobs have logic that retry with increased resources on failure, so your supposition (that the difference between the first time and the second time is the adjusting of spark parameters) is exactly correct. If you are interested, you should be able to confirm this by going to Spark Details → Environment from the job tracker page for the jobs in-question and comparing the values for e.g. executorMemory. In any event, as long as the second (or third) attempt succeeds, you do not need to worry about the initial failures.