How to parse an array of structs in streaming pipeline builder

[groth]

I have an array of structs field and I want to flatten the column into multiple parallel arrays where each has one struct field. Is this possible in builder (streaming)? Which transform(s) would I use?

See example below.

Input Array[Struct] column:
[
{
“pose_”: {
“orientation_”: {
“w_”: “1”,
“x_”: “0”,
“y_”: “0”,
“z_”: “0”
},
“position_”: {
“x_”: “0”,
“y_”: “10”,
“z_”: “0”
}
}
},
{
“pose_”: {
“orientation_”: {
“w_”: “1”,
“x_”: “0”,
“y_”: “0”,
“z_”: “0”
},
“position_”: {
“x_”: “10”,
“y_”: “20”,
“z_”: “0”
}
}
},
{
“pose_”: {
“orientation_”: {
“w_”: “1”,
“x_”: “0”,
“y_”: “0”,
“z_”: “0”
},
“position_”: {
“x_”: “10”,
“y_”: “50”,
“z_”: “0”
}
}
}
]

Output Array[double] columns:
pose_orientation_w: [1,1,1]
pose_orientation_x: [0,0,0]
pose_orientation_y: [0,0,0]
pose_orientation_z: [0,0,0]
pose_position_x: [0,10,10]
pose_position_y: [10,20,50]
pose_position_z: [0,0,0]

[dherls]

Hi @groth you can use a combination of the “Transform array element” and “Get struct field” expressions:

Notional example:

You will need to repeat this board several times to extract all of the values you want.