Hi, Complex types are generally used to aggregate the characteristics of an object, for example: Based on: https://impala.apache.org/docs/build/html/topics/impala_struct.html#struct type: current_address STRUCT <
So now we have the 'current_address' attribute and its members grouped. This is not only organizational, but also has an impact on the performance of the processes related to this table. When you want to retrieve a data it can be done like this: SELECT id, name,
FROM struct_demo; Despite the example they are giving, it refers to Apache Impala the concept is the same applied to Spark. Hope this helps.
... View more