01-29-2018 07:29 AM
I did not found any documents describing how the spark tasks are assigned to which exectur when data is read from Kudu into dataframes. I noticed, that in some cases (did not have enough time to test) Spark reads data ONLY from the Leaders of the tablets, so moving data across network.
Is there any setting or configuration for co-locate the spark task in an executor with a Kudu tablet?
Based on the Kudu documentation, the LEADER is for write, but the FOLLOWERs can server reads too..
01-29-2018 11:15 AM