Querying large datasets in Cloudera - Emmanuel Katto

[#1]

Hello everyone, My name is Emmanuel Katto. Can anyone share their experiences with Impala for querying large datasets in Cloudera? What are some tips for optimizing query performance?

Looking forward to your tips/suggestions.

Thanks in advance!

Best,

Emmanuel Katto

[#2]

@emmanuelkatto Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our Impala experts @jAnshula @Boris G @Saurabhatiyal  who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

[#3 · Accepted solution]

Hello-

Impala is architected for querying "large datasets" out of the box. However, depending on your requirements, you need to allocate enough hardware and resources. You can start with https://impala.apache.org/docs/build/html/topics/impala_scalability.html, https://impala.apache.org/docs/build/html/topics/impala_resource_management.html, https://impala.apa... and https://impala.apache.org/docs/build/html/topics/impala_planning.html.

Let me know if that helps.

[#4]

@emmanuelkatto Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.