I realized today, after browsing many google results, that it is illicit to use a "null" value as a parameter of a where clause. Because null is considered to be unknown, two null values compared to each other are not considered to be equal. In expressions using arithmetic operators, if any of the operands is null, the result is null as well. Details can be found here : https://stackoverflow.com/questions/36992184/sqlcommand-createparameter-value-dbnull-value-not-returning-results So it was obvious that my simple C# sample would not work and it had actually nothing to do with the Cloudera ODBC driver. ... View more

@alexe   yes, you can login with pyspark (or) spark-shell and run your commands one by one to get the result. All they need is your result and code that you have used to generate the result. So it is not necessary to create .jar from your code and execute (also it will take additional time) ... View more

It is very wierd that I rebooted the system, started the cloudera-management-services, and then started others services individually. It is working now.   I am not sure why it happened. It was really a nightmare, and I am really surprised what should I do in such scenarios (without rebooting system). ... View more

@Fawze I don't collect specific metric, yet. I make an api call to get all Hive jobs between this time and that time (same for Impala) from... This data is then crunched to provide usage analysis for these specific types of jobs. /clusters/{clusterName}/services/{serviceName}/yarnApplications /clusters/{clusterName}/services/{serviceName}/impalaQueries ... View more

/user/spark directory was missing. I created it manually and it worked fine. ... View more