@mqureshi Thank you for the prompt response. I am new to this space. Could you please elaborate little bit on setting up spark- env.sh. I understand this is to hand shake with hive, trying to get exact values. My current set up is: HADOOP_CONF_DIR=${HADOOP_CONF_DIR:-/usr/hdp/2.6.2.0-205/hadoop/conf} How to add hdfs,hive,core site xmls. In the java code you put above, i don't see the hive connection parameters. Do i need to replace the values on this? .config("spark.some.config.option","some-value") Please advise. ... View more

@Prabhu Muthaiyan , you can use rlike regex select count(*) from <tableName> where <colName> not rlike '[^0-9]' ; ... View more

@Prabhu Muthaiyan Glad that it helped you. Happy Hadooping!! ... View more