About smayani

smayani · ‎10-03-2016

@Matt Burgess Here is new error: Caused by: java.net.URISyntaxException: Illegal character in path at index 73: hive2://dummyhost:00000/;principal=hive/_HOST@EXAMPLE.COM at java.net.URI$Parser.fail(URI.java:2848) ~[na:1.8.0] at java.net.URI$Parser.checkChars(URI.java:3021) ~[na:1.8.0] at java.net.URI$Parser.parseHierarchical(URI.java:3105) ~[na:1.8.0] at java.net.URI$Parser.parse(URI.java:3053) ~[na:1.8.0] at java.net.URI.<init>(URI.java:588) ~[na:1.8.0] at java.net.URI.create(URI.java:850) ~[na:1.8.0] ... 33 common frames omitted Here is the Database Connection URL: jdbc:hive2://host.name.net:10000/;principal=hive/_HOST@EXAMPLE.COM

smayani · ‎09-22-2016

PutHiveQL and SelectHiveQL processors are looking for class ‘org.apache.hive.jdbc.HiveDriver’ which I guess should have already been specified into. Is there any option to specify that in HiveConnectionPool. Error is as follows 2016-09-19 17:55:30,084 ERROR [Timer-Driven Process Thread-4] o.a.nifi.processors.hive.SelectHiveQL SelectHiveQL[id=4467ed6d-0157-1000-5114-2998b4c5f3aa] Unable to execute HiveQL select query select * from nifitest; due to org.apache.nifi.processor.exception.ProcessException: org.apache.commons.dbcp.SQLNestedException: Cannot create JDBC driver of class 'org.apache.hive.jdbc.HiveDriver' for connect URL '!connect jdbc:hive2://host.name.net:10000/;principal=hive/_HOST@EXAMPLE.COM '. No FlowFile to route to failure: org.apache.nifi.processor.exception.ProcessException: org.apache.commons.dbcp.SQLNestedException: Cannot create JDBC driver of class 'org.apache.hive.jdbc.HiveDriver' for connect URL '!connect jdbc:hive2://host.name.net:10000/;principal=hive/_HOST@EXAMPLE.COM '

smayani · ‎05-24-2016

heapsize was 1GB. Looks like that is the default. Is there a class to read "yarn-nm-recovery" file to check on how many jobs were running to get recovered ?

smayani · ‎05-24-2016

@Geoffrey Shelton Okot I am specifically looking for heap size for YARN Resource Manager Daemon and Node Manager daemon and not for containers memory allocation sizing.

smayani · ‎05-24-2016

To avoid errors on starting up Node Managers application : "GC Overhead limit exceeded" when yarn.nodemanager.recovery.enabled = true. How do you determine / size Node Manager heap.

smayani · ‎05-17-2016

My application need common-codec1.10 version but on cluster i have 1.4, when i launch yarn application using hadoop_classpath=/home/*/common-codec-1.10.jar:o yarn jar <*.jar> yarn picks up 1.4 first then after it has 1.10. so i am getting exception on method not found. How can tell yarn application to read through full classpath instead to read till 1.4 and stop.

smayani · ‎04-21-2016

Default fs.trash.interval=0 & fs.trash.checkpoint.interval=0 indicating i.e. trash feature is disabled. What is recommended value for Production like clusters ? if these values are 0 then what is command to empty entire hdfs trash directories on periodic basis?

smayani · ‎04-06-2016

smayani · ‎04-05-2016

This can be solved by appending "oozie.launcher." to the properties. <configuration> <property> <name>oozie.launcher.dfs.nameservices</name> <value>${nameService1},${nameService2}</value> </property> <property> <name>oozie.launcher.dfs.ha.namenodes.${nameService2}</name> <value>${nn21},${nn22}</value> </property> <property> <name>oozie.launcher.dfs.namenode.rpc-address.${nameService2}.${nn21}</name> <value>${nn21_fqdn}:8020</value> </property> <property> <name>oozie.launcher.dfs.namenode.rpc-address.${nameService2}.${nn22}</name> <value>${nn22_fqdn}:8020</value> </property> <property> <name>oozie.launcher.dfs.client.failover.proxy.provider.${nameService2}</name> <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value> </property> <property> <name>oozie.launcher.mapreduce.job.hdfs-servers</name> <value>${defaultFS1},${defaultFS2}</value> </property> </configuration>

smayani · ‎03-03-2016

How we would go about configuring the number of HBase snapshots that are saved? Is there a purge process or setting?

Online	Offline
Last Visited	‎05-15-2018 07:39 PM

Member Since	‎09-25-2015 05:14 PM
Last Visited	‎05-15-2018 07:39 PM
Posts	109
Kudos received	33

Cloudera Community

Re: yarn.nodemanager.resource.cpu-vcores is by def...

Re: default queue accepting one mr job for hive wh...

Re: How to move all the regions of a region server...

Re: Memory Utilization is high unable to find what...

Re: In Kerberos setting, in a HDP, how to confirm ...

Re: NiFi Cannot create JDBC driver of class 'org.a...

NiFi Cannot create JDBC driver of class 'org.apach...

Re: How to determine and size Node Manager Heap si...

Re: How to determine and size Node Manager Heap si...

How to determine and size Node Manager Heap size?

How to read specific jar from classpath (having mu...

hdfs trash compaction

Do we have instructions on how to compile the comp...

Re: how to resolve ${nameservice2} in oozie.launch...

How we would go about configuring the number of HB...