Never mind it works ,if add empty line between every package in PACKAGES file ... View more

I have followed the above steps keep getting the following error install.packages("magrittr", repos = "/tmp/r-packages/") Installing package into ‘/usr/lib64/R/library’ (as ‘lib’ is unspecified) Warning message: package ‘magrittr’ is not available (for R version 3.4.1) ... View more

Could you share the nifi template for this flow ... View more

Make sure u have following dependencies based on your hdp version. <dependencies> <dependency> <groupId>org.apache.hive</groupId> <artifactId>hive-exec</artifactId> <version>1.2.1000.2.5.3.0-37</version> </dependency> <dependency> <groupId>org.apache.hive</groupId> <artifactId>hive-jdbc</artifactId> <version>1.2.1000.2.5.3.0-37</version> </dependency> <dependency> <groupId>org.apache.hive</groupId> <artifactId>hive-metastore</artifactId> <version>1.2.1000.2.5.3.0-37</version> </dependency> <dependency> <groupId>org.apache.hive</groupId> <artifactId>hive-service</artifactId> <version>1.2.1000.2.5.3.0-37</version> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-common</artifactId> <version>2.7.3.2.5.3.0-37</version> </dependency> </dependencies> following is the example code org.apache.hadoop.conf.Configuration conf = new org.apache.hadoop.conf.Configuration(); conf.set("hadoop.security.authentication", "Kerberos"); UserGroupInformation.setConfiguration(conf); UserGroupInformation.loginUserFromKeytab("hive/xx@HDP.COM", "/tmp/hive.service.keytab"); Class.forName("org.apache.hive.jdbc.HiveDriver"); System.out.println("getting connection"); Connection con = DriverManager.getConnection("jdbc:hive2://<host>:10001/;principal=hive/xx@HDP.COM;transportMode=http;httpPath=cliservice"); ... View more

You can use the following cmd oozie jobs -filter status=FAILED -len 1000 -oozie http://localhost:11000/oozie ... View more

in your /home/<user>/.storm/storm.yaml file,need to specify following property supervisor.run.worker.as.user : true ... View more

i am not sure about unix command,what is the time duration u see in resourcemanager url ... View more

You can check for empty patition using following code lines.dstream().foreachRDD(rdd => { if(!rdd.partitions.isEmpty) rdd.saveAsTextFile(outputDir) }) ... View more

sorry typo, 8088 is the port ... View more