Member since
03-18-2018
33
Posts
0
Kudos Received
0
Solutions
08-30-2018
12:51 PM
Thanks .Yes we do have postgres DB which used for ambari and Hive metastore
... View more
08-30-2018
12:44 PM
All nodes on our cluster require outage for maintenance . I am planning to stop all services in Ambari and stop Ambari server Are these steps correct & enough?
... View more
Labels:
05-23-2018
04:39 PM
None of the above worked. It working after adding below configuration set("spark.jars","/usr/hdp/current/spark2-client/jars/sqljdbc42.jar")
... View more
05-23-2018
12:08 PM
Thanks Sridhar Already tried the --jars and spark.driver.extraClassPath & spark.executor.extraClassPath, they don't work. What do you mean by "Directory expansion does not work with --jars"
... View more
05-23-2018
01:03 AM
spark-submit --master yarn --deploy-mode cluster sqlserver.py --jars sqljdbc42.jar I get Error : java.lang.ClassNotFoundException: com.microsoft.sqlserver.jdbc.SQLServerDriver Everything works when i use --deploy-mode client and copy the jar file to /usr/hdp/current/spark2-client/jars/sqljdbc42.jar Should i copy the sqljdbc42.jar to /usr/hdp/current/hadoop-yarn-client/lib/ on all data nodes?
... View more
Labels:
- Labels:
-
Apache Spark
-
Apache YARN
05-03-2018
01:09 AM
Any update , its 2018. I am gettiing the same error, Error: Error while processing statement: FAILED: Hive Internal Error: org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAccessControlException(Query with transform clause is disallowed in current configuration.) (state=08S01,code=12)
... View more
04-14-2018
02:54 PM
I am also facing the same issue, did you find a resolution?
... View more
03-22-2018
06:10 PM
I have downloaded NIFI registry from hortonworks website. I am installed on windows 10.I am getting below error when trying to execute run-nifi-registry.bat 2018-03-22 13:51:26,814 INFO [main] org.apache.nifi.registry.NiFiRegistry Launching NiFi Registry...
2018-03-22 13:51:26,814 INFO [main] org.apache.nifi.registry.NiFiRegistry Read property protection key from conf/bootstrap.conf
2018-03-22 13:51:26,861 INFO [main] o.a.n.r.security.crypto.CryptoKeyLoader No encryption key present in the bootstrap.conf file at C:\Users\Vdutt\Downloads\nifi_regis\nifi-registry-0.1.0-bin.tar\nifi-registry-0.1.0-bin\nifi-registry-0.1.0\conf\bootstrap.conf
2018-03-22 13:51:26,877 INFO [main] o.a.n.r.p.NiFiRegistryPropertiesLoader Loaded 26 properties from C:\Users\Vdutt\Downloads\nifi_regis\nifi-registry-0.1.0-bin.tar\nifi-registry-0.1.0-bin\nifi-registry-0.1.0\conf\nifi-registry.properties
2018-03-22 13:51:26,885 INFO [main] org.apache.nifi.registry.NiFiRegistry Loaded 26 properties
2018-03-22 13:51:26,886 INFO [main] org.apache.nifi.registry.NiFiRegistry NiFi Registry started without Bootstrap Port information provided; will not listen for requests from Bootstrap
2018-03-22 13:51:26,889 ERROR [main] org.apache.nifi.registry.NiFiRegistry Failure to launch NiFi Registry due to java.lang.NoClassDefFoundError: org/apache/nifi/registry/util/FileUtils
java.lang.NoClassDefFoundError: org/apache/nifi/registry/util/FileUtils
at org.apache.nifi.registry.NiFiRegistry.<init>(NiFiRegistry.java:97) ~[nifi-registry-runtime-0.1.0.jar:0.1.0]
at org.apache.nifi.registry.NiFiRegistry.main(NiFiRegistry.java:158) ~[nifi-registry-runtime-0.1.0.jar:0.1.0]
Caused by: java.lang.ClassNotFoundException: org.apache.nifi.registry.util.FileUtils
at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[na:1.8.0_161]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[na:1.8.0_161]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) ~[na:1.8.0_161]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[na:1.8.0_161]
... 2 common frames omitted
2018-03-22 13:51:26,891 INFO [Thread-1] org.apache.nifi.registry.NiFiRegistry Initiating shutdown of Jetty web server...
2018-03-22 13:51:26,891 INFO [Thread-1] org.apache.nifi.registry.NiFiRegistry Jetty web server shutdown completed (nicely or otherwise).
... View more
Labels:
- Labels:
-
Apache NiFi