1973
Posts
1225
Kudos Received
124
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1998 | 04-03-2024 06:39 AM | |
| 3165 | 01-12-2024 08:19 AM | |
| 1725 | 12-07-2023 01:49 PM | |
| 2503 | 08-02-2023 07:30 AM | |
| 3507 | 03-29-2023 01:22 PM |
09-18-2016
09:07 PM
are you logged in as root/hadoop in the root home directory? http://hortonworks.com/hadoop-tutorial/learning-the-ropes-of-the-hortonworks-sandbox/
... View more
09-18-2016
09:02 PM
can you login as admin with password admin
... View more
09-18-2016
08:18 PM
1 Kudo
https://developer.ibm.com/hadoop/2016/04/26/submit-spark-jobs-via-rest-iop-4-1-using-livy/ http://livy.io/overview.html http://www.slideshare.net/JenAman/livy-a-rest-web-service-for-apache-spark https://spark-summit.org/eu-2015/events/building-a-rest-job-server-for-interactive-spark-as-a-service/ Livy with Zeppelin
http://www.slideshare.net/HadoopSummit/apache-zeppelin-livy-bringing-multi-tenancy-to-interactive-data-analysis
https://github.com/apache/zeppelin/blob/master/docs/interpreter/livy.md
Using Livy with Zeppelin
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/ch_stop-services.html
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/install-livy.html
... View more
09-15-2016
06:00 PM
NIFI/HDF is the way, very easy and a huge number of sources. https://community.hortonworks.com/articles/52415/processing-social-media-feeds-in-stream-with-apach.html ttps://community.hortonworks.com/content/kbentry/47854/accessing-facebook-page-data-from-apache-nifi.html
h ttps://community.hortonworks.com/articles/46258/iot-example-in-apache-nifi-consuming-and-producing.html
h ttps://community.hortonworks.com/articles/45531/using-apache-nifi-070s-new-putslack-processor.html
h ttps://community.hortonworks.com/articles/45706/using-the-new-hiveql-processors-in-apache-nifi-070.html
h https://community.hortonworks.com/content/kbentry/44018/create-kafka-topic-and-use-from-apache-nifi-for-hd.html https://community.hortonworks.com/content/kbentry/55839/reading-sensor-data-from-remote-sensors-on-raspber.html
... View more
09-15-2016
01:33 PM
ambari-server install-mpack --purge --verbose --mpack=http://public-repo-1.hortonworks.com/HDF/centos7/2.x/updates/2.0.0.0/tars/hdf_ambari_mp/hdf-ambari-mpack-2.0.0.0-579.tar.gz on Centos 7.2
... View more
09-15-2016
01:25 PM
15 Sep 2016 13:23:41,006 INFO [main] ClustersImpl:179 - Initializing the ClustersImpl
15 Sep 2016 13:23:41,100 WARN [Stack Version Loading Thread] LatestRepoCallable:237 - Could not load version definition for HDF-2.0 identified by http://public-repo-1.hortonworks.com/HDF/centos7/2.x/BUILDS/2.0.0.0-579/HDF-2.0.0.0-579.xml. http://public-repo-1.hortonworks.com/HDF/centos7/2.x/BUILDS/2.0.0.0-579/HDF-2.0.0.0-579.xml
java.io.FileNotFoundException: http://public-repo-1.hortonworks.com/HDF/centos7/2.x/BUILDS/2.0.0.0-579/HDF-2.0.0.0-579.xml
at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1836)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)
at java.net.URL.openStream(URL.java:1045)
at org.apache.ambari.server.state.repository.VersionDefinitionXml.load(VersionDefinitionXml.java:298)
at org.apache.ambari.server.state.stack.LatestRepoCallable.mergeDefinitions(LatestRepoCallable.java:233)
at org.apache.ambari.server.state.stack.LatestRepoCallable.call(LatestRepoCallable.java:176)
at org.apache.ambari.server.state.stack.LatestRepoCallable.call(LatestRepoCallable.java:47)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
... View more
09-15-2016
01:23 PM
2 Kudos
I installed the HDF 2.0 management pack on HDP 2.5 ambari server and after restart it dies. Is there a different pack for 2.5? http://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.0.0/bk_ambari-installation/content/set_up_the_ambari_server.html 2016-09-15 13:18:31,098 INFO - ******************************* Check database started *******************************
2016-09-15 13:18:35,606 INFO - Checking for configs not mapped to any cluster
2016-09-15 13:18:35,630 INFO - Checking for configs selected more than once
2016-09-15 13:18:35,633 INFO - Checking for hosts without state
2016-09-15 13:18:35,634 INFO - Checking host component states count equals host component desired states count
2016-09-15 13:18:35,637 INFO - Checking services and their configs
2016-09-15 13:18:37,207 ERROR - Exception occurred during complex service check procedure:
org.apache.ambari.server.ParentObjectNotFoundException: Parent Stack Version resource doesn't exist. Stack data, Stack HDP 2.5 is not found in Ambari metainfo. Stack data, Stack HDP 2.5 is not found in Ambari metainfo
at org.apache.ambari.server.api.services.AmbariMetaInfo.getServices(AmbariMetaInfo.java:520)
at org.apache.ambari.server.checks.DatabaseConsistencyCheckHelper.checkServiceConfigs(DatabaseConsistencyCheckHelper.java:540)
at org.apache.ambari.server.checks.DatabaseConsistencyChecker.main(DatabaseConsistencyChecker.java:115)
Caused by: org.apache.ambari.server.StackAccessException: Stack data, Stack HDP 2.5 is not found in Ambari metainfo
at org.apache.ambari.server.api.services.AmbariMetaInfo.getStack(AmbariMetaInfo.java:618)
at org.apache.ambari.server.api.services.AmbariMetaInfo.getServices(AmbariMetaInfo.java:518)
... 2 more
2016-09-15 13:18:37,212 INFO - ******************************* Check database completed *******************************
2016-09-15 13:18:42,433 INFO - Checking DB store version
2016-09-15 13:18:43,193 INFO - DB store version is compatible
... View more
Labels:
09-15-2016
01:05 PM
Check out the Developer's Guide https://nifi.apache.org/developer-guide.html
... View more
09-15-2016
12:18 PM
Why connect to hive via JDBC? Use SparkSQL with the HiveContext and have full access to all the HiveTables. This is optimized in spark and very fast. https://spark.apache.org/docs/1.6.0/sql-programming-guide.html
... View more