Member since
10-01-2015
3933
Posts
1150
Kudos Received
374
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3648 | 05-03-2017 05:13 PM | |
| 3002 | 05-02-2017 08:38 AM | |
| 3261 | 05-02-2017 08:13 AM | |
| 3215 | 04-10-2017 10:51 PM | |
| 1680 | 03-28-2017 02:27 AM |
03-21-2016
10:42 PM
What is being used by port 11000? We do not use it for anything but Oozie, it could be another instance of Oozie, please dig into the process and kill if necessary. ps aux | grep oozie kill -9 ooziepid
... View more
03-21-2016
12:24 PM
1 Kudo
HDP installs are placed in /usr/hdp/version, so in case you are on HDP, look for /usr/hdp on your local filesystem not in HDFS. Then in Ambari, make sure you have pig client installed on the machines you're on. Look for that jar in the directory I specified earlier. @Maeve Ryan
... View more
03-21-2016
10:57 AM
Check your hive url 17:29:17,177 logger.py:67 - Execute['! beeline -u 'jdbc:hive2://vm-hadoop-slave2.out:11000/;transportMode=binary' -e '' 2>&1| awk '{print}'|grep -i -e 'Cction refused' -e 'Invalid URL''] {'path': ['/bin/', '/usr/bin/', '/usr/lib/hive/bin/', '/usr/sbin/'], 'user': 'ambari-qa', 'timeout': 30} INFO 2016-03-17 17:29:17,214 logger.py:67 - Execute['source /usr/hdp/current/oozie-server/conf/oozie-env.sh ;
... View more
03-21-2016
10:51 AM
He just did, this particular HDP 2.4 release is not 0.9.0.1 but next maintenance release will have it. Expect it in hdp version 2.4.x.x not 2.4.0.0.
... View more
03-21-2016
10:47 AM
make sure hdp-select is installed, make sure hdfs-client is installed, as the last resort mkdir the directory and try again. More details please, I'm not sure if this is an upgrade to existing cluster or new install.
... View more
03-21-2016
01:20 AM
1 Kudo
My only guess is that your use case is more advanced than other users'. I will raise this question with the team. @rcoss @rmolina
... View more
03-21-2016
01:15 AM
2 Kudos
I have an example from a book by Ofer and Casey from Hortonworks implementing TF-IDF using pyspark (python and Spark). It does need more work but it can put you on the right path. https://github.com/dbist/datamunging You surely picked a pretty sophisticated usecases to start learning Hadoop.
... View more
03-21-2016
01:09 AM
2 Kudos
As long as you use HDP and you have pig client installed on your edgenode, you can find piggybank jar in /usr/hdp/current/pig-client/lib/piggybank.jar. you dont need to download it separately or upload it to hdfs. Please see this for example https://community.hortonworks.com/questions/20487/store-output-file-as-3-files-using-pig.html
... View more
03-20-2016
07:16 PM
@Gerd Koenig you know we expect an article from you on doing just that, end to end hbase rest and alerting. A very simple approach would be to have an always-on script checking for service up or down. Going the API way is a lot better for obvious reasons.
... View more