Member since
09-18-2015
3274
Posts
1159
Kudos Received
426
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2126 | 11-01-2016 05:43 PM | |
6445 | 11-01-2016 05:36 PM | |
4112 | 07-01-2016 03:20 PM | |
7052 | 05-25-2016 11:36 AM | |
3423 | 05-24-2016 05:27 PM |
05-17-2016
11:31 AM
1 Kudo
Original Post
DC/OS - a new kind of operating system that spans all of the servers in a physical or cloud-based datacenter, and runs on top of any Linux distribution.
Source
Projects
More details https://docs.mesosphere.com/overview/components/
Let's cover Mesos in this post
Frameworks (Application running on mesos) http://mesos.apache.org/documentation/latest/frameworks/
I used http://mesos.apache.org/gettingstarted/ to install Mesos in my local machine. I am launching c++, java and python framework in this demo.
Slide Share http://www.slideshare.net/tomasbart/introduction-to-apache-mesos
... View more
05-14-2016
02:09 PM
@Vinayak Agrawal try this try modifying the workflow.xml and add <exec>${execFile}</exec>
<env-var>HADOOP_USER_NAME=${wf:user()}</env-var>
<file>${execPath}#${execFile}</file>
... View more
05-14-2016
02:08 PM
@simran kaur try modifying the workflow.xml and add <exec>${execFile}</exec>
<env-var>HADOOP_USER_NAME=${wf:user()}</env-var>
<file>${execPath}#${execFile}</file>
... View more
05-14-2016
01:34 PM
1 Kudo
@mpandit Currently there is nothing but see this https://issues.apache.org/jira/browse/RANGER-895 Current version is 0.5.0 Wait for 0.6.0
... View more
05-14-2016
01:08 PM
1 Kudo
@pedababu turlapati You have to look into the following settings. This was happened in my cluster when I did the manual install i,e non ambari install http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_installing_manually_book/content/configure_yarn_and_mapreduce.html modify mapreduce.application.classpath - in the entries there should not be any breaks or gaps <property>
<name>mapreduce.application.classpath</name>
<value>$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:/usr/hdp/${hdp.version}/hadoop/lib/hadoop-lzo-0.6.0.${hdp.version}.jar:/etc/hadoop/conf/secure</value>
</property>
... View more
05-14-2016
12:53 PM
1 Kudo
@simran kaur Ambari takes care of creating users. I am not sure how did you install the cluster. Did you use ambari?
... View more
05-14-2016
12:51 PM
1 Kudo
@elan chelian Take a look on this . I recommend to use local repo option and also, make sure that repo file is correct and there is no conflict with repo files in other nodes in case there was previous install in the cluster. local repo http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_Installing_HDP_AMB/content/_using_a_local_repository.html fuse-libs-2.8.3-4.0.2.el6.x86_64: failure: getPackage/fuse-libs-2.8.3-4.0.2.el6.x86_64.rpm from ol6_latest:[Errno256]No more mirrors to try.
... View more
05-14-2016
12:45 PM
@Mukthyar Azam Answer to your question: Yes http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_installing_manually_book/content/ch_installing_hue_chapter.html But I do suggest to look into Ambari views.
... View more
05-14-2016
12:41 PM
2 Kudos
@simran kaur See this error org.apache.sqoop.hive.HiveImport-Exceptionin thread "main" java.lang.RuntimeException: org.apache.hadoop.security.AccessControlException:Permission denied: user=yarn, access=WRITE, inode="/user/yarn":hdfs:hdfs:drwxr-xr-x su - hdfs hdfs dfs -chown -R yarn:hdfs /user/yarn
... View more
05-14-2016
12:40 PM
@Radhakrishnan Rk I don't think that you can use cloudbreak to do this in your case . You can look into this https://cwiki.apache.org/confluence/display/AMBARI/Blueprints#Blueprints-AddingHoststoanExistingCluster You can automate the process to scale up and down using API.
... View more