Member since
09-18-2015
3274
Posts
1159
Kudos Received
426
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2689 | 11-01-2016 05:43 PM | |
| 9115 | 11-01-2016 05:36 PM | |
| 5027 | 07-01-2016 03:20 PM | |
| 8432 | 05-25-2016 11:36 AM | |
| 4603 | 05-24-2016 05:27 PM |
02-21-2016
12:09 PM
1 Kudo
[guest@sandbox dataprocessing]$ find / -name java [guest@sandbox dataprocessing]$ export JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre [guest@sandbox dataprocessing]$ ~/gradle-1.9/bin/gradle clean jar Build file '/home/guest/examples/dataprocessing/build.gradle': line 9 The RepositoryHandler.mavenRepo() method has been deprecated and is scheduled to be removed in Gradle 2.0. Please use the maven() method instead. :clean UP-TO-DATE :compileJava
... View more
02-21-2016
11:59 AM
@Syed Naqvi With the combination of SmartSense...I have use this https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/determine-hdp-memory-config.html But you cannot reply on this completely. 90% of the times, I had to make extra tweaks based on the cluster use case.
... View more
02-21-2016
11:50 AM
@min roh /etc/init.d/network restart then yum repolist Can you try again?
... View more
02-21-2016
11:49 AM
@Revathy Mourouguessane You can ignore this warning WARN hdfs.DFSClient: DFSInputStream has been closed already. There is a jira opened already to address this I am sure you are following this http://hortonworks.com/hadoop-tutorial/cascading-hortonworks-data-platform-2-1/ Check your JAVA_HOME setting. What's is the output of echo $JAVA_HOME?
... View more
02-21-2016
03:36 AM
@Wael Emam FYI The following apporach worked fine Ambari server and data node is on CentoOs 6.7 and added a node running Centos7 ..no issues.
... View more
02-21-2016
02:55 AM
@Revathy Mourouguessane Please see this http://stackoverflow.com/questions/29990236/flag-usehcatalog-not-working See this I was facing the issue in HDP 2.3 and Pig 0.15 . Package name for HCatLoader() class is different in Hortonworks distribution. The following worked for me USING org.apache.hive.hcatalog.pig.HCatLoader() instead of USING org.apache.hcatalog.pig.HCatLoader();
... View more
02-21-2016
02:39 AM
@Wael Emam It may be possible to do it. You would have to be very creative. See this http://image.slidesharecdn.com/ambari-agent-registration-flow-130308115303-phpapp02/95/ambari-agent-registration-flow-7-638.jpg?cb=1365612606
... View more
02-21-2016
02:37 AM
@Wael Emam Def not recommended
... View more
02-21-2016
02:02 AM
@Wael Emam See this https://community.hortonworks.com/questions/4324/hdp-support-for-mix-of-os-releases-within-a-cluste.html
... View more
02-21-2016
12:14 AM
1 Kudo
@Shishir Saxena Ok. I am going to share these numbers based on my experience..No official numbers 5 nodes cluster with 96GB , Dual 8 Core over 10G network from different datacenter 4 billion rows with 30 mappers = 40 mins 86 million rows ~ 12 mins My best suggestion is to run a dummy test and based on that you can estimate the timings.
... View more