Member since
09-18-2015
3274
Posts
1159
Kudos Received
426
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2126 | 11-01-2016 05:43 PM | |
6448 | 11-01-2016 05:36 PM | |
4115 | 07-01-2016 03:20 PM | |
7053 | 05-25-2016 11:36 AM | |
3423 | 05-24-2016 05:27 PM |
10-21-2015
11:58 PM
@amcbarnett@hortonworks.com
... View more
10-21-2015
04:55 PM
@pbalasundaram@hortonworks.com What version of Hive and HDP are you using?
... View more
10-21-2015
04:33 PM
1 Kudo
@bsaini@hortonworks.com You can enable Ranger HA but for NN , you have to configure it manually
... View more
10-21-2015
04:26 PM
2 Kudos
@Brandon Wilson This may help ...Link
... View more
10-21-2015
01:49 PM
1 Kudo
You would be changing ranger repo to point to active name node after restarts or failover of name nodes No changes in ambari Only ranger repo Please see this screenshot
... View more
10-21-2015
11:29 AM
1 Kudo
Hi @dprichici@hortonworks.com , The solution is in your question. Are you looking for something in particluar? diff --git a/hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh b/hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
index ecab38b..d36b370 100644
--- a/hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
+++ b/hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
@@ -23,6 +23,9 @@
# set JAVA_HOME in this file, so that it is correctly defined on
# remote nodes.
+[ X"$HADOOP_ENV_INITED" = X"true" ] && return
+export HADOOP_ENV_INITED="true"
+
# The java implementation to use.
export JAVA_HOME=${JAVA_HOME}
... View more
10-21-2015
11:27 AM
2 Kudos
@Guilherme Braccialli Please see this Master nodes, what is recommended RAM for master? Prospect asked me to consider that virtualized usually runs on machines with 512GB of RAM and usually they don't allocate more than 64GB virtual hosts. Comment: 256GB is good start - Each master node If you are referring to 512GB in each physical node then 2 VM based on 1 bare metal - Edges nodes - Knox, do we have any sizing for Knox? Comment: It' light weight instance so 64gb is good number (Depends how much traffic coming to the knox gateway) - Database servers, do we have any sizing for dedicated database servers(for metadata: Ambari, Hue, Hive Metastore, Oozie, etc)? Comment: Dedicated instance for DB is a good practice. Memory: 128GB is a good start ( Mysql, Postgres, Oracle) ( in prod, its very important to have HA for DB) CPU - dual 8 core or quad core if possible ( Assuming large cluster)
... View more
10-21-2015
11:17 AM
I have reached out to Kylin Dev team to comment on this.
I am working on setting up Kylin with HDP 2.3.2. Package.sh failed because of unapproved licensees messages in rat.txt
I deleted following and package.sh moved forward.
rm -f /root/kylin/storage/src/main/java/org/apache/kylin/storage/hbase/coprocessor/endpoint/protobuf/II.proto
Unapproved licenses:
rm -f /root/kylin/query/src/test/resources/query/sql_verifyCount/query04.sql.expected
rm -f /root/kylin/query/src/test/resources/query/sql_verifyCount/query07.sql.expected
rm -f /root/kylin/query/src/test/resources/query/sql_verifyCount/query08.sql.expected
rm -f /root/kylin/query/src/test/resources/query/sql_verifyCount/query06.sql.expected
rm -f /root/kylin/query/src/test/resources/query/sql_verifyCount/query05.sql.expected
Issues
<strong>Permission
</strong>[root@nsfed01 bin]# ls -l
total 40
-rw-r--r--. 1 root hadoop 1604 Oct 21 03:46 check-env.sh
-rw-r--r--. 1 root hadoop 1300 Oct 21 03:46 find-hbase-dependency.sh
-rw-r--r--. 1 root hadoop 1785 Oct 21 03:46 find-hive-dependency.sh
-rw-r--r--. 1 root hadoop 1023 Oct 21 03:46 get-properties.sh
-rw-r--r--. 1 root hadoop 1638 Oct 21 03:46 health-check.sh
-rw-r--r--. 1 root hadoop 3881 Oct 21 03:46 kylin.sh
-rwxr-xr-x. 1 root hadoop 2321 Oct 21 03:46 metastore.sh
-rw-r--r--. 1 root hadoop 1395 Oct 21 03:46 performance-monitor.sh
-rw-r--r--. 1 root hadoop 1456 Oct 21 03:46 sample.sh
-rwxr-xr-x. 1 root hadoop 2487 Oct 21 03:46 setenv.sh
[root@nsfed01 bin]#
[root@nsfed01 kylin]# bin/kylin.sh start
KYLIN_HOME is set to /root/kylin/
WARNING: Use "yarn jar" to launch YARN applications.
Logging initialized using configuration in file:/etc/hive/2.3.2.0-2950/0/hive-log4j.properties
Please visit <a href="http://%3Cyour_sandbox_ip%3E:7070/kylin">http://<your_sandbox_ip>:7070/kylin</a> to play with the cubes! (Useranme: ADMIN, Password: KYLIN)
You can check the log at bin/../tomcat/logs/kylin.log
[root@nsfed01 kylin]# bin/kylin.sh: line 62: bin/../tomcat/logs/kylin.log: No such file or directory
mkdir -p tomcat/logs
[root@nsfed01 tomcat]#
[root@nsfed01 logs]# ls
kylin.log
[root@nsfed01 logs]# cat kylin.log
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128M; support was removed in 8.0
Not a valid JAR: /root/kylin/tomcat/bin/bootstrap.jar
[root@nsfed01 logs]#
[root@nsfed01 logs]# ls -l /root/kylin/tomcat/bin/bootstrap.jar
ls: cannot access /root/kylin/tomcat/bin/bootstrap.jar: No such file or directory
[root@nsfed01 logs]#
... View more
10-21-2015
10:44 AM
@amcbarnett@hortonworks.com Did you test that in your environment?
... View more
10-21-2015
10:22 AM
@abjawa@hortonworks.com That helped. I had to delete this files. rm -f /root/kylin/storage/src/main/java/org/apache/kylin/storage/hbase/coprocessor/endpoint/protobuf/II.proto
Unapproved licenses:
rm -f /root/kylin/query/src/test/resources/query/sql_verifyCount/query04.sql.expected
rm -f /root/kylin/query/src/test/resources/query/sql_verifyCount/query07.sql.expected
rm -f /root/kylin/query/src/test/resources/query/sql_verifyCount/query08.sql.expected
rm -f /root/kylin/query/src/test/resources/query/sql_verifyCount/query06.sql.expected
rm -f /root/kylin/query/src/test/resources/query/sql_verifyCount/query05.sql.expected
... View more