Member since
02-24-2016
175
Posts
56
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1261 | 06-16-2017 10:40 AM | |
10903 | 05-27-2016 04:06 PM | |
1281 | 03-17-2016 01:29 PM |
05-24-2016
04:17 PM
Guys, We have configured three zookeeper instances for a cluster when the cluster was 8 node cluster. Now it has gone bigger and is 28 nodes, and may go up to 40 shortly. I am a bit confused here, should we add more ZK services or its ok to maintain three. What are the implications of increasing the ZK Servers to 5 or 7 or 9 ? And what are the implications of keeping them to three? Thanks.
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
05-23-2016
08:36 AM
@lgeorge Thanks for the links. And looking through the typo. Yes default ambari port for HS2 is 10000 and when it is Kerberized for http requests it listens on 10001. I started the STS from the command line ./sbin/start-thriftserver.sh --master yarn-client --executor-memory 512m --hiveconf hive.server2.thrift.port=100015
I tried netstat and I do not see any thing on port 100015 .
However, I notice that in the Thrift logs it says : ThriftCLIService started on port 10001.
In the log I see following :
16/05/20 15:36:25 INFO AbstractConnector: Started SelectChannelConnector@0.0.0.0:10001
16/05/20 15:36:25 INFO ThriftCLIService: Started ThriftHttpCLIService in http mode on port 10001 path=/cliservice/* with 5...500 worker threads It says clearly that STS thrift is trying to start on port 10001. I would be pleased if I can keep STS and HS2 on the same machine and different ports. I am confused here, because no where in the STS configuration I see 1001 !!!!
... View more
05-23-2016
08:21 AM
@Jitendra Yadav Did you verify if its a bug? Or any work around.
... View more
05-19-2016
03:38 PM
Sure @Jitendra Yadav
... View more
05-19-2016
01:40 PM
@Jitendra Yadav Thank you. Looks like it to be work around. However, I will comment there :). Thank you very much.
... View more
05-19-2016
01:23 PM
@Jitendra Yadav HDP-2.4.0.0 (2.4.0.0-169)
... View more
05-19-2016
01:10 PM
Folks, I am registering temp table in Spark-shell : using people.registerTempTable("people"). ( Kerberized cluster user xyz). on the shell I see +---------+-----------+
|tableName|isTemporary|
+---------+-----------+
| people| true| And now, I am trying to login with beeline with the same user (xyz) . But when I do show tables, I do not see the people table when I issue, show tables on beeline: Connected to: Spark SQL (version 1.6.0) Driver: Hive JDBC (version 1.2.1000.2.4.0.0-169)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.2.1000.2.4.0.0-169 by Apache Hive
0: jdbc:hive2://STS_SERVER> show tables; +------------+--------------+--+
| tableName | isTemporary |
+------------+--------------+--+ @vshukla, @Timothy Spann, @Jitendra Yadav, @Yuta Imai@Simon Elliston Ball
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Spark
05-19-2016
12:40 PM
@Jitendra Yadav Its only one instance for STS and one for HS2. In the Ambari Configuration : hive.server2.thrift.port has been set to 100015 already.
... View more
05-19-2016
12:31 PM
Do you suggest to use command to start STS ?
./sbin/start-thriftserver.sh --master yarn-client --executor-memory 512m --hiveconf hive.server2.thrift.port=100015
... View more
05-19-2016
12:29 PM
Can you be precise, which property to be changed? I do not want to change for HS2. What I think is : Internally STS uses HS2 and not sure if it inherits port configurations of HS2.
... View more