Support Questions

Find answers, ask questions, and share your expertise

How to track application detail which run in beeline which connected to spark-sql?

avatar
Expert Contributor

I connected to spark-sql using beeline, and ran SQL successfully.

[root@insightcluster136 ~]# beeline -u "jdbc:hive2://10.107.217.178:10015" --color=true
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/hdp/2.5.0.0-1245/hive/lib/rapidminer_libs-7.3.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/2.5.0.0-1245/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
Connecting to jdbc:hive2://10.107.217.178:10015
Connected to: Spark SQL (version 1.6.2)
Driver: Hive JDBC (version 1.2.1000.2.5.0.0-1245)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.2.1000.2.5.0.0-1245 by Apache Hive
0: jdbc:hive2://10.107.217.178:10015> select count(*) from humep.te_ft_result1;
+------------+--+
|    _c0     |
+------------+--+
| 552541198  |
+------------+--+
1 row selected (358.873 seconds)
0: jdbc:hive2://10.107.217.178:10015> 

But, It seems can't monitor/track the application details during running or after finished like the SQL in TEZ/HIVE.

No any information in Tez View, YARN RM UI and Spark history server. Why?

1 ACCEPTED SOLUTION

avatar
Expert Contributor

I found there is unfreindly UI slider ....

View solution in original post

1 REPLY 1

avatar
Expert Contributor

I found there is unfreindly UI slider ....