Member since
02-25-2016
72
Posts
34
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3653 | 07-28-2017 10:51 AM | |
2831 | 05-08-2017 03:11 PM | |
1191 | 04-03-2017 07:38 PM | |
2896 | 03-21-2017 06:56 PM | |
1185 | 02-09-2017 08:28 PM |
06-22-2017
07:32 PM
after adding this setting, am getting the same explain plan. Nothing additional
... View more
06-22-2017
06:33 PM
2 Kudos
Am trying to understand Hive Explain plan. Sample explain plan for my query is as below Vertex dependency in root stage
Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 2 (SIMPLE_EDGE), Map 3 (BROADCAST_EDGE)
Reducer 3 <- Map 4 (SIMPLE_EDGE), Map 5 (BROADCAST_EDGE), Reducer 2 (SIMPLE_EDGE)
Reducer 4 <- Map 6 (SIMPLE_EDGE), Map 7 (BROADCAST_EDGE), Map 8 (BROADCAST_EDGE), Reducer 3 (SIMPLE_EDGE). Can some one help me in understanding what is SIMPLE_EDGE and BROADCAST_EDGE. What should I interpret from BROADCAST_EDGE and SIMPLE_EDGE?
... View more
Labels:
- Labels:
-
Apache Hive
06-14-2017
08:22 PM
1 Kudo
Couldnt Agree More with @Dinesh Chitlangia Same is the case with WHERE clause. If you have alias in WHERE clause we
will facing similarerror. Reason being here clause is evaluated before the select clause, select col1 as c1, col2 as c2 from test_table where c1 = "ABC"; we make it work by re tweaking above query as
select * from (
select col1 as c1, col2 as c2 from test_table
) t1 where c1 = "ABC";
... View more
06-05-2017
06:06 PM
tried creating RDD with collect() and print out using for loop. Was working fine. Was trying out in pyspark though. thank you
... View more
06-04-2017
09:44 PM
1 Kudo
was trying spark scenario, tried to load csv file of data set around 1M records into a RDD. did a split by delimiter, and was checking count() which worked. on the same RDD wanted to check sample data and tried action take(10)which did not work. Was throwing spark socketexception connection reset by peer Your assistance would be of great help
... View more
Labels:
- Labels:
-
Apache Spark
05-08-2017
03:11 PM
1 Kudo
Replace the colon with a
semi-colon in jdbc url and this will work:jdbc:phoenix[:zk_quorum][:zk_port][:zk_hbase_path][:headless_keytab_file:principal] [;autocommit=true]
... View more
04-04-2017
02:30 AM
1 Kudo
was curious to check Zookeeper logs, navigated in /var/log/../zookeeper folder. I see 2 files with xxxx.out and zookeeper-xxxx-xxxx.out files, also can't find any data in it. Can you please let me know where to locate log files for zookeeper and also can you please advise me if zookeeper will have log files created on a daily/hourly basis.
... View more
Labels:
- Labels:
-
Apache Zookeeper
04-03-2017
07:38 PM
Try using CAST, then it should not throw any exception and
should work fine
... View more
04-03-2017
06:47 PM
If you have used CAST then it should not throw any exception and
should work absolutely fine.
... View more
03-28-2017
06:19 PM
I have created new set of User with correct hostname and privileges and it worked, thankyou
... View more