Member since
09-18-2015
3274
Posts
1159
Kudos Received
426
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2565 | 11-01-2016 05:43 PM | |
| 8495 | 11-01-2016 05:36 PM | |
| 4856 | 07-01-2016 03:20 PM | |
| 8176 | 05-25-2016 11:36 AM | |
| 4321 | 05-24-2016 05:27 PM |
11-26-2015
10:55 AM
3 Kudos
yum install expect*
#!/usr/bin/expect
spawn ambari-server sync-ldap --existing
expect "Enter Ambari Admin login:"
send "admin\r"
expect "Enter Ambari Admin password:"
send "admin\r"
expect eof
... View more
Labels:
11-26-2015
10:33 AM
2 Kudos
@Hajime This makes sense hive.exec.reducers.bytes.per.reducer
Default Value: 1,000,000,000 prior to Hive 0.14.0; 256 MB ( 256,000,000 ) in Hive 0.14.0 and later Added In: Hive 0.2.0; default changed in 0.14.0 with HIVE-7158 (and HIVE-7917) Size per reducer. The default in Hive 0.14.0 and earlier is 1 GB, that is, if the input size is 10 GB then 10 reducers will be used. In Hive 0.14.0 and later the default is 256 MB, that is, if the input size is 1 GB then 4 reducers will be used. Point to note: Calculate hive.exec.reducers.max should be set to a number which is less than the available reduce slots on the cluster. Hive calculate the reducers based on hive.exec.reducers.bytes.per.reducer (default 1GB). Consider setting this high based on the workloads and demand for the reducers on the cluster https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties
... View more
06-29-2017
02:01 PM
the answer was given by Guilherme Braccialli . in your /tmp/<user>/hive.log you would see a message like this 2017-06-28 10:04:43,717 INFO [main]: parse.BaseSemanticAnalyzer (CalcitePlanner.java:canCBOHandleAst(397)) - Not invoking CBO because the statement has too few joins
... View more
08-19-2016
10:25 PM
where and how can I add this parameter? I am having same issues. thanks
... View more
11-23-2015
09:40 PM
@Brad Bukacek J
Blog : https://www.linkedin.com/pulse/yarn-queues-hadoop-neeraj-sabharwal Capacity sheduler view has an option for user mapping format
... View more
01-10-2017
09:41 PM
@Shihab That worked for me. Thanks so much. I also had to delete /system/diskbalancer.id to run it successfully. But for some reason I have to do this for every rebalancer I run.
... View more
11-21-2015
02:39 AM
Thanks @Pardeep.
... View more
06-05-2017
04:24 PM
Do we have a way to generate the DDLs for hive databases ?
... View more
10-19-2016
04:18 PM
@Pardeep It's been a while of the post. I have been facing the same issue after I upgraded my hortonworks sandbox to HDP2.5. I tried the "mv VERSIONS VERSIONS.org" and restarted the hue but didn't work. I get the below when I restart My HUE shows up below when re-started Any help on this is greatly appreciated. Thanks!
... View more
11-24-2015
03:58 PM
also note, Teradata has released their Teradata Connector for Hadoop(TDCH) with HDP2.3 through joint efforts with both engineering teams.
... View more