Member since
01-25-2016
345
Posts
86
Kudos Received
25
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
5011 | 10-20-2017 06:39 PM | |
3536 | 03-30-2017 06:03 AM | |
2591 | 02-16-2017 04:55 PM | |
16105 | 02-01-2017 04:38 PM | |
1146 | 01-24-2017 08:36 PM |
07-21-2016
07:34 PM
yes, MSCK will create partitions again. it's good practice dropping partitions as well along with files before going to re-load the data. I believe that few older partitions are causing an issue. let me know if it's fix your issue while following above mentioned steps
... View more
07-21-2016
07:05 PM
@suresh krish
Here issue with cache in partitions, Clear your partitions and MSCK to repair the table. dropping partitions: alter table dbschemaname.tableanme DROP partition (source <> ''); Run MSCK for table repair, MSCK REPAIR TABLE <tablename>; run count command. Basically when you run select script, your request directly goes to hdfs file to get the requested information, here request wouldn't run mr job. But when you run count(*) it will trigger mr job to pull requested info.
... View more
07-21-2016
06:10 AM
1 Kudo
@ARUN 1) Identifying directories usage in HDFS Try to run below for each directory to know the usage [root@abc01 ~]# hadoop fs -du -s -h <hdfs location> 50.9 M /abc [root@adc01 ~]# 2) namenode heap size is increasing and is around 80 - 90%. NN heap size increasing because of your cluster is occupying maximum space in HDFS for files & directories. Here is the link for increaseing values based on file size https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_installing_manually_book/content/ref-80953924-1cbf-4655-9953-1e744290a6c3.1.html I hope this will help you.
... View more
07-21-2016
02:21 AM
I think, your linux paths or linux libraries are not supporting. you can also directly download & install tar.gz file instead of going through build.xml. Actually build.xml creates tar.gz file.
... View more
07-21-2016
02:06 AM
1 Kudo
@Heath Yates you also can try tar.gz file from below link if you have an issue with Build.xml https://cran.r-project.org/src/contrib/Archive/RHive/ R CMD INSTALL RHive_2.0-0.10.tar.gz
... View more
07-21-2016
01:53 AM
you can try tar.gz file from below link if you have an issue with Build.xml https://cran.r-project.org/src/contrib/Archive/RHive/ R CMD INSTALL RHive_2.0-0.10.tar.gz
... View more
07-21-2016
01:38 AM
sure..If this is what you wanted, please vote the response and accepted it as a best answer.
... View more
07-21-2016
01:35 AM
Here is the link for RHive https://github.com/nexr/RHive Just FYI..RHive & rhdfs both are same.
... View more
07-21-2016
01:29 AM
I installed RStudio on my production environment and handling Since 2 yrs.
... View more
07-20-2016
10:15 PM
2 Kudos
@Heath Yates
link for RStudio Commercial pro Version: https://www.rstudio.com/products/rstudio/download-commercial/ Pro will work for 45 days without license. Download Server: https://www.rstudio.com/products/rstudio/download-server/ Documentation: https://s3.amazonaws.com/rstudio-server/rstudio-server-pro-0.99.903-admin-guide.pdf URL for connecting Remotely http://<SandBox IP:8787/auth-sign-in
... View more