Member since
09-24-2015
144
Posts
72
Kudos Received
8
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1311 | 08-15-2017 08:15 AM | |
6109 | 01-24-2017 06:58 AM | |
1590 | 08-03-2016 06:45 AM | |
2892 | 06-01-2016 10:08 PM | |
2480 | 04-07-2016 10:30 AM |
12-23-2015
12:03 AM
The cheatsheet says "without them having to request kerberos ticket". Does this mean it would need different configuration to work with Kerberoised HiveServer2?
... View more
12-16-2015
10:31 PM
3 Kudos
I'm just curious to know what would be the main cause of corrupted blocks 🙂 As it would always have at least three copies, I thought this would be hard to happen (but happens) If HDFS can't create one copy or detects corruption, wouldn't it try to recover by copying a good one into another DataNode? Or once a file was properly created in HDFS, does it never check if file is corrupted or not until HDFS is restarted?
... View more
Labels:
- Labels:
-
Apache Hadoop
12-16-2015
10:21 PM
Thank you! I will play with it.
... View more
12-16-2015
10:01 AM
1 Kudo
I'm looking at https://hadoop.apache.org/docs/current/hadoop-proj... and I don't find an easy way to copy one folder. Do I have to get the list of the content of the folder and download one by one?
... View more
Labels:
- Labels:
-
Apache Hadoop
12-10-2015
02:42 AM
Thanks! but if i understand this correctly, it does not show NodeManager itself's heap (Xmx), does it?
... View more
12-10-2015
02:38 AM
2GB (i wonder why this system has min char limit which doesn't allow me to just type "2GB")
... View more
12-09-2015
09:54 PM
I asked a question regarding OOM in NodeManager log and it turned out I need to increase the NM's heap size. So that I was wondering if there is any document which advises me how much memory I should assign? I'm hoping something similar to HDFS NameNode heap size ( http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-... ) Or as it would be hard to estimate, I should just try twice higher and see how it goes?
... View more
Labels:
- Labels:
-
Apache YARN
11-26-2015
06:46 AM
1 Kudo
Hive's default value for "hive.exec.reducers.bytes.per.reducer" is 256MB (which used to be 1GB) Looks like this was introduced in AMBARI-8092 and AMBARI-8836. I was wondering if there is any specific reason Ambari sets 64MB? In general, is it good thing to have many reducers?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive
11-25-2015
05:57 AM
3 Kudos
As long as reading http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_Sys_Admin_Guides/content/ref-263ee41f-a0a9-4dea-ad4a-b3c257b8e188.1.html , looks like implying same realm. Even Cloudera mentions Distinct Realms... http://www.cloudera.com/content/www/en-us/documentation/enterprise/latest/topics/cdh_admin_distcp_data_cluster_migrate.html#concept_hcs_srr_sr_unique_1
... View more
Labels:
- Labels:
-
Apache Hadoop