Member since
07-18-2016
262
Posts
12
Kudos Received
21
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
6675 | 09-21-2018 03:16 AM | |
3196 | 07-25-2018 05:03 AM | |
4141 | 02-13-2018 02:00 AM | |
1930 | 01-21-2018 02:47 AM | |
37946 | 08-08-2017 10:32 AM |
07-12-2017
05:44 AM
Our Hive Server2 going down for this issue. Have anyone implemented this steps and it working fine. https://community.hortonworks.com/articles/591/using-hive-with-pam-authentication.html
... View more
03-25-2017
03:51 PM
You need to update in /etc/hosts as well. 1) /etc/sysconfig/network :- this used while internode communication 2) /etc/hosts while client connection this is going to use. We need to set FQDN names on both file, this idle way
... View more
04-05-2017
01:46 PM
I'd also post this question on the Ambari track to check why Ambari didn't detect the DataNodes doing down. Also from your logs it is hard to say why the DataNode went down. I again recommend increasing the DataNode heap allocation via Ambari. Also check that your nodes are provisioned with sufficient amount of RAM.
... View more
03-24-2017
10:47 AM
thank you for your immediate reply, is there any other approach are there at Hbase site pleaes recomend.
... View more
03-31-2017
09:08 AM
Thank you for giving the video link . It was very helpful.
... View more
03-23-2017
06:22 PM
2 Kudos
@zkfs, mask_show_last_n udf can be used for the scenario you mentioned. You can run this query from the beeline to get additional details about udf: DESCRIBE FUNCTION extended mask_show_last_n;
+---------------------------------------------------------------------------------------------------------------------------------+--+
| tab_name |
+---------------------------------------------------------------------------------------------------------------------------------+--+
| masks all but last n characters of the value |
| Examples: |
| mask_show_last_n(ccn, 8) |
| mask_show_last_n(ccn, 8, 'x', 'x', 'x') |
| Arguments: |
| mask_show_last_n(value, charCount, upperChar, lowerChar, digitChar, otherChar, numberChar) |
| value - value to mask. Supported types: TINYINT, SMALLINT, INT, BIGINT, STRING, VARCHAR, CHAR |
| charCount - number of characters. Default value: 4 |
| upperChar - character to replace upper-case characters with. Specify -1 to retain original character. Default value: 'X' |
| lowerChar - character to replace lower-case characters with. Specify -1 to retain original character. Default value: 'x' |
| digitChar - character to replace digit characters with. Specify -1 to retain original character. Default value: 'n' |
| otherChar - character to replace all other characters with. Specify -1 to retain original character. Default value: -1 |
| numberChar - character to replace digits in a number with. Valid values: 0-9. Default value: '1' |
| NULL |
+---------------------------------------------------------------------------------------------------------------------------------+--+
Following query returns string with all the characters masked except last 4: select mask_show_last_n('AAbb1234567', 4, 'X', 'X', 'X');
+--------------+--+
| _c0 |
+--------------+--+
| XXXXXXX4567 |
+--------------+--+
1 row selected (0.085 seconds
... View more
11-13-2016
06:33 PM
2 Kudos
@zkfs Assuming you have upgraded to Ambari 2.2.0.0 you could perform Express Upgrade of HDP from 2.1 to 2.3 --> this is a supported path See http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_upgrading_Ambari/content/_upgrading_HDP_perform_express_upgrade.html for more info You could use a local repository for the upgrade. Since upgrade is for HDP, you would need to setup HDP local repo (and not Ambari) for the upgrade. This link has the details: http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_Installing_HDP_AMB/content/_using_a_local_repository.html
... View more
08-22-2016
02:18 PM
@bigdata.neophyte -t option seems to not available in 2.7.1 version which is included with HDP 2.4.2. This option is included in hadoop 2.7.3 which is available with HDP 2.5 Tech preview . [hdfs@hdp1 ~]$ hadoop version
Hadoop 2.7.3.2.5.0.0-1133
Subversion git@github.com:hortonworks/hadoop.git -r 93bf28063ef319be6833d3d6f117d44e0b6b8fa9
Compiled by jenkins on 2016-08-03T11:38Z
Compiled with protoc 2.5.0
From source with checksum 1aed9e48ca6f7cd4ada3a36b1cd5feb
This command was run using /usr/hdp/2.5.0.0-1133/hadoop/hadoop-common-2.7.3.2.5.0.0-1133.jar
[hdfs@hdp1 ~]$ hdfs dfs -ls -t -help
-ls: Illegal option -help
Usage: hadoop fs [generic options] -ls [-C] [-d] [-h] [-q] [-R] [-t] [-S] [-r] [-u] [<path> ...]
[hdfs@hdp1 ~]$ hdp-select versions
2.5.0.0-1133
... View more
08-18-2016
12:11 PM
If small files are there in HDFS storage is it going to occupy the Namenode Heap Memory ? 1) What is work around for total Name Node Memory Heap size usage. 2) Is any other things need to consider, YARN jobs ...etc your concerns are welcome.
... View more
08-22-2016
05:52 AM
Thanks for your reply, Yep i understand the your update, yes i need install the all RPM packages, even if install without using Ambari. I am correcting my question for this and update it
... View more