Member since
02-16-2016
176
Posts
197
Kudos Received
17
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 4467 | 11-18-2016 08:48 PM | |
| 7961 | 08-23-2016 04:13 PM | |
| 2087 | 03-26-2016 12:01 PM | |
| 1953 | 03-15-2016 12:12 AM | |
| 17971 | 03-14-2016 10:54 PM |
03-07-2016
02:34 AM
2 Kudos
@Artem Ervits @Vinti Maheshwari As Artem suggested, you need to check which folder is using space. First, figure out which components are running on this node. Then look at log directory for each component to determine which component is using most disk space. If there are no historical logs, you may need to limit log size.
... View more
03-07-2016
02:22 AM
2 Kudos
@Colton Rodgers Can you try adding hive-site.xml as resource. conf.addResource(new Path("/etc/hive/conf/hive-site.xml"));
... View more
03-04-2016
10:44 PM
2 Kudos
@Kevin Vasko It is in Summary section. Run as End User instead of Hive user.
... View more
03-04-2016
06:21 PM
2 Kudos
@Saurabh Kumar Password is stored in HDFS at location jceks://hdfs/user/<user>/mydb.password.jceks See http://www.ericlin.me/securely-managing-passwords-in-sqoop I have not tried 2, but you should grant read access to this file for other user.
... View more
03-03-2016
08:26 PM
1 Kudo
@mike pal Can you try following statement ? CREATE EXTERNAL TABLE IF NOT EXISTS db.tablename( SOURCE_ID VARCHAR(30) , SOURCE_ID_TYPE VARCHAR(30) , SOURCE_NAME VARCHAR(30) , DEVICE_ID_1 VARCHAR(30) , DEVICE_ID_TYPE_1 VARCHAR(30) , DEVICE_ID_2 VARCHAR(30) , DEVICE_ID_TYPE_2 VARCHAR(30) , EVENT_TYPE VARCHAR(30) , EVENT_NAME VARCHAR(100) , EVENT_IDENTIFIER VARCHAR(30) , OCCURRENCE_TIME TIMESTAMP , DETECTION_TIME TIMESTAMP , REQUEST_ID VARCHAR(256) , TRANSACTION_ID VARCHAR(100) , HOSTNAME VARCHAR(30) , CATEGORY VARCHAR(30) , CHANNEL_LANG_TYPE VARCHAR(30) , ACCESS_ID VARCHAR(30) , ACCESS_TYPE VARCHAR(30) , MULTI_FACTOR_AUTHENTICATION_INDICATOR_1 VARCHAR(30) , INVOLVED_PARTY_ID_1 VARCHAR(30) , CARD_NUMBER_1 VARCHAR(30) , INVOLVED_PARTY_TYPE_1 VARCHAR(30) , CARD_ACCESS_FACILITY_ARRANGEMENT_TYPE_1 VARCHAR(30) , INVOLVED_PARTY_ROLE_TYPE_1 VARCHAR(30) , AUTHENTICATION_TYPE_1 VARCHAR(30) , INVOLVED_PARTY_ACTIVE_DIRECTORY_ID_1 VARCHAR(30) , MULTI_FACTOR_AUTHENTICATION_INDICATOR_2 VARCHAR(30) , INVOLVED_PARTY_ID_2 VARCHAR(30) , CARD_NUMBER_2 VARCHAR(30) , INVOLVED_PARTY_TYPE_2 VARCHAR(30) , CARD_ACCESS_FACILITY_ARRANGEMENT_TYPE_2 VARCHAR(30) , INVOLVED_PARTY_ROLE_TYPE_2 VARCHAR(30) , AUTHENTICATION_TYPE_2 VARCHAR(30) , INVOLVED_PARTY_ACTIVE_DIRECTORY_ID_2 VARCHAR(30) , CARD_NUMBER VARCHAR(30) , CUSTOMER_ID VARCHAR(30) , CUSTOMER_NAME VARCHAR(100) , CREDENTIAL_TYPE VARCHAR(30) , AUTHENTICATION_METHOD_TYPE VARCHAR(30) , AUTHENTICATION_TIMESTAMP TIMESTAMP , ELECTRONIC_DELIVERY_DEVICE_TYPE VARCHAR(30) , ELECTRONIC_DELIVERY_DEVICE_ID VARCHAR(30) , OPERATOR_ID VARCHAR(8) , OPERATOR_NAME VARCHAR(30) , BRANCH_NUMBER VARCHAR(8) , SOURCE_SYSTEM_ID VARCHAR(30) , SOURCE_SYSTEM_CODE VARCHAR(30) , SOURCE_SYSTEM_NAME VARCHAR(60) , RANK_NUMBER VARCHAR(30) ) ROW FORMAT DELIMITED FIELDS TERMINATED BY '|' STORED AS TEXTFILE location 'hdfs:///user/test';
... View more
03-03-2016
07:10 PM
1 Kudo
@mike pal Can you post your complete create table statement ?
... View more
03-03-2016
06:05 PM
1 Kudo
@Sunella Zag Following fields are defaults and will be included in all responses "cluster_name" , "definition_id", "definition_name" , "host_name" , "id" , "service_name" You can include any additional fields using http://ambari_server:8080/api/v1/clusters/appslogs/alerts?Alert/state.in(WARNING,CRITICAL,UNKNOWN)&Alert/maintenance_state=OFF&fields=Alert/state,Alert/text
... View more
03-03-2016
05:34 PM
2 Kudos
Where are thrift definitions file located for HBase and HDFS services in Hortonworks 2.3 distribution ?
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache HBase
03-03-2016
05:10 PM
1 Kudo
@Roberto Sancho You will be able to achieve much better performance by transforming files using simple peocessing in pig/Hive and create ORC Hive tables on transformed data.
... View more
03-03-2016
05:06 PM
2 Kudos
@Michael Dennis Uanang May be this article can help. http://stackoverflow.com/questions/32525077/kafka-console-producer-error-in-hortonworks-hdp-2-3-sandbox
... View more