Member since
01-19-2017
3676
Posts
632
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 609 | 06-04-2025 11:36 PM | |
| 1177 | 03-23-2025 05:23 AM | |
| 584 | 03-17-2025 10:18 AM | |
| 2186 | 03-05-2025 01:34 PM | |
| 1375 | 03-03-2025 01:09 PM |
09-23-2017
11:47 AM
@Pathan Shehbaz Have you enabled the plugins? Lineage will show for tables you created after the Altas setup not before. Have you configured the cross component lineage see doc Can you create a new table "as select" from 2 tables and check whether you can see the lineage in Atlas?
... View more
09-21-2017
10:29 AM
@Ashnee Sharma Notice krb5-auth-dialog is optional Assuming you installed the KDC server yum -y install krb5-server krb5-libs krb5-auth-dialog Assuming you installed the KDC clients yum -y install krb5-auth-dialog krb5-workstation Your /etc/krb5.conf looks like below and copied to all the hosts in the cluster [logging]
default = FILE:/var/log/krb5libs.log
kdc = FILE:/var/log/krb5kdc.log
admin_server = FILE:/var/log/kadmind.log
[libdefaults]
default_realm = EXAMPLE.COM
dns_lookup_realm = false
dns_lookup_kdc = false
ticket_lifetime = 24h
renew_lifetime = 7d
forwardable = true
[realms]
EXAMPLE.COM = {
kdc = kdc.examplecom
admin_server = kdc.examplecom
}
[domain_realm]
.example.com = EXAMPLE.COM
example.com = EXAMPLE.COM Your kdc.conf should resemble this [kdcdefaults]
kdc_ports = 88
kdc_tcp_ports = 88
[realms]
EXAMPLE.COM = {
#master_key_type = aes256-cts
acl_file = /var/kerberos/krb5kdc/kadm5.acl
dict_file = /usr/share/dict/words
admin_keytab = /var/kerberos/krb5kdc/kadm5.keytab
supported_enctypes = aes256-cts:normal aes128-cts:normal des3-hmac-sha1:normal arcfour-hmac:normal des-hmac-sha1:normal des-cbc-md5:normal des-cbc-crc:normal
} You kadm5.acl in /var/kerberos/krb5kdc as below */admin@EAMPLE.COM * Can you create an admin principal as suit # kadmin.local -q "addprinc admin/admin"
Authenticating as principal admin/admin@EXAMPLE.COM with password.
WARNING: no policy specified for admin/admin@EXAMPLE.COM; defaulting to no policy
Enter password for principal "admin/admin@EXAMPLE.COM":
Re-enter password for principal "admin/admin@EXAMPLE.COM":
Principal "admin/admin@EXAMPLE.COM" created. This is the principal you should use for the Ambari Kerberos,make sure you started the appropriate daemons below Centos7/RHEL7 # systemctl start krb5kdc
# systemctl start kadmin Centos6/RHEL6 # systemctl start krb5kdc
# systemctl start kadmin All should be fine please let me know
... View more
09-20-2017
08:35 PM
@Jacqualin jasmin The simple answer is YES for MR This whole depends on the number of nodes in your cluster and the desired setup HA or NOT. Usually, there are Masternodes ,Datanodes and edge node (Clients Only) Masternode (if HA the recommended setup at least 3 nodes) - NAMENODE.
- JOURNALNODE.
- ZKFC.
- NODEMANAGER.
- HBASE_MASTER(Optional).
- HISTORYSERVER.
- APP_TIMELINE_SERVER.
- RESOURCEMANAGER.
- ZOOKEEPER_SERVER.(at least 2 )
- JOURNALNODE.
- MYSQL_SERVER.
- ZKFC.
- HIVE_SERVER.
- HIVE_METASTORE.
- WEBHCAT_SERVER.
- ZOOKEEPER_CLIENT. Datanode (As desired) - JOURNALNODE.
- NODEMANAGER.
- HBASE_REGIONSERVER(if Hbase installed).
- ZOOKEEPER_CLIENT.
- DATANODE Edgenode ( At least one) - YARN_CLIENT.
- ZOOKEEPER_CLIENT.
- RANGER_ADMIN.
- RANGER_USERSYNC.
- METRICS_MONITOR.
- METRICS_COLLECTOR.
- ZEPPELIN_MASTER.
- INFRA_SOLR.
- INFRA_SOLR_CLIENT.
- HBASE_CLIENT.
- HDFS_CLIENT.
- TEZ_CLIENT.
- YARN_CLIENT.
- HIVE_CLIENT.
- MAPREDUCE2_CLIENT In the above setup, some components are optional. See official Hortonworks document
... View more
09-20-2017
07:23 AM
@Pooja Kamle Do you have some error messages in hiveserver2.log?
... View more
09-19-2017
02:30 PM
@PJ Check and ensure the ambari-agent is stopped on the dead datanode.
... View more
09-18-2017
11:19 AM
@Hiren Gala Can you give te screenshot and parameters used? The following are possible causes of this issue: 1. Incorrect port and/or Hive Service defined in connection.
2. Network issues.
3. The Hive server is not started. Please revert
... View more
09-18-2017
07:41 AM
@Hiren Gala The errors suggest that your cluster is probably SSL enables so you would need extra configuration for the ODBC to work .Look at the attached screenshot, of course, you will need the CA, Private key.
... View more
09-17-2017
07:32 AM
@Charles Bradbury It should be frustrating, a simple diagnostic isn't easy just a quick look I saw some incompatibility in 2017-09-1516:58:19,901-StackFeatureVersionInfo:ClusterStack=2.5,ClusterCurrentVersion=None,CommandStack=None,CommandVersion=None->2.5
2017-09-1516:58:19,933-Using hadoop conf dir:/usr/hdp/current/hadoop-client/conf
2017-09-1516:58:19,953- checked_call['rpm -q --queryformat '%{version}-%{release}' hdp-select | sed -e 's/\.el[0-9]//g''] {'stderr': -1}
2017-09-1516:58:19,985- checked_call returned (0,'2.6.0.3-8','') There is a conflict between 2.5 and 2.6.0.3-8 can you validate your hdp.repo in /etc/yum.repo.d/* Make sure you have only the one you intend to install in this case I think 2.6 yum clean all
yum repolist Please revert
... View more