Cloudera Community
abajwa
user rank
user rank
Guru

Re: How to Make Kylin work with HDP 2.3

by Expert Contributor in Support Questions
‎02-23-2016 05:10 PM
‎02-23-2016 05:10 PM
@xingxing di @bhagan @Neeraj Sabharwal can you guys please post step by steps to start Kylin on HDP 2.3.2 and pre-requisites for the same? Thanks in advance ... View more

Re: Sample HDF/NiFi flow to Push Tweets into Solr/...

by New Member in Community Articles
‎02-15-2017 11:11 AM
‎02-15-2017 11:11 AM
Thank you @Ali Bajwa for good tutoral. I am trying this example with a difference, My nifi is local and I try to put tweets in a remote Solr. Solr is in a VM that contains Hortonworks sandbox. Unfortunately I am getting this error on PutSolrContentStream processor: PutSolrContentStream[id=f6327477-fb7d-4af0-ec32-afcdb184e545] Failed to send StandardFlowFileRecord[uuid=9bc39142-c02c-4fa2-a911-9a9572e885d0,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1487148463852-14, container=default, section=14], offset=696096, length=2589],offset=0,name=103056151325300.json,size=2589] to Solr due to org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://172.17.0.2:8983/solr/tweets_shard1_replica1; routing to connection_failure: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://172.17.0.2:8983/solr/tweets_shard1_replica1; Could you help me? thanks, Shanghoosh ... View more

Re: Installing ElasticSearch on HDP

by Guru in Support Questions
‎10-12-2015 03:57 PM
‎10-12-2015 03:57 PM
Perfect, looking forward to it! ... View more

Re: Hbase indexing to Solr with HDP Search

by New Member in Community Articles
‎07-28-2017 01:11 PM
‎07-28-2017 01:11 PM
Hi, I am using HDP-2.6.0.3, Installed HBASE and SOLR using ambari. My hbase region servers are crashing the moment I add mentioned configurations in Ambari > HBase > Configs > Custom hbase-site I have proceeded without the configurations but it is not indexing the data. Please advise. Thanks. ... View more

Re: Index Documents using HDPSearch in HDP 2.3

by Guru in Community Articles
‎04-20-2016 06:01 AM
‎04-20-2016 06:01 AM
2181 is the Zookeeper port, make sure your Zookeeper ensemble is running and accessible. You might want to create a new question and describe your setup a bit more, it is probably easier to solve this problem then 🙂 ... View more

Configuring HDP Security with Active Directory/IPA

by Guru Guru in Community Articles
‎10-08-2015 06:35 PM
18 Kudos
‎10-08-2015 06:35 PM
18 Kudos
There have been a number of questions recently on using AD/IPA with HDP 2.3 security: How to setup Active Directory/IPA? How to setup cluster OS to recognize users from AD using SSSD? How to enable kerberos for authentication? How to install Ranger for authorization/audit and setup plugins for HDFS, Hive, HBase, Kafka, Storm, Yarn, Knox and test these components on kerborized cluster? How to sync Ranger user/group sync with AD/IPA? How to integrate Knox with AD/IPA? How to setup encryption at rest with Ranger KMS? To help answer some of these questions, the partner team have prepared cheatsheets on security workshops. These are living materials with sample code snippets which are being updated/enhanced per the feedback from the field so rather than replicate the materials here, the latest materials can be referenced at the GitHub repo linked from here: https://community.hortonworks.com/repos/4465/workshops-on-how-to-setup-security-on-hadoop-using.html To help get started with security, we have also made available secured sandbox and LDAP VMs after running through above steps. Note that these are unofficial and for the final word on security with HDP, the official docs should be referenced at: http://docs.hortonworks.com. For example: http://docs.hortonworks.com/HDPDocuments/Ambari-2.1.1.0/bk_Ambari_Security_Guide/content/ch_amb_sec_guide.html http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_Ranger_Install_Guide/content/ch_overview_ranger_ambari_install.html http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_Ranger_KMS_Admin_Guide/content/ch_ranger_kms_overview.html For help with the workshop materials please use GitHub issues: https://github.com/abajwa-hw/security-workshops/issues ... View more

Re: CentOS 7 support

by Guru Guru in Support Questions
‎10-04-2015 10:47 PM
‎10-04-2015 10:47 PM
It's supported with HDP 2.3. Link here ... View more

Re: IPA Kerberos not liking my kinit Ticket

by Guru in Support Questions
‎06-17-2016 01:15 PM
‎06-17-2016 01:15 PM
@Philippe Back... From all krb5.conf files on all nodes in the hadoop cluster. ... View more

Re: (hive) How to dynamically set hive.aux.jars.pa...

by New Member in Support Questions
‎03-02-2017 04:46 PM
‎03-02-2017 04:46 PM
Guilherme's solution worked for me on the HDP 2.5 sandbox VM when I used the hive-client directory instead of the hive-server2 directory. Create directory /usr/hdp/current/hive-client/auxlib/ Move jar files to that directory Restart Hive ... View more

Re: On Ambari 2.1.1 (Centos/RHEL 7): removed servi...

by New Member in Support Questions
‎08-13-2016 04:09 PM
‎08-13-2016 04:09 PM
I got the following to work to remove HBASE and NIFI from Ambari: [root@ambari-server ~] # ambari-server stop Using python /usr/bin/python Stopping ambari-server Ambari Server stopped [root@ambari-server ~] # su - postgres - bash -4.1$ psql psql (8.4.20) Type "help" for help. postgres= # \connect ambari psql (8.4.20) You are now connected to database "ambari" . ambari= # DELETE FROM ambari.hostcomponentstate WHERE service_name IN ('HBASE'); DELETE 14 ambari= # DELETE FROM ambari.hostcomponentdesiredstate WHERE service_name IN ('HBASE'); DELETE 14 ambari= # DELETE FROM ambari.servicecomponentdesiredstate WHERE service_name IN ('HBASE'); DELETE 4 ambari= # DELETE FROM ambari.servicedesiredstate WHERE service_name IN ('HBASE'); DELETE 1 ambari= # DELETE FROM ambari.clusterservices WHERE service_name IN ('HBASE'); DELETE 1 ambari= # \q - bash -4.1$ exit logout [root@ambari-server ~] # ambari-server start Using python /usr/bin/python Starting ambari-server Ambari Server running with administrator privileges. Organizing resource files at /var/lib/ambari-server/resources ... Server PID at: /var/run/ambari-server/ambari-server .pid Server out at: /var/log/ambari-server/ambari-server .out Server log at: /var/log/ambari-server/ambari-server .log Waiting for server start.................... Ambari Server 'start' completed successfully. [root@ambari-server ~] # ambari-server stop Using python /usr/bin/python Stopping ambari-server Ambari Server stopped [root@ambari-server ~] # su - postgres - bash -4.1$ psql psql (8.4.20) Type "help" for help. postgres= # \connect ambari psql (8.4.20) You are now connected to database "ambari" . ambari= # DELETE FROM ambari.hostcomponentstate WHERE service_name IN ('NIFI'); DELETE 1 ambari= # DELETE FROM ambari.hostcomponentdesiredstate WHERE service_name IN ('NIFI'); DELETE 1 ambari= # DELETE FROM ambari.servicecomponentdesiredstate WHERE service_name IN ('NIFI'); DELETE 1 ambari= # DELETE FROM ambari.servicedesiredstate WHERE service_name IN ('NIFI'); DELETE 1 ambari= # DELETE FROM ambari.clusterservices WHERE service_name IN ('NIFI'); DELETE 1 ambari= # \q - bash -4.1$ exit logout [root@ambari-server ~] # ambari-server start Using python /usr/bin/python Starting ambari-server Ambari Server running with administrator privileges. Organizing resource files at /var/lib/ambari-server/resources ... Server PID at: /var/run/ambari-server/ambari-server .pid Server out at: /var/log/ambari-server/ambari-server .out Server log at: /var/log/ambari-server/ambari-server .log Waiting for server start.................... Ambari Server 'start' completed successfully. [root@ambari-server ~] # , This worked for me and now HBASE and NIFI no longer show up in Ambari: [root@ambari-server ~]# ambari-server stop Using python /usr/bin/python Stopping ambari-server Ambari Server stopped [root@ambari-server ~]# su - postgres -bash-4.1$ psql psql (8.4.20) Type "help" for help. postgres=# \connect ambari psql (8.4.20) You are now connected to database "ambari". ambari=# DELETE FROM ambari.hostcomponentstate WHERE service_name IN ('HBASE'); DELETE 14 ambari=# DELETE FROM ambari.hostcomponentdesiredstate WHERE service_name IN ('HBASE'); DELETE 14 ambari=# DELETE FROM ambari.servicecomponentdesiredstate WHERE service_name IN ('HBASE'); DELETE 4 ambari=# DELETE FROM ambari.servicedesiredstate WHERE service_name IN ('HBASE'); DELETE 1 ambari=# DELETE FROM ambari.clusterservices WHERE service_name IN ('HBASE'); DELETE 1 ambari=# \q -bash-4.1$ exit logout [root@ambari-server ~]# ambari-server start Using python /usr/bin/python Starting ambari-server Ambari Server running with administrator privileges. Organizing resource files at /var/lib/ambari-server/resources... Server PID at: /var/run/ambari-server/ambari-server.pid Server out at: /var/log/ambari-server/ambari-server.out Server log at: /var/log/ambari-server/ambari-server.log Waiting for server start.................... Ambari Server 'start' completed successfully. [root@ambari-server ~]# ambari-server stop Using python /usr/bin/python Stopping ambari-server Ambari Server stopped [root@ambari-server ~]# su - postgres -bash-4.1$ psql psql (8.4.20) Type "help" for help. postgres=# \connect ambari psql (8.4.20) You are now connected to database "ambari". ambari=# DELETE FROM ambari.hostcomponentstate WHERE service_name IN ('NIFI'); DELETE 1 ambari=# DELETE FROM ambari.hostcomponentdesiredstate WHERE service_name IN ('NIFI'); DELETE 1 ambari=# DELETE FROM ambari.servicecomponentdesiredstate WHERE service_name IN ('NIFI'); DELETE 1 ambari=# DELETE FROM ambari.servicedesiredstate WHERE service_name IN ('NIFI'); DELETE 1 ambari=# DELETE FROM ambari.clusterservices WHERE service_name IN ('NIFI'); DELETE 1 ambari=# \q -bash-4.1$ exit logout [root@ambari-server ~]# ambari-server start Using python /usr/bin/python Starting ambari-server Ambari Server running with administrator privileges. Organizing resource files at /var/lib/ambari-server/resources... Server PID at: /var/run/ambari-server/ambari-server.pid Server out at: /var/log/ambari-server/ambari-server.out Server log at: /var/log/ambari-server/ambari-server.log Waiting for server start.................... Ambari Server 'start' completed successfully. [root@ambari-server ~]# ... View more
Contact Me
Online
Offline
Last Visited
‎11-07-2024 06:35 PM
Community Statistics
Member Since ‎09-17-2015 07:33 PM
Last Visited ‎11-07-2024 06:35 PM
Posts 436
Kudos received 559