Member since
04-04-2016
147
Posts
40
Kudos Received
16
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1197 | 07-22-2016 12:37 AM | |
4410 | 07-21-2016 11:48 PM | |
1631 | 07-21-2016 11:28 PM | |
2308 | 07-21-2016 09:53 PM | |
3428 | 07-08-2016 07:56 PM |
07-12-2016
05:54 PM
Hi @Ian Li, If this issue was resolved can you pick the best answer and we can think this as resolved. Thanks, Sujitha
... View more
07-08-2016
07:56 PM
Hi @ghost k, Step1: #Can you edit pg_hba.conf file in /var/lib/pgsql/data # Add the following line as the first line of pg_hba.conf. It allows access to all databases for all users with an encrypted password: host all all 0.0.0.0/0 md5 On postgres end:
su postgres psql \c ambari #list all tables \dt ambari.* select*from ambari.hosts; Step2: Download the jar and curl -L 'http://jdbc.postgresql.org/download/postgresql-9.2-1002.jdbc4.jar'-o postgresql-9.2-1002.jdbc4.jar Step3: sqoop list-tables --connect jdbc:postgresql://127.0.0.1/ambari --username ambari --password bigdata Step4: sqoop ambari hosts table into hdfs: password: bigdata sqoop import --connect jdbc:postgresql://127.0.0.1/ambari --username ambari -P --table hosts --target-dir /user/guest/ambari_hosts_table Hope this helps... Thanks, Sujitha
... View more
07-07-2016
04:13 AM
2 Kudos
Story: From
the documentation I was able to add a service to existing stack definition in
Ambari. Issue: But I
was either not able to stop the service or delete the service just in case. https://cwiki.apache.org/confluence/display/AMBARI/Defining+a+Custom+Stack+and+Services How did I solve the problem?
1.Create and
Add Stack: cd
/var/lib/ambari-server/resources/stacks/HDP/2.4/services
2.Create a directory that contains the service
definition for SAMPLESRV mkdir
/var/lib/ambari-server/resources/stacks/HDP/2.4/services/SAMPLESRV cd
/var/lib/ambari-server/resources/stacks/HDP/2.4/services/SAMPLESRV
3.Create
a metainfo.xml as show in the link above.
4.With
this we have a service name as SAMPLESRV and it contains SAMPLESRV_MASTER,
SAMPLESRV_SLAVE and SAMPLESRV_CLIENT
5.Next we need to
create the command scripts mkdir –p /var/lib/ambari-server/resources/stacks/HDP/2.4/services/SAMPLESRV/package/scriptscd /var/lib/ambari-server/resources/stacks/HDP/2.4/services/SAMPLESRV/package/scripts 6.Browse the scripts
directory and create the .py command scripts:master.py, slave.py and
sample_client.py under : /var/lib/ambari-server/resources/stacks/HDP/2.4/services/SAMPLESRV/package/scripts Master.py
and slave.py here
was the issue: in the documentation
it doesn’t mention about the dummy.pid that needs to be created. Since we have not installed a real service, there is no PID file
created by it. Therefore, we are going to artificially create the PID, remove
the PID and check the process status of the dummy pid.
7.Then restart ambari: ambari-server
restart and add the service to the stack as shown the document. Just don't want to duplicate the process with steps here. Hope this helps....
... View more
Labels:
07-06-2016
09:05 PM
1 Kudo
Hi @Ian Li, I was able to get this to stop and start by adding these lines in the master.py and slave.py I added a dummy PID, Since we have not installed a real service, there is no PID file created by it.Therefore we are going to artificially create the PID,remove the PIDand check the process status of the dummy pid. screen-shot-2016-07-06-at-20304-pm.png screen-shot-2016-07-06-at-20322-pm.png screen-shot-2016-07-06-at-20340-pm.png Hope this helps. Let me know in case of any other issues. Thanks, Sujitha
... View more
07-06-2016
01:23 AM
Hi @Ian Li, I followed the steps from https://cwiki.apache.org/confluence/display/AMBARI/Defining+a+Custom+Stack+and+Services, I was able to launch the service and it shows green . Please find the attached. My assumption is within the documentation I see the steps for applicable for HDP 2.0.6 -> 2.1. Can you try the steps in /var/lib/ambari-server/resources/stacks/HDP/2.4/services new-sample-service.png screenshot1.png Hope that helps. Let me know in case of issues. Thanks, Sujitha
... View more
07-05-2016
09:39 PM
Hi @Saurabh Kumar, Can you please confirm that you can see your Nifi UI at: Step1: http://127.0.0.1:9090/nifi/ or http://sandbox.hortonworks.com:9090/nifi/ If not, please ensure that port forwarding is applied as http://hortonworks.com/hadoop-tutorial/how-to-refine-and-visualize-sentiment-data/ Step2: Can you make sure you created the app and access token, access secret, consumer key and consumer secret keys are all correct. Sep3: In case of installation issue, please follow these steps to add Nifi service. https://community.hortonworks.com/articles/1282/sample-hdfnifi-flow-to-push-tweets-into-solrbanana.html Hope this help. Please let me know in case of issues. Thanks, Sujitha
... View more
07-05-2016
08:01 PM
1 Kudo
Hi @Mukesh Kumar, The below guide explains step by step process to install Nifi, run a simple twitter demo. Hope this helps. https://community.hortonworks.com/articles/1282/sample-hdfnifi-flow-to-push-tweets-into-solrbanana.html Thanks, Sujitha
... View more
07-05-2016
07:03 PM
Hi @ghost k Can you please share the queries you used for importing the tables,creating the tables and also can you share the complete logs from: /var/log/sqoop when you use sqoop list-tables if ran successfully it should show the list of tables in the database server in this case its postgre. Thanks, Sujitha
... View more
07-05-2016
06:32 PM
I echo Bala, this error is occurring due to connectivity issue with remote database. Thanks, Sujitha
... View more
07-01-2016
12:40 AM
Hi @Ravi Mutyala, Thanks for the response. With this I understand that the whole hadoop ecosystem uses UTF-8. Is that correct? Can you confirm. Thanks, Sujitha
... View more