Member since
11-07-2016
637
Posts
253
Kudos Received
144
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2720 | 12-06-2018 12:25 PM | |
| 2862 | 11-27-2018 06:00 PM | |
| 2193 | 11-22-2018 03:42 PM | |
| 3567 | 11-20-2018 02:00 PM | |
| 6273 | 11-19-2018 03:24 PM |
11-30-2017
02:09 PM
1 Kudo
@Chaitanya D, Can you try adding these 3 lines in /etc/ambari-server/conf/ambari.properties and try restarting the server db.mysql.jdbc.name=/var/lib/ambari-server/resources/mysql-connector-java.jar
server.jdbc.rca.url=jdbc:mysql://localhost:3306/ambaridatabase
server.jdbc.url=jdbc:mysql://localhost:3306/ambaridatabase 1) Check if server.jdbc.user.name is ambariuser in /etc/ambari-server/conf/ambari.properties. 2) Make sure that this path exists /var/lib/ambari-server/resources/mysql-connector-java.jar. Or change the path if the connector jar name is different. 3) If localhost doesn't work , try changing to 127.0.0.1 in server.jdbc.rca.url and server.jdbc.url Thanks, Aditya
... View more
11-29-2017
08:03 PM
1 Kudo
@Michael Bronson Run this command as is. No need to append headers and password. In above command you were using curl twice. curl http://master02:18081/api/v1/applications | grep "\"id\"" > a.txt
... View more
11-29-2017
07:45 PM
@Michael Bronson, I see that you are using port 8080. For spark history server port is 18080 by default for spark2 history server port is 18081 by default. You can check the port in UI where you saw the applications
... View more
11-29-2017
07:07 PM
1 Kudo
@Michael Bronson, If you want to list all and delete all applications. You can simply do hdfs dfs -rm -R /spark2-history/* This folder will have only spark2 app logs and no other files. Hope this helps (Or) You can do the below. This should print all application IDs curl http://{spark2history server url}:18080/api/v1/applications | grep "\"id\"" > a.txt
cut -d':' -f2 a.txt | cut -d "\"" -f 2
... View more
11-29-2017
06:52 PM
@Michael Bronson You can use files view if you want to delete from GUI. I'm not sure if there is delete option in Spark history server.
... View more
11-29-2017
06:45 PM
hdfs dfs -rm -R /spark2-history/* will remove all applications
... View more
11-29-2017
06:41 PM
1 Kudo
@Michael Bronson, If you want to delete applications in spark2 hdfs dfs -rm -R /spark2-history/{app-id} If you want to delete applications in spark1 hdfs dfs -rm -R /spark-history/{app-id} Restart history servers after running the commands. Thanks, Aditya
... View more
11-29-2017
06:04 PM
1 Kudo
@Chaitanya D, Can you try running this and then start ambari server. chmod 644 /usr/share/java/mysql-connector-java.jar
ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar
ambari-server start Also , did you add the bind address and restart mysql server? This output still shows 127.0.0.1 tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN 1151/mysqld Thanks, Aditya
... View more
11-29-2017
05:07 PM
1 Kudo
@Chaitanya D, I guess you are trying to login to the same machine since you have 127.0.0.1 mapped to chaitu and you are trying to run 'ssh root@chaitu' To enable password less ssh, follow below steps sudo su --- > to make sure you are as root
[root@chaitu ~]# cat ~/.ssh/id_rsa.pub
[root@chaitu ~]# cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
[root@chaitu ~]# ssh root@chaitu ---> now it should not ask for password
For mysql error, change the bind address in /etc/my.cnf and restart mysql # vi /etc/my.cnf
[mysqld]
bind-address=0.0.0.0 To restart mysql run below command systemctl restart mysqld Now try to start ambari server ambari-server start Thanks, Aditya
... View more
11-29-2017
08:51 AM
4 Kudos
This article describes to store your zeppelin notes in a GitHub repo. 1) Create a GitHub repo where you want to store your zeppelin notes. I have created a repo named 'zeppelin-notes'. Select ssh for cloning. We will be using ssh key to perform git operations. 2) Copy the ssh public key from the node where Zeppelin is installed and add it in git hub. The command displays the public key and screenshot tells how to add the ssh key to github # su zeppelin
# cat ~/.ssh/id_rsa.pub Click on "New SSH Key" , give a title for the key and paste the content and click save. 3) Clone the git repo in the node where zeppelin is installed and set proper permissions to the folder su zeppelin
cd /usr/hdp/current/zeppelin-server/
git clone git@github.com:cvr-aditya/zeppelin-notes.git
chown zeppelin:zeppelin zeppelin-notes
chmod -R 777 zeppelin-notes 4) Change the zeppelin notebook directory path. Go to Ambari -> Zeppelin -> Configs -> Advanced zeppelin-config and set the value for zeppelin.notebook.dir to the git hub repo name (ie zeppelin-notes) 5) Change the storage for zeppelin. Go to Ambari -> Zeppelin -> Configs -> Advanced zeppelin-config and set the value for zeppelin.notebook.storage to org.apache.zeppelin.notebook.repo.GitNotebookRepo. Perform steps 4 and 5 and restart Zeppelin 6) Login to zeppelin and create a new Notebook. I named it 'FirstNote'. 7) After making some changes now you may want to commit the note. Click on the icon shown in the screenshot below and write your commit message and click Commit. 😎 Check if your commit was successful. cd /usr/hdp/current/zeppelin-server/zeppelin-notes
git log 9) You can check the state of the notebook at a particular commit by setting the revision to the particular commit. Check the screenshot. 10) You can push your commits to the repo by running the following commands cd /usr/hdp/current/zeppelin-server/zeppelin-notes
git push origin {branch-name}
Hope this helps 🙂 Refernce : https://help.github.com/articles/adding-a-new-ssh-key-to-your-github-account/ Thanks, Aditya
... View more
Labels: