Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2826 | 04-27-2020 03:48 AM | |
| 5497 | 04-26-2020 06:18 PM | |
| 4678 | 04-26-2020 06:05 PM | |
| 3709 | 04-13-2020 08:53 PM | |
| 5615 | 03-31-2020 02:10 AM |
06-14-2019
02:36 AM
1 Kudo
@Gulshan Agivetova May be you can use the "InvokeHTTP" --> "ReplaceText" --> "PutFile" processors like following: Here in "ReplaceText" processor can be used something like following to replace Search Value = TAB with COMMA ReplaceText Properties: Search Value =
Replacement Value = ,
Character Set = UTF-8
Maximum Buffer Size = 1 MB
Replacement Strategy = Regex Replace
Evaluation Mode = Line-by-Line And then it should be able to replace the TABs with Comma. The output of the given inout should be something like: RELM,Satieva_microloans,6,3369,2019-06-12,11:42:00,772103971
RELM,Satieva_microloans,6,3369,2019-06-12,11:42:00,772104117
RELM,Satieva_microloans,6,3369,2019-06-12,11:42:00,772101000 .
... View more
06-13-2019
10:00 AM
@Matas Mockus If this answers your query then can you please close this HCC thread by clicking on the "Accept" button on the helpful answer.
... View more
06-13-2019
02:58 AM
@Matas Mockus Do you have any additional query that you have as part of this HCC thread?
... View more
06-13-2019
02:11 AM
@shraddha srivastav Based on the logs now i see that your Zeppelin is listening properly to port 8888 without any issue. have you accessed Zeppelin using browser after "2019-06-13 01:11:27" time ? INFO [2019-06-13 01:11:27,800] ({main} AbstractConnector.java[doStart]:292) - Started ServerConnector@234cd86c{HTTP/1.1,[http/1.1]}{0.0.0.0:8888}
INFO [2019-06-13 01:11:27,801] ({main} Server.java[doStart]:407) - Started @8727ms
INFO [2019-06-13 01:11:27,807] ({main} ZeppelinServer.java[main]:249) - Done, zeppelin server started So if you are still not able to access the Zeppelin UI via browser then it might be some proxy/firewall issue. Can you please try running the following command from two hosts: 1. Run the curl command from host where you are running your browser to access Zeppelin UI: # curl -iv http://$ZEPPELIN_HOSTNAME:8888
2. Now login to Zeppelin host and then try running the same curl call with "localhost" and hostname. # curl -iv http://$ZEPPELIN_HOSTNAME:8888
# curl -iv http://localhost:8888 Please share the *complete* output of both the Calls. Also please check if the "iptables" (firewall) is disabled on your Zeppelin server host or not?
... View more
06-13-2019
12:10 AM
@Michael Klaene Good to know that adding temporary credential store resolved your issue. It will be also wonderful if you can mark this thread answered by clicking the "Accept" button on the helpful answer that way it will be more useful for other hcc users to quickly browser answers.
... View more
06-13-2019
12:05 AM
@shraddha srivastav Yes, if you change the port of your zeppelin to some other port which is free then it should work. Or you will need to stop the other process which is using that port 8090 to avoid port conflict.
... View more
06-12-2019
11:54 PM
@shraddha srivastav The problem seems to be the Port Conflict on port "8090" . (either change the Zeppelin port to something else or find and kill the other process which is using that port) ERROR [2019-06-12 17:24:49,656] ({main} ZeppelinServer.java[main]:246) - Error while running jettyServer
java.io.IOException: Failed to bind to /0.0.0.0:8090
.
Caused by: java.net.BindException: Address already in use
at java.base/sun.nio.ch.Net.bind0(Native Method) . So before restarting Zeppelin please make sure that there is no other process which is using that port 8090. Please check which other process is using that port and kill that. # netstat -tnlpa | grep 8090 . You can also try running the following command to see if oyu are able to bind to that port 8090 using simple netcat command or not? this is just to verify if that port is free to be binded or not? # nc -l 8090 If that port is already in use by some other process then you should see the following kind of error when you run that command: # nc -l 8090
Ncat: bind to :::8090: Address already in use. QUITTING. .
... View more
06-12-2019
12:36 AM
@Michael Klaene In a kerberized cluster you will need to first post your "kdc.admin.credential" to Ambari and then try your other API calls like Example: (Please provide your KDC principal and credentials there. # curl -s -H "X-Requested-By:ambari" --user admin:admin -i -X POST -d '{ "Credential" : { "principal" : "admin/admin", "key" : "admin", "type" : "temporary" } }' http://my-ambari-host:8080/api/v1/clusters/my-cluster/credentials/kdc.admin.credential Then try your API calls: # curl --user admin:admin -i -H "X-Requested-By:ambari" -X PUT -d '{"HostRoles": {"state":"INSTALLED"}}' http://my-ambari-host:8080/api/v1/clusters/my-cluster/hosts/my-host/host_components/ATLAS_CLIENT . The temporary credential store is a keystore in memory where each entry is removed after 90 minutes (from initial creation), when Ambari is restarted, or by user request. The persisted credential store is a keystore stored on disk where each entry is removed only by user request. The option to store a credential in the persisted store is only available if Ambari's credential store has been setup. Please refer to the following HCC Article as well: https://community.hortonworks.com/articles/42927/adding-kdc-administrator-credentials-to-the-ambari.html
... View more
06-11-2019
10:52 AM
@Adil BAKKOURI We see the following message seems to be causing the DataNode startup failure. 2019-06-11 12:30:52,832 WARN common.Storage (DataStorage.java:loadDataStorage(418)) - Failed to add storage directory [DISK]file:/hadoop/hdfs/data
java.io.IOException: Incompatible clusterIDs in /hadoop/hdfs/data: namenode clusterID = CID-bd1a4e24-9ff2-4ab8-928a-f04000e375cc; datanode clusterID = CID-9a605cbd-1b0e-41d3-885e-f0efcbe54851 Looks like your VERSION file has different cluster IDs present in NameNode and DataNode that need to be correct. Please copy the clusterID from nematode "<dfs.namenode.name.dir>/current/VERSION" and put it in the VERSION file of datanode "<dfs.datanode.data.dir>/current/VERSION" and then try again. Also please check the following link: https://community.hortonworks.com/questions/79432/datanode-goes-dows-after-few-secs-of-starting-1.html
... View more
06-11-2019
10:21 AM
@Adil BAKKOURI Based on your Latest Logs it looks like after changing the permissions the NameNode is starting fine without any issue. For the DataNode not starting issue please open a Separate HCC thread and Mark this HCC thread as Answered by clicking on "Accept" link on correct answer.
... View more