Member since
11-07-2016
637
Posts
253
Kudos Received
144
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2720 | 12-06-2018 12:25 PM | |
| 2861 | 11-27-2018 06:00 PM | |
| 2193 | 11-22-2018 03:42 PM | |
| 3567 | 11-20-2018 02:00 PM | |
| 6273 | 11-19-2018 03:24 PM |
11-17-2017
05:00 PM
@Attila Kanto, Can you try running these mysql commands before triggering the blueprint GRANT ALL PRIVILEGES ON *.* TO 'root'@'localhost' WITH GRANT OPTION;
GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' WITH GRANT OPTION;
FLUSH PRIVILEGES; Thanks, Aditya
... View more
11-12-2017
10:07 AM
@Michael Bronson, Yes. You need to add the service -> install the service and start the service. If you do it from Ambari , it will take care of all these after "Configure services" step
... View more
11-12-2017
06:48 AM
1 Kudo
@Karthick Raja, Check this line in your code RatingsBreakdown.py line 12, in mapper_get_ratings (userID, movieID, rating, timestamp ) = line.split('\t') The line should have exactly 4 values else you may get the issue 'ValueError: need more than 2 values to unpack' . Check the input or add a validation if len(line.split('\t')) == 4:
(userID, movieID, rating, timestamp ) = line.split('\t')
... View more
11-12-2017
06:28 AM
1 Kudo
@Michael Bronson, I thought it was only an install. If you want to add a service and install the service, there are series of steps which you need to do. This doc will help you. Currently I do not have configuration for knox which is required in Step 3. https://cwiki.apache.org/confluence/display/AMBARI/Adding+a+New+Service+to+an+Existing+Cluster
... View more
11-10-2017
04:15 PM
1 Kudo
You can follow the below steps to upgrade your Spectrum Scale transparency. 1. Download the latest HDFS Transparency connector (gpfs.hdfs-protocol.rpm) 2. Delete the old rpm from your local repository. There should be only one hdfs-protocol rpm in the RPMs directory. 3. Place the latest rpm downloaded in Step 2 in the directory. 4. Refresh the local repository to pick up the latest rpm. cd <local rpm repository dir>
createrepo . 5. Stop all services from ambari Ambari -> Actions -> Stop All 6. Upgrade transparency Ambari -> Spectrum scale -> Service Actions -> Upgrade Transparency 7. Restart ambari server ambari-server restart 8. Start all services from ambari Ambari -> Actions -> Start All You can check SpectrumScale installation here. Uninstallation here Download Transparency connector from here Hope this helps 🙂
... View more
11-10-2017
01:22 PM
@Michael Bronson Yes. It will startup inspite the volume is bad. If you dont want this to happen you might have to replace your failed volume with a new volume (ie unmount old one and mount new one)
... View more
11-10-2017
01:15 PM
1 Kudo
@Michael Bronson, To get the {stack-version-no} , hit below API curl -k -u {username}:{password} -H "X-Requested-By:ambari" -i -X GET http://{ambari-server}:{port}/api/v1/clusters/{clustername}/stack_versions/
ex: curl -k -u admin:admin -H "X-Requested-By:ambari" -i -X GET http://172.31.192.200:8080/api/v1/clusters/cl1/stack_versions
{
"href" : "http://172.31.192.200:8080/api/v1/clusters/cl1/stack_versions",
"items" : [
{
"href" : "http://172.31.192.200:8080/api/v1/clusters/cl1/stack_versions/1", --> stack version no
"ClusterStackVersions" : {
"cluster_name" : "cl1",
"id" : 1,
"repository_version" : 1,
"stack" : "HDP",
"version" : "2.6"
}
}
]
}
<br> To get {repository-version-no} , hit below API curl -k -u {username}:{password} -H "X-Requested-By:ambari" -i -X GET http://{ambari-server}:{port}/api/v1/clusters/{clustername}/stack_versions/{stack-version-no}
ex: curl -k -u admin:admin -H "X-Requested-By:ambari" -i -X GET http://172.31.192.200:8080/api/v1/clusters/cl1/stack_versions/1
{
"href" : "http://x.x.x.x:8080/api/v1/clusters/cl1/stack_versions/1/",
"ClusterStackVersions" : {
"cluster_name" : "cl1",
"id" : 1,
"repository_version" : 1,
"stack" : "HDP",
"state" : "CURRENT",
"version" : "2.6",
"host_states" : {
"CURRENT" : [
"hbase-migration-repro-4.novalocal",
"hbase-migration-repro-1.novalocal",
"hbase-migration-repro-3.novalocal",
"hbase-migration-repro-2.novalocal"
],
"INIT" : [ ],
"INSTALLED" : [ ],
"INSTALLING" : [ ],
"INSTALL_FAILED" : [ ],
"NOT_REQUIRED" : [ ],
"OUT_OF_SYNC" : [ ]
}
},
"repository_versions" : [
{
"href" : "http://x.x.x.x:8080/api/v1/clusters/hbasetest/stack_versions/1/repository_versions/51", --- > repository version no
"RepositoryVersions" : {
"id" : 51,
"stack_name" : "HDP",
"stack_version" : "2.6"
}
}
]
}
<br> Then you can hit the final API curl -k -u {username}:{password} -H "X-Requested-By:ambari" -i -X GET http://{ambari-server}:{port}/api/v1/clusters/{clustername}/stack_versions/{stack-version-no}/repository_versions/{repository-version-no}
... View more
11-10-2017
01:07 PM
@Michael Bronson, Can you please accept the answer if this helped you. This will be really useful for other community users.
... View more
11-10-2017
01:03 PM
get list of available services : curl -k -u {username}:{password} -H "X-Requested-By:ambari" -i -X GET http://{ambari-server}:{port}/api/v1/clusters/{clustername}/stack_versions/{stack-version-no}/repository_versions/{repository-version-no} Get list of installed services: curl -k -u {username}:{password} -H "X-Requested-By:ambari" -i -X GET http://{ambari-server}:{port}/api/v1/clusters/{clustername}/services To get the {stack-version-no} you can hit below API and see the available stack versions curl -k -u {username}:{password} -H "X-Requested-By:ambari" -i -X GET http://{ambari-server}:{port}/api/v1/clusters/{clustername}/stack_versions/ Similarly to get {repository-version-no}, get {stack-version-no} from above call and hit below url curl -k -u {username}:{password} -H "X-Requested-By:ambari" -i -X GET http://{ambari-server}:{port}/api/v1/clusters/{clustername}/stack_versions/{stack-version-no}/ replace the placeholders with your values
... View more
11-10-2017
12:56 PM
@Michael Bronson, If you set dfs.datanode.failed.volumes.tolerated to 'x', it will allow maximum of 'x' no of volumes to be failed. So HDFS restart should fix it.
... View more