Member since
08-24-2017
32
Posts
7
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1895 | 06-11-2018 11:24 AM | |
1435 | 03-23-2018 03:07 PM | |
1295 | 03-07-2018 10:56 AM | |
1182 | 03-07-2018 10:35 AM | |
1294 | 03-06-2018 01:20 PM |
09-18-2018
08:00 AM
Also, in the log you have "Unable to locate KDC for realm XYZ.COM" make sure that REALM exists and if the mappings are correct inside the file.
... View more
09-18-2018
07:56 AM
Hi @Rohit Sharma, The "krb5.conf" file shouldn't be changed depending on the REALM, you can configure more than one REALM inside. https://web.mit.edu/kerberos/krb5-devel/doc/admin/realm_config.html Check if the keytab is pointing to the correct REALM. Hope it helps! Gonçalo
... View more
08-29-2018
08:24 AM
3 Kudos
Short Description:
Using JOLT transformation to modify a JSON object. Article:
In NIFI, JOLT Transformation can be used to help modifying a JSON object, the below code snippets are an example of how JOLT can be used to shift elements inside a JSON Object, in this case, the intention is to move and repeat "productionID" and "processID" inside of the array.
Original JSON Object:
{
"productionID": "BHS0928MDB8391",
"productionLine": [
{
"model": "Cooper",
"year": 2018,
"type": "Hatchback",
"motorization": "Electric",
"colour": "Midnight Black",
"stageID": "MGOP94810482042"
},
{
"model": "Cooper",
"year": 2018,
"type": "Hatchback",
"motorization": "Diesel",
"colour": "Silver",
"stageID": "MGOP9183740194"
}
],
"processID": "884910421743POR4183UK"
}
Target JSON Object:
{
"productionLine" : [ {
"model" : "Cooper",
"year" : 2018,
"type" : "Hatchback",
"motorization" : "Electric",
"colour" : "Midnight Black",
"stageID" : "MGOP94810482042",
"productionID" : "BHS0928MDB8391",
"processID" : "884910421743POR4183UK"
}, {
"model" : "Cooper",
"year" : 2018,
"type" : "Hatchback",
"motorization" : "Diesel",
"colour" : "Silver",
"stageID" : "MGOP9183740194",
"productionID" : "BHS0928MDB8391",
"processID" : "884910421743POR4183UK"
} ]
}
JOLT transformation code used: [
{
"operation": "shift",
"spec": {
"productionLine": {
"*": {
"@": "[&1]",
"@(2,productionID)": "[&1].productionID",
"@(2,processID)": "[&1].processID"
}
}
}
},
{
"operation": "shift",
"spec": {
"*": {
"@": "productionLine"
}
}
}
]
... View more
Labels:
06-11-2018
11:24 AM
1 Kudo
Hi @Bhagabati Das, RHEL 7.5 is not supported for HDP 2.6.4: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_support-matrices/content/ch01.html However, your error seems to be related to this: https://access.redhat.com/articles/2039753 Gonçalo
... View more
03-23-2018
03:07 PM
Hi @Bramantya Anggriawan, Check if in Ambari UI the Metron repo URL is pointing to the correct version, go to "Admin -> Stack and Versions -> Versions tab -> Manage Versions -> Click your current HDP version". If not, uninstall the mpack and then go to Ambari database and remove the HCP references in the XML tag in the "repo_version" table. Before doing the change perform a backup of the Ambari database. Then install again the HCP mpack. Gonçalo
... View more
03-13-2018
09:16 AM
Hi @Deepu Nagesh, Test if your details are correct via ldapsearch, for example: ldapsearch -h <YOUR AD URL WITHOUT PROTOCOL> -p 389 -x -D 'CN=hdpsrv,OU=service_accounts,DC=mylab,DC=com' -W -b 'OU=ambari_roles,DC=mylab,DC=com' If you connect successfully then keep testing the other parameters that you have set-up in the Ambari AD configuration, to confirm that the Ambari AD configuration was set-up properly accordingly with your AD settings. As the error that the AD is throwing is "52e" meaning that is Invalid AD Credentials. Hope it helps. Gonçalo
... View more
03-07-2018
10:56 AM
Hi @Nicolas Velasquez, Yes, there is. You can access Ambari UI and go to "Admin -> Stack and Versions -> Versions tab -> Manage Versions -> Click your current HDP version", in that page you will be able to update all the repo URL's. The second option would be to uninstall the mpack and then go to Ambari database and remove the HCP references in the XML tag in the "repo_version" table. Before doing the change backup the Ambari database. Then install again the HCP mpack. Gonçalo
... View more
03-07-2018
10:35 AM
Hi
@Vinoth Krish,
To deploy your model to Metron you should use the following:
/<METRON HOME>/bin/maas_deploy.sh -zq <ZOOKEEPER>:2181 -lmp <LOCAL FS MODEL PATH> -hmp <HDFS MODEL PATH> -mo ADD -m <MEMORY FOR THE CONTAINER> -n <MODEL NAME> -v <MODEL VERSION> -ni <NUMBER OF MODEL INSTANCES>
If you are trying first to start MaaS Service you should use:
/<METRON HOME>/bin/maas_service.sh -zq <ZOOKEEPER>:2181
If you don't have at all MaaS components installed try this (Change accordingly with your OS):
yum list metron*
Find the Metron MaaS package and install (Change accordingly with your OS):
yum install <METRON MAAS PACKAGE NAME>
Hope it helps! Gonçalo
... View more
03-06-2018
01:20 PM
1 Kudo
Hi @Bhushan Kandalkar, How to add new nodes in SSL enabled cluster without restarting services of cluster? Via hosts menu in Ambari you can add your new hosts. How new truststores are reflected after adding new node? If you are using host based ssl's then you should add all public certs of each host to the truststore. If you are using wildcard based certs then you just need to create the new truststore with the wildcards in your new hosts. Do we need to manually copy truststore file on all nodes of cluster? You should have the truststore in all hosts so that the hosts can trust each others in the comms. Is there any provision in Ambari by which it will automatically take modified truststore? In each service you usually will find a SSL location path, this path will be your JKS path. If you don't change the JKS name and path then it will be always picked up automatically. Hope it helps! Gonçalo
... View more
02-15-2018
12:24 PM
1 Kudo
Short Description
Storm Service Check fails with a Kerberos error after performing an Ambari upgrade in a cluster that had Metron installed.
Article In a cluster where Metron was removed before upgrading Ambari server, the following error can occur when performing a Service Check in Storm service:
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: The TGT found is not renewable
at org.apache.storm.security.auth.kerberos.AutoTGT.populateCredentials(AutoTGT.java:1)
at org.apache.storm.StormSubmitter.populateCredentials(StormSubmitter.java:3)
at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:748)
at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:590)
at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:239)
at storm.starter.WordCountTopology.main(WordCountTopology.java:492)
Caused by: java.lang.RuntimeException: The TGT found is not renewable
at org.apache.storm.security.auth.kerberos.AutoTGT.populateCredentials(AutoTGT.java:291)
Solution
Go to Ambari -> Storm Service -> Configs -> Custom storm-site and remove the following properties:
topology.auto-credentials=['org.apache.storm.security.auth.kerberos.
AutoTGT']
nimbus.credential.renewers.classes=['org.apache.storm.security.auth.kerberos.AutoTGT']
supervisor.run.worker.as.user=true
... View more
Labels: