Member since
03-07-2019
158
Posts
53
Kudos Received
33
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
6359 | 03-08-2019 08:46 AM | |
4342 | 10-17-2018 10:25 AM | |
2775 | 10-16-2018 07:46 AM | |
2121 | 10-16-2018 06:57 AM | |
1764 | 10-12-2018 09:55 AM |
08-08-2018
09:19 AM
Are you using MySQL or MariaDB as db for hive? Can you see any error in /var/log/hive/hivemetastore.log? If you see something like this in the metastore log; java.lang.NullPointerException
org.apache.hadoop.hive.metastore.HiveMetaException: Upgrade FAILED! Metastore state would be inconsistent try to source the following manually from sql cli (the metastore log should indicate the from/to versions) and restart the metastore server source /usr/hdp/3.0.0.0-1634/hive/scripts/metastore/upgrade/upgrade-<version you're upgrading from>-to-<version you're upgrading to>.mysql.sql
... View more
08-07-2018
10:26 AM
Hi @Sadique
Manzar
Can you share the version of HPD & Hive you're using? Can you try to disable vectorized execution and run your query again set hive.vectorized.execution.enabled = false;
... View more
08-07-2018
09:14 AM
1 Kudo
Hi @Sadique
Manzar
Is your hive table created using "STORED AS ORC" ? STORED AS ORC is better to use than for example, STORED AS INPUTFORMAT xxx or OUTPUTFORMAT yyy as with those options you are not specifying which SERDE to use which your error complains of. It's likely taking your hive.default.serde now, which probably isn't set right. Let me know if that helps!
... View more
08-03-2018
10:48 AM
Awesome, glad you got it working now and thanks for clarifying how you got it up! 🙂
... View more
08-03-2018
10:33 AM
Thanks for sharing your JSON. It looks good but the error also complains about the required fields. I don't see some fields; realm / kdc_type / kdc_host / admin_server_host etc as you can see on the example in the link I previously sent. Can you try to include those values, and see if that makes any improvement?
... View more
08-03-2018
10:18 AM
There is an example here, near the bottom of the page; https://docs.hortonworks.com/HDPDocuments/Cloudbreak/Cloudbreak-2.4.2/content/security-kerberos/index.html If that doesn't help you, can you share what you've used that is giving you an error?
... View more
08-02-2018
10:07 AM
Did you pre-load the ambari database schema as described here at step 4; https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.2/bk_ambari-administration/content/using_ambari_with_postgresql.html
... View more
08-02-2018
09:39 AM
Hi @Seongmin Park The "NiFi Flow" itself is also a process group, see on the left hand side when you log in, note the Process group ID that belongs to my NiFi Flow. I will also set a var on the NiFi Flow and retrieve it with REST: Setting a random var on it; And getting the variable data of the NiFi Flow over REST: [root@c3175-node4 ~]# curl -i -X GET http://172.25.35.14:9090/nifi-api/process-groups/dadadbcd-0164-1000-16c1-6c50ce94361e/variable-registry
HTTP/1.1 200 OK
Date: Thu, 02 Aug 2018 09:34:52 GMT
Content-Type: application/json
Content-Length: 362
{"processGroupRevision":{"clientId":"f9e30047-0164-1000-e3ba-51b6ec77ae6f","version":3},"variableRegistry":{"variables":[{"variable":{"name":"FlowVarExample","value":"This is a flow variable example : - )","processGroupId":"dadadbcd-0164-1000-16c1-6c50ce94361e","affectedComponents":[]},"canWrite":true}],"processGroupId":"dadadbcd-0164-1000-16c1-6c50ce94361e"}}
... View more
08-01-2018
09:37 AM
That's excellent to hear, glad that it helped. And thank you for confirming that your issue is solved 🙂
... View more
08-01-2018
08:36 AM
1 Kudo
Hi @Seongmin Park Yes, this is possible with the REST API. For example, I made a process group with 1 variable "TestVariable" and content "Hello Seongmin" Now to get this using REST, I run; curl -i -X GET http://172.25.36.20:9090/nifi-api/process-groups/<your group id here>/variable-registry And the output from that rest query HTTP/1.1 200 OK
Date: Wed, 01 Aug 2018 08:33:32 GMT
Content-Type: application/json
Content-Length: 337
{"processGroupRevision":{"clientId":"f49c73f5-0164-1000-48ef-ef1af0585eca","version":4},"variableRegistry":{"variables":[{"variable":{"name":"TestVariable","value":"Hello Seongmin","processGroupId":"f49c4d0a-0164-1000-ffff-ffffb54b15e2","affectedComponents":[]},"canWrite":true}],"processGroupId":"f49c4d0a-0164-1000-ffff-ffffb54b15e2"}}
... View more