Member since
02-27-2020
4
Posts
0
Kudos Received
0
Solutions
03-03-2020
10:22 AM
Thanks @ask_bill_brooks for your message. I'm starting to "watch" at this issue in JIRA now...I hope it will be fixed soon.
... View more
02-28-2020
10:06 AM
Hello,
We've recently migrated CDH from 5.16.2 to 6.3.3 and we now have the following message when we create a table using Impala JDBC driver (we are using the latest version 2.6.15.1017).
errorMessage:ImpalaRuntimeException: Error creating Kudu table 'impala::pdo.discoveries' CAUSED BY: IllegalArgumentException: table owner must not be null or empty
When the same "create table" statement is executed in impala-shell, it works perfectly well.
The search for this error message in google did not find much result.
Any idea about the root cause ?
... View more
Labels:
- Labels:
-
Apache Impala
-
Apache Kudu
02-27-2020
01:56 AM
Probably one workaround would be to modify our code as explained here: https://medium.com/@harshalparekh20696/modifying-org-json-to-handle-duplicate-keys-975bfffe2f5a But it would really be better to fix the problem at YARN API level
... View more
02-27-2020
01:35 AM
Hello,
We are retrieving the state of a Spark application in yarn using the Cluster Application API (http://rm-http-address:port/ws/v1/cluster/apps/{appid})
Since I've migrated CDH from 5.16.2 to 6.3.3, the response returned by this API looks invalid as it contains a duplicate key "entry" under the "resourceSecondsMap" as shown below.
{ "app":{ "id":"application_1582735008785_0001", "user":"ossa", "name":"Labeling 2.0.0.0SNAPSHOT", "queue":"root.inta-pdo.labeling", "state":"FINISHED", "finalStatus":"SUCCEEDED", "progress":100.0, "trackingUI":"History", "trackingUrl":"http:// myhost :8088/proxy/application_1582735008785_0001/", "diagnostics":"", "clusterId":1582735008785, "applicationType":"SPARK", "applicationTags":"", "priority":0, "startedTime":1582742735767, "launchTime":1582742737578, "finishedTime":1582742815272, "elapsedTime":79505, "amContainerLogs":"http:// myhost :8042/node/containerlogs/container_1582735008785_0001_01_000001/ossa", "amHostHttpAddress":" myhost :8042", "amRPCAddress":" myIP ", "allocatedMB":-1, "allocatedVCores":-1, "reservedMB":-1, "reservedVCores":-1, "runningContainers":-1, "memorySeconds":1908208, "vcoreSeconds":827, "queueUsagePercentage":0.0, "clusterUsagePercentage":0.0, "resourceSecondsMap":{ "entry":{ "key":"memory-mb", "value":"1908208" }, "entry":{ "key":"vcores", "value":"827" } }, "preemptedResourceMB":0, "preemptedResourceVCores":0, "numNonAMContainerPreempted":0, "numAMContainerPreempted":0, "preemptedMemorySeconds":0, "preemptedVcoreSeconds":0, "preemptedResourceSecondsMap":{ }, "logAggregationStatus":"SUCCEEDED", "unmanagedApplication":false, "amNodeLabelExpression":"", "timeouts":{ "timeout":[ { "type":"LIFETIME", "expiryTime":"UNLIMITED", "remainingTimeInSeconds":-1 } ] } } }
As far as I know this kind of structure is considered as invalid with respect to the JSON format and I cannot initialize a java JSONObject with this content (I would receive a
IOException :
Duplicate key "entry" at 992 [character 993 line 1])
Is there any way to workaround this problem ?
... View more
Labels:
- Labels:
-
Apache Spark
-
Apache YARN