Hi, We have KMS keys that are in 128 bit length. Is there any way to change their length from 128 to 256 ?   For new keys, we know that using "hadoop key <keyname> -size 256" will create a key with 256 bit length. But, for existing keys, is there any way to change the length ? ... View more

Hi, We have preemption enabled for all queues in our prod cluster. We need to run a big spark job without preemption enabled. Can someone help me on running a spark job without preemption. ... View more

Hi, We have Oozie SSH action that is taking longer time. We have HA enabled for oozie. The ssh commands are getting completed in 2 minutes. However, the actions is getting updated after 10 minutes. Below is one of the sample logs. 2019-05-09 23:28:12,454 INFO WorkflowNotificationXCommand:520 - SERVER[manag002] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0022791-190411111121510-oozie-oozi-W] ACTION[0022791-190411111121510-oozie-oozi-W@pull] No Notification URL is defined. Therefore nothing to notify for job 0022791-190411111121510-oozie-oozi-W@pull 2019-05-09 23:28:17,055 WARN ActionStartXCommand:523 - SERVER[manag004] USER[svc-prod] GROUP[-] TOKEN[-] APP[myapp] JOB[0022791-190411111121510-oozie-oozi-W] ACTION[0022791-190411111121510-oozie-oozi-W@pull] E0816: Action pending=[true], status=[RUNNING]. Skipping ActionStart Execution, Error Code: E0816 2019-05-09 23:39:23,203 INFO ActionStartXCommand:520 - SERVER[manag004] USER[svc-prod] GROUP[-] TOKEN[-] APP[myapp] JOB[0022791-190411111121510-oozie-oozi-W] ACTION[0022791-190411111121510-oozie-oozi-W@orc_build] Start action [0022791-190411111121510-oozie-oozi-W@orc_build] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] Please help us asap. ... View more

Hi, Today our active NN went down due to thread deadlock's issue. This is the sample from the thread dump. All the IPC server handlers for both 8020 and 8040 were hung due to the below issue. Could you please explain about the lock issue. org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2347) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAs(Subject.java:422) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2347) Thread 372 (IPC Server handler 83 on 8040): State: WAITING Blocked count: 20620 Waited count: 2798944 Waiting on java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@4391b320 Stack: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967) ... View more

Hi, We need to create data flow between two kafka clusters (cluster1 and cluster2). We are using Nifi sitting at cluster1 to send the messages from cluster1 kafka to cluster2 kafka. Here we wanted to use the external load balancer in front of cluster2 Kafka. However, it is not working properly. The Nifi is unable to send the data to cluster2 kafka if we use LB url in the kafka brokers section. If we put the actual kafka brokers, it is working properly. Can any one help me on this asap. ... View more