Reassignment of a replica across Kafka volumes in a JBOD never completes

Question

This is a partition move from one volume to another in a single broker.  I have started a kafka-reaasign-partitions of a partition from one volume to another but it never completes. Has anyone faced this ? Kafka cluster is in a healthy state Controller is fine source and destination is also fine The replica is not a leader. So far havent seen any errors in logs  The directories look like the below. Here i am moving a partition from sdc to sdf volume. inodes also look fine. desind@xxx:~#> sudo du -sh /kafka/data/sdc/prod-events-4876G /kafka/data/sdc/prod-events-48 desind@xxx:~#> sudo du -sh /kafka/data/sdf/prod-events-48.b82f63b489554ef4b2e2f4c514bc1bc0-future76G /kafka/data/sdf/prod-events-48.b82f63b489554ef4b2e2f4c514bc1bc0-futuredesind@xxx:~#> find /kafka/data -type d -name 'prod-events-48*'/kafka/data/sdf/prod-events-48.b82f63b489554ef4b2e2f4c514bc1bc0-future/kafka/data/sdc/prod-events-48

desind · Accepted Answer

Thats wierd.

So in the log.dirs specify any,any,any and see if that works

Example

{
"partitions": [{
"topic": "foo",
"partition": 1,
"replicas": [1, 2, 3],
"log_dirs": ["any", "any", "any"]
}],
"version": 1
}

This is what documentation says "Broker will cancel existing movement of the replica if "any" is specified as destination log directory."

pdvorak · Answer

Can you please provide the reassign-partitions command and files that you are using to migrate? What version of CDK are you using?-pd

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.