We are using NiFi a cluster mode. Each node is running on a 40 core machine. We have configured both NiFi Settings Maximum Timer Driven & Maximum Event Driven Thread Count to 50 each. There are multiple flows which are computation intensive processing both real time continous and batch data.. However, the CPU utilization does not go beyond 20%. What further configurations can help utilize the CPUs and increase the computation power. ... View more

I am trying to use HDP 2.6 Sandbox docker image on MAC OS, however facing issues Mac Os Seira 10.12.6 Docker Info Server/Client Version: 17.06.1-ce Loading the docker image gives the sha mismatch error docker load < HDP_2.6_docker_05_05_2017_15_01_40.tar.gz b1b065555b8a: Loading layer [==================================================>]202.2MB/202.2MB invalid diffID for layer 0: expected "sha256:b1b065555b8aba5ae83d5d59d611a6b0cc470e9c14b7e4bee081398309e474a5", got "sha256:9849a0473ada85896f92a0651dae2a973f746bb474ef2d5c1254bdc664cb8529" Import the docker image works docker import HDP_2.6_docker_05_05_2017_15_01_40.tar.gz sha256:1bada5f859d2da5e14957345a7916c875d792df35275ea8c2bb0a3d78faace02 I tag the image using docker tag 1bada5f859d2 sandbox-hdp:latest However run the docker container using the startup script, gives the path not found error. ./start_sandbox-hdp.sh Waiting for docker daemon to start up:34c7d62da472ce103d5016fab070d3576311687b6c938e118647f4cdd31d3e4c docker: Error response from daemon: oci runtime error: container_linux.go:262: starting container process caused "exec: \"/usr/sbin/sshd\": stat /usr/sbin/sshd: no such file or directory". I face the same issue with HDP 2.5 and 2.6.1 I faced the same issue with HDF load, however HDF import works fine and I am able to run the HDF using the startup script. Any missing steps ? ... View more