I have seen people create Kudu connectors for Sqoop, however these are not supported by Cloudera. The main reason is likely that Sqoop is fundamentally designed for writing to HDFS. If you are limited to CDH you could first use sqoop to get the data into your cluster, and then do an extra step to bring it to Kudu. However, since CDF has been released we have now got standard NiFi processors for reading from a database and writing to Kudu. Hence this would be my recommended solution. ... View more

Your job.properties serves future launches and very hand when any of your cluster parameters changes due to upgrades or other issues. It is not meant for launching only but can be used for testing as well if you configure your files appropriately.  ... View more

I think I see the originally issue - to use the schema switch, it need two sets of dashes:   -- --schema   ^^ this is correct ... View more

Thanks Ben. Also, do we have any updates that are announced by Cloudera in terms of CDH upgrade required for Meltdown or Spectre apart from OS patches. Thanks!! ... View more

I have verified that all of the parcels requested in teh cloudera-scm-server.log are contained in the /opt/cloudera/parcel-repos directory on the master/name node host server as are all of teh SLES parcels.     hadoop1:/opt/cloudera/parcel-repo # ls -l total 7392988 -rw-r----- 1 cloudera-scm users 16033068 Aug 1 08:15 ACCUMULO-1.7.2-5.5.0.ACCUMULO5.5.0.p0.8-el7.parcel -rw-r----- 1 cloudera-scm users 41 Aug 1 08:15 ACCUMULO-1.7.2-5.5.0.ACCUMULO5.5.0.p0.8-el7.parcel.sha -rw-r----- 1 cloudera-scm users 794 Aug 1 08:15 ACCUMULO-1.7.2-5.5.0.ACCUMULO5.5.0.p0.8-el7.parcel.torrent -rw-r----- 1 cloudera-scm users 16085305 May 23 12:00 ACCUMULO-1.7.2-5.5.0.ACCUMULO5.5.0.p0.8-sles12.parcel -rw-r----- 1 cloudera-scm users 41 May 23 12:00 ACCUMULO-1.7.2-5.5.0.ACCUMULO5.5.0.p0.8-sles12.parcel.sha -rw-r----- 1 cloudera-scm users 797 May 23 12:00 ACCUMULO-1.7.2-5.5.0.ACCUMULO5.5.0.p0.8-sles12.parcel.torrent -rw-r----- 1 cloudera-scm users 1510291137 Apr 12 12:28 CDH-5.10.1-1.cdh5.10.1.p0.10-sles12.parcel -rw-r----- 1 cloudera-scm users 41 Apr 12 12:28 CDH-5.10.1-1.cdh5.10.1.p0.10-sles12.parcel.sha -rw-r----- 1 cloudera-scm users 57790 Apr 12 12:28 CDH-5.10.1-1.cdh5.10.1.p0.10-sles12.parcel.torrent -rw-r----- 1 cloudera-scm users 1528077457 May 15 18:30 CDH-5.11.0-1.cdh5.11.0.p0.34-sles12.parcel -rw-r----- 1 cloudera-scm users 41 May 15 18:30 CDH-5.11.0-1.cdh5.11.0.p0.34-sles12.parcel.sha -rw-r----- 1 cloudera-scm users 58470 May 15 18:31 CDH-5.11.0-1.cdh5.11.0.p0.34-sles12.parcel.torrent -rw-r----- 1 cloudera-scm users 1592734904 Aug 17 17:43 CDH-5.11.1-1.cdh5.11.1.p0.4-el7.parcel -rw-r----- 1 cloudera-scm users 41 Aug 17 17:43 CDH-5.11.1-1.cdh5.11.1.p0.4-el7.parcel.sha -rw-r----- 1 cloudera-scm users 60926 Aug 17 17:43 CDH-5.11.1-1.cdh5.11.1.p0.4-el7.parcel.torrent -rw-r----- 1 cloudera-scm users 1520750328 Aug 17 18:07 CDH-5.11.1-1.cdh5.11.1.p0.4-sles12.parcel -rw-r----- 1 cloudera-scm users 41 Aug 17 18:07 CDH-5.11.1-1.cdh5.11.1.p0.4-sles12.parcel.sha -rw-r----- 1 cloudera-scm users 58189 Aug 17 18:08 CDH-5.11.1-1.cdh5.11.1.p0.4-sles12.parcel.torrent -rw-r----- 1 cloudera-scm users 68055715 May 15 18:27 KAFKA-2.1.1-1.2.1.1.p0.18-sles12.parcel -rw-r----- 1 cloudera-scm users 41 May 15 18:27 KAFKA-2.1.1-1.2.1.1.p0.18-sles12.parcel.sha -rw-r----- 1 cloudera-scm users 2764 May 15 18:27 KAFKA-2.1.1-1.2.1.1.p0.18-sles12.parcel.torrent -rw-r----- 1 cloudera-scm users 445585375 Apr 20 21:35 KUDU-1.3.0-1.cdh5.11.0.p0.12-sles12.parcel -rw-r----- 1 cloudera-scm users 41 Apr 20 21:35 KUDU-1.3.0-1.cdh5.11.0.p0.12-sles12.parcel.sha -rw-r----- 1 cloudera-scm users 17169 Apr 20 21:35 KUDU-1.3.0-1.cdh5.11.0.p0.12-sles12.parcel.torrent -rw-r----- 1 cloudera-scm users 362683461 Aug 17 17:40 KUDU-1.4.0-1.cdh5.12.0.p0.25-el7.parcel -rw-r----- 1 cloudera-scm users 41 Aug 17 17:40 KUDU-1.4.0-1.cdh5.12.0.p0.25-el7.parcel.sha -rw-r----- 1 cloudera-scm users 14006 Aug 17 17:40 KUDU-1.4.0-1.cdh5.12.0.p0.25-el7.parcel.torrent -rw-r----- 1 cloudera-scm users 509716601 Aug 17 17:41 KUDU-1.4.0-1.cdh5.12.0.p0.25-sles12.parcel -rw-r----- 1 cloudera-scm users 41 Aug 17 17:41 KUDU-1.4.0-1.cdh5.12.0.p0.25-sles12.parcel.sha -rw-r----- 1 cloudera-scm users 19629 Aug 17 17:41 KUDU-1.4.0-1.cdh5.12.0.p0.25-sles12.parcel.torrent ... View more

I'm not sure how the to identify the Kafka broker version easily. I did find the the file kafka_2.10-0.10.1.2.1.0.0-165.jar.asc in the /libs folder where Kafka is installed so I am assuming I am running Kafka 0.10.1. I did get both the ConsumeKafka and ConsumeKafka_0_10 connectors to work. Thanks. Now off to figure out why the PutHiveStreaming doesn't work, but that will be for a different post. ... View more