@Zack Riesland You can use ambari REST API to update YARN capacity scheduler queues. An example is given in the following link: https://community.hortonworks.com/questions/33578/api-to-manage-yarn-capacity-queue.html ... View more

@Tech Gig No, they are not created under Zookeeper but Zookeeper is used by Kafka for state management, kafka topics and partitions. For example, consumers mark the offset for the record they have read to know what record they will be reading next. I'd recommend following deck (slide 10) to see how this works: https://www.slideshare.net/rahuldausa/apache-kafka-16727853?next_slideshow=1 and slide 15 of following deck to understand how Zookeeper is used by Kafka: https://www.slideshare.net/rahuldausa/introduction-to-kafka-and-zookeeper ... View more

@Abhijeet Rajput Numeric is preferred which you are already doing. You don't run into case sensitivity issues (your database sorting records in case insensitive way for example). Do you have a column which is unique but not primary key? Even distribution is important because otherwise your sqoop job can be skewed. Number of mappers definitely matter if you have slots available. More mappers, more parallelism, faster job. See the following link if you haven't already: http://stackoverflow.com/questions/37206232/sqoop-import-composite-primary-key-and-textual-primary-key ... View more

@Abhijeet Rajput Sqoop should load data in UTF-8 by default. run the following get db cfg for db_name and see the value for Database_code_set. In your mapred-site.xml, can you please try adding the following for mapreduce.map.java.opts: -Ddb2.jcc.charsetDecoderEncoder=3 ... View more