Hi All...   I saw this thread...  http://community.cloudera.com/t5/Batch-Processing-and-Workflow/how-to-share-the-arg-of-the-sqoop-action/m-p/22112/highlight/true#M767   ... and since it is about 3 years old, I wondered if this still applies as the only solution?   Essentially, we have common properties for our workflows...for example the queue (or dynamic resource pool) or a connection string or a password file...just wondering if there is a way via the Oozie UI editor to reference a common property file across all workflows....or to have a way of even just referencing a single common element (like the queue/pool) ?  Or....is the only way via command line?   And...are there any examples of how this can be set up?   thanks...d   ... View more

Hello -   We are trying to import data from Oracle ( 12.1.0.2)  using Sqoop and with SSL enabled.   I have tested without encryption and the sqoop command works and we can import data.   However, I am having troubles figuring out the correct syntax to add the SSL options to the Sqoop command. From what i have read online, it requires (at least) these:  useSSL=true    and  requireSSL=true.   I have tried many variations of adding the options to the sqoop command and none work.  I get an error from Sqoop indicating "invalid connection string format"    Here is the connection string that works: sqoop import -Dmapred.job.queue.name=hi.adhoc --connect jdbc:oracle:thin:@170.173.150.162:1522/phdssts2 --username p378428 -P --table P378428.BAR --target-dir /user/p378428/insights2/ --fields-terminated-by '\t' --delete-target-dir --verbose   Below are four of variants that don't work.   If anyone knows how to add the SSL options to a sqoop command to Oracle...that would be great.   Thanks...   (a) sqoop import -Dmapred.job.queue.name=hi.adhoc --connect jdbc:oracle:thin:@170.173.150.162:1522/phdssts2 --useSSL=true --requireSSL=true --username p378428 -P --table DSS_STAGE.KHS_ZC_ARRIV_MEANS --target-dir /user/p378428/insights-zc-khs_SSL_1/ --fields-terminated-by '\t' --delete-target-dir --verbose (b) sqoop import -Dmapred.job.queue.name=hi.adhoc --connect jdbc:oracle:thin:@170.173.150.162:1522/phdssts2;useSSL=true;requireSSL=true --username p378428 -P --table DSS_STAGE.KHS_ZC_ARRIV_MEANS --target-dir /user/p378428/insights-zc-khs_SSL_1/ --fields-terminated-by '\t' --delete-target-dir --verbose (c) sqoop import -Dmapred.job.queue.name=hi.adhoc --connect jdbc:oracle:thin:@170.173.150.162:1522/phdssts2&useSSL=true&requireSSL=true --username p378428 -P --table DSS_STAGE.KHS_ZC_ARRIV_MEANS --target-dir /user/p378428/insights-zc-khs_SSL_1/ --fields-terminated-by '\t' --delete-target-dir --verbose (d) sqoop import -Dmapred.job.queue.name=hi.adhoc --connect "jdbc:oracle:thin:@170.173.150.162:1522/phdssts2;useSSL=true;requireSSL=true" --username p378428 -P --table DSS_STAGE.KHS_ZC_ARRIV_MEANS --target-dir /user/p378428/insights-zc-khs_SSL_1/ --fields-terminated-by '\t' --delete-target-dir --verbose     ... View more

Hello -   Per the two links below, seems that to execute Impala jobs in Oozie, the user needs to provide his keytab.    a)  https://community.cloudera.com/t5/Interactive-Short-cycle-SQL/How-to-Schedule-Impala-Jobs-with-Oozie/ta-p/31277    b)  https://community.cloudera.com/t5/Interactive-Short-cycle-SQL/Impala-schedule-with-oozie-tutorial/td-p/23906   Where can the users find (or generate) their keytabs?     thanks   w ... View more

Hello - Just wondering how to enable SASL encryption for JDBC (connecting to Oracle).   Our cluster (CDH 7.7.2) has Kerberos and TLS/SSL encryption.   Thanks  ... ... View more

Hello -   I realized I set up a couple of hosts with the data node role, but they do not need to have that role.  I have three other hosts with data node role.   How can I remove the role?  I do not see any way to simply remove the role.   thanks    ... View more

Hello - We recently and installed HAProxy for a load balancer for Impala.  We have 5 worker/data nodes that have the impala daemon running.   After four days....when I look at the workload summary, i can only see 4 coordinators/nodes that have any queries. There is one 1 node that doesn't appear to be serving/accepting queries...but the health on the node/role is good.   Also, there doesn't seem to be an even distribution of queries on the other nodes.  One has run over 50%, one 30% and then the other two about 10% each.   Is there any way for us to identify the issues:    1.  Why doesn't the fifth node run/accept queries    2.  why are the distributions so far off???     thanks.. ... View more

 Hello - We noticed an on-going issue at times, where Impala queries will be receive this type of message:      Query Status: Couldn't open transport for <hostname>:22000 (SSL_connect: Connection reset by peer)   We are running CDH 5.7.3 and Impalad verison is 2.5.0.   When we see this, i can look at the webui for the impalad host and I usually see a query that in the "CREATED" state, but is not running...and typically these queries are from days before.     I also notice that the Last Event will indicate something like "Ready to start 47 remote fragments".  I try to cancel (esp if the query is 2 or 3 days old) and i cannot cancel it and get this message: Error: Query not yet running   Seems the only way to clear the query is to reset the Impalad node.  That seems like bad way to resolve this issue.   Has anyone faced this issue before and have any thoughts/suggestions?   thanks... ... View more

Hello  -   Currently, when we add a new AD Group (via LDAP Sync) we have to manually add the permissions to the group by click...click...click..click....and then save.  When we have lots of groups to add, this can be a painfully slow process.    Does anyone know if there is a way to run a statement in Beeline (sort of like a GRANT statement) that we could use  to add permissions to an AD Group?   thanks.. ... View more

Hello -   I am trying to find out if the Spark Thrift Server is available in CDH 5.7.2.  And, if it is, how can i enable it?   thanks  ... View more

Hello  in our environment, we have some existing AD Groups that have a space in the name, like "My Company Group One".  We can import these into HUE via LDAP Sync and we do get all of the users.   However, adding this AD group to the Linux OS is proving nearly impossible.  I've tried using various escape characters, quoting it,etc....and just can't get it to add to Linux.    Just wondering how other folks might be handling this issue?  Does Cloudera even support having AD Group names with a space?   thanks... ... View more

Hello - We need to restrict access to running sqoop at the command line in hdfs.     My thought on this was that I would probably have to manage this at the Linux OS layer.  1. Create a group (sqoop-users) in linux 2.  Add users to that group 3.  use ACLs (via setfacl) to add the new group (sqoop-users) to /usr/bin/sqoop with r-x permissions. 4.  then change permissions via chmod to remove "other" access completely (so chmod 750).   Just wondering if anyone has thoughts or suggestions...and if that is the way to go.   thanks... ... View more