About dwill

dwill · ‎12-06-2017

Hi Nitish... Thanks for the update and new info. I will try it out and let you know how things work. One question...you wrote the this will only work wiht Oracle 12g....but there is no Oracle 12g...is there? There is 11g and 12c. We have 12c at our place. thanks..d

dwill · ‎12-05-2017

So...just for everyone interested....this still doesn't work. We set the paramater on the sqoop side, ran the eval command and could see the encyrypted notes. However...while running the sqoop command, we did a packet capture and all of the data/traffic was in plain text, it was not encrypted at all. Hopefully, there is another way?

dwill · ‎12-01-2017

Thanks for the reply and information. We do have Resource Pools set up now...but more by function. However...from what you are saying (and from the few things I have seen), the only way for us to get what we want is to create resource pools per project/customer. I forgot about the Impala stuff....about them not being included. Thanks for mentioning that too. thank you!

dwill · ‎11-30-2017

Hello - We need to be able to report back on cluster usage. I can use the existing reports in CM to figure out the HDFS (or storage) usage for our projects and customers. However, I also need a way to calculate and report on the compute resources used per project or customer/tenant. Does anyone know how to do this? I have heard it is possible, but I have searched and haven't found anything. Thanks for any help or suggestions ...

dwill · ‎10-20-2017

Just wondering....has anyone successfully used Sqoop with SSL to connect to oracle and import data into cloudera cluster / hdfs ?

dwill · ‎10-19-2017

Thanks so much for the help. That worked. I was able to get the backup of the fsimage.

dwill · ‎10-19-2017

Hello - I am trying to run the hdfs dfsadmin -fetchImage command to get a back up of our Namenode. It is failing similar to this thread -> http://community.cloudera.com/t5/CDH-Manual-Installation/Backing-up-Namenode-FSImage/m-p/27268#M727 In that post, there is the suggestion below...about adding users to the dfs.cluster.adminstrators property (see snippet below). We are on CM 5.11 and I am not finding this property. Does anyone know how to set it? Or, do i have to just update some config ini/xml file? Thanks...d === from link === In clusters managed by Cloudera Manager 5.x, the property is set to "hdfs" by default. So if this command is run as the hdfs user on any node on the cluster, the command will succeed. You can try setting dfs.cluster.administrators to the list of users and groups who are allowed to perform this operation and then try again. It will require a restart of the Namenode(s) to take effect. <property> <name>dfs.cluster.administrators</name> <value>user1,user2,user3 group1,group2,group3</value> </property>

dwill · ‎10-19-2017

Thanks for the quick reply. I did find that article, but thought that the SSL options/keywords might be the same. I'll revew the article and let you know if this works. thank you! ...d

dwill · ‎10-19-2017

Hello - We are trying to import data from Oracle (12.1.0.2) using Sqoop and with SSL enabled. I have tested without encryption and the sqoop command works and we can import data. However, I am having troubles figuring out the correct syntax to add the SSL options to the Sqoop command. From what i have read online, it requires (at least) these: useSSL=true and requireSSL=true. I have tried many variations of adding the options to the sqoop command and none work. I get an error from Sqoop indicating "invalid connection string format" Here is the connection string that works: sqoop import -Dmapred.job.queue.name=hi.adhoc --connect jdbc:oracle:thin:@170.173.150.162:1522/phdssts2 --username p378428 -P --table P378428.BAR --target-dir /user/p378428/insights2/ --fields-terminated-by '\t' --delete-target-dir --verbose Below are four of variants that don't work. If anyone knows how to add the SSL options to a sqoop command to Oracle...that would be great. Thanks... (a) sqoop import -Dmapred.job.queue.name=hi.adhoc --connect jdbc:oracle:thin:@170.173.150.162:1522/phdssts2 --useSSL=true --requireSSL=true --username p378428 -P --table DSS_STAGE.KHS_ZC_ARRIV_MEANS --target-dir /user/p378428/insights-zc-khs_SSL_1/ --fields-terminated-by '\t' --delete-target-dir --verbose (b) sqoop import -Dmapred.job.queue.name=hi.adhoc --connect jdbc:oracle:thin:@170.173.150.162:1522/phdssts2;useSSL=true;requireSSL=true --username p378428 -P --table DSS_STAGE.KHS_ZC_ARRIV_MEANS --target-dir /user/p378428/insights-zc-khs_SSL_1/ --fields-terminated-by '\t' --delete-target-dir --verbose (c) sqoop import -Dmapred.job.queue.name=hi.adhoc --connect jdbc:oracle:thin:@170.173.150.162:1522/phdssts2&useSSL=true&requireSSL=true --username p378428 -P --table DSS_STAGE.KHS_ZC_ARRIV_MEANS --target-dir /user/p378428/insights-zc-khs_SSL_1/ --fields-terminated-by '\t' --delete-target-dir --verbose (d) sqoop import -Dmapred.job.queue.name=hi.adhoc --connect "jdbc:oracle:thin:@170.173.150.162:1522/phdssts2;useSSL=true;requireSSL=true" --username p378428 -P --table DSS_STAGE.KHS_ZC_ARRIV_MEANS --target-dir /user/p378428/insights-zc-khs_SSL_1/ --fields-terminated-by '\t' --delete-target-dir --verbose

dwill · ‎07-20-2017

Hello I just need to remove the Data Node role from a node that doesn't need to be a data node. This is in a testing environment. Replication factor = 3 thanks...douglas

Online	Offline
Last Visited	‎01-12-2018 03:04 PM

Member Since	‎07-28-2016 04:57 PM
Last Visited	‎01-12-2018 03:04 PM
Posts	44
Kudos received	1

Cloudera Community

Re: Historical Disk Usage Report - date format in ...

Re: Sqoop from Oracle with SSL

Re: Sqoop from Oracle with SSL

Re: Report on Compute - CPU and Memory - by projec...

Report on Compute - CPU and Memory - by project or...

Re: Sqoop from Oracle with SSL

Re: Namenode backup help

Namenode backup help

Re: Sqoop from Oracle with SSL

Sqoop from Oracle with SSL

Re: How to remove role from host