I need to update the 2 properties in sqoop, but I am not able do it through sqoop.propeties files as CM will overide it, Its need to be done in the Sqoop Service Environment Safety Valve in CM,
But when I did it in the sqoop2 service, in the advanced configuration,to setup key/value pair for "Sqoop Service Environment Safety Valve", below is the format.
I get the below error,
Could not parse: Sqoop Service Environment Safety Valve : Could not parse parameter 'sqoop_env_safety_valve'. Was expecting: valid variable name. Input: connector.autoupgrade=true
If i just give it like this it works
but I need the whole string. I need help, what is format?
Why do you want to enable auto upgrade? Sqoop has upgrade commands that will do this for you. Auto upgrade may have other side effects that could cause problems down the line.
If you really want to make this change, you need to modify the safety valve for sqoop.properties, not the environment safety valve.
Thanks dlo for reply,
I started doing this because when I start the sqoop service in CM, I get the below error. So some one on the forum suggested that turning to true will help that,
Connector config urls: [jar:file:/hdp2014poc/cloudera/parcels/CDH-4.6.0-1.cdh4.6.0.p0.26/lib/sqoop2/webapps/sqoop/WEB-INF/lib/sqoop-connector-generic-jdbc-1.99.2-cdh4.6.0.jar!/sqoopconnector.properties]
Connector [org.apache.sqoop.connector.jdbc.GenericJdbcConnector] initialized.
Marking transaction for rollback
Attempting transaction roll-back
Server startup failure
Shutting down Sqoop server
When you get that message, it generally means you should run the upgrade command. CM has made this one easy for you, so no need to figure out how to do the upgrade manually.
Click on Sqoop, then in the Actions dropdown menu on the right, you'll see an option to Upgrade Sqoop. If it's greyed out, that's because you need to stop Sqoop first.
I am using CDH 4.6,
I don't see the upgrade in action
these all the choices I have start, stop,restart,rename,enter maintenance mode, create group.
Let me know If I am missing something.
After the CM upgrade from 4.5 to 4.6, I get these errors, I am not able to start the sqoop2 service. So on the forum it is said to manually edit the sqoop.properties files.
I did the following
conf -> /etc/alternatives/sqoop2-conf
/etc/alternatives/sqoop2-conf -> /hdp2014poc/cloudera/parcel-repo/CDH-4.5.0-1.cdh4.5.0.p0.30/etc/sqoop2/conf.dist
even after updating the sqoop.properties, I still get the above error.