Member since
06-19-2014
26
Posts
4
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
31104 | 10-15-2014 01:10 PM | |
15590 | 08-22-2014 12:46 PM | |
15190 | 08-21-2014 04:36 PM |
10-15-2014
01:10 PM
2 Kudos
I found the solution for the above issue 1) for protocolError we need to use kill -9 to kill the superviser 2) the above mention steps are correct I was making some typo with the ip and hostnames in the config.ini in one of the hosts. Hope that help.... Thanks, Amit
... View more
10-10-2014
09:36 AM
I have a CDH 5.1 cluster with 3 nodes. We installed it using cloudera manager automated installation. It was running perfect until we moved the box to a different network and IP addresses changed. I tried following steps
1. Stopped service, cloudera-scm-server.
2. Stopped service, cloudera-scm-agent
3. Edit the /etc/cloudera-scm-agent/config.ini
4. change the server host to the new ip.
5. restart service, cloudera-scm-agent, cloudera-scm-server.
not working .
Then i followed http://www.cloudera.com/content/cloudera/en/documentation/cloudera-manager/v4-latest/Cloudera-Manager-Administration-Guide/cmag_change_hostnames.html Not helped even after changing the ips in the PostgreSQL directly.
I found following blog : http://www.geovanie.me/changing-ip-of-node-in-cdh-cluster/
Getting following error in the scm-agent log file
ProtocolError: <ProtocolError for 127.0.0.1/RPC2: 401 Unauthorized>
No helped .... Can anyone please help how to change all IP addresses in a cdh 5.1 cluster safely .....
Thanks, Amit
... View more
Labels:
- Labels:
-
Cloudera Manager
08-25-2014
08:19 AM
Thanks a lot Sebastien....
... View more
08-22-2014
12:46 PM
2 Kudos
I fixed the issue... So those who need a solution here are the steps 1) drop the following jars to /var/lib/sqoop/ sqoop-connector-teradata-1.2c5.jar tdgssconfig.jar terajdbc4.jar 2) Go to the /etc/sqoop/conf 3) create a drectory managers.d 4) sudo create a file @ /etc/sqoop/conf/managers.d/ cldra_td_connector.txt 5) Most important : the content of the file will be com.cloudera.connector.teradata.TeradataManagerFactory = /var/lib/sqoop/sqoop-connector-teradata-1.2c5.jar And this will do the sqoop installation. Sorry the documentation is of no use ..... Happy Hadoop-ing Thanks Amit
... View more
08-22-2014
11:38 AM
Hi Sebastian, can you please help me in two points 1) where do put the connector jar file? I placed it in /var/lib/scoop 2) t what should be the content of this file /etc/sqoop/conf/managers.d/cldra_td_connector.tx? i did manager.class.name=/var/lib/sqoop/sqoop-connector-teradata-1.2c5.jar I have been struggeling to get this thig work ... so far no luck Documentation is really bad ... Thanks, Amit
... View more
08-22-2014
08:43 AM
I found the we need to place the jar manually to /var/lib/sqoop/
sqoop-connector-teradata-1.2c5.jar
tdgssconfig.jar
terajdbc4.jar
I put theabove jars /var/lib/sqoop/
is that the correct path?
b) As per suggestion i ran the sqoop command in the command prompt
sqoop import --connect jdbc:teradata://absb.222222.COM/DATABASE=ntl_prd_qmtmptbls --username utechntlrpg --password **232 --table par_MOB_APPS --num-mappers 3 --escaped-by '\\' --fields-terminated-by ',' --lines-terminated-by '\n'
Warning: /opt/cloudera/parcels/CDH-5.1.0-1.cdh5.1.0.p0.53/bin/../lib/sqoop/../accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. 14/08/21 19:45:57 INFO sqoop.Sqoop: Running Sqoop version: 1.4.4-cdh5.1.0 14/08/21 19:45:57 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead. 14/08/21 19:45:57 ERROR tool.BaseSqoopTool: Got error creating database manager: java.io.IOException: No manager for connect string: jdbc:teradata://asas.@@@@.COM/DATABASE=ntl_prd_ at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:185) at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:243) at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:84) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:494) at org.apache.sqoop.Sqoop.run(Sqoop.java:147) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:222) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:231) at org.apache.sqoop.Sqoop.main(Sqoop.java:240)
Can someone pleaselet me know what went wrong??
I followed the exact steps in the documentation for installation of Teradata connector
Thanks for your help
Thanks,
Amit
... View more
Labels:
- Labels:
-
Apache Sqoop
08-21-2014
04:36 PM