Member since
11-26-2015
20
Posts
3
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2863 | 09-30-2016 01:34 AM |
11-28-2017
09:04 AM
Hello, I haven't done anything on this topic. My idea is to fix the code of the sqoop but I need one or two days to do it...
... View more
11-08-2016
12:10 AM
Hi @eriks, I am busy this week but I think I can try to build a fix next week. Johann
... View more
10-13-2016
06:42 AM
Hi csguna, this is not the point, there is an option for changing/forcing type which is being ignored in the case of importing a table from postgresql to Hive in parquet format.
... View more
10-13-2016
04:43 AM
Hello, in PostgreSQL, I have my datetime stored as TIMESTAMP without TIME ZONE. I have tried with other variables types, the option is not working when doing an import to create a hive table in parquet format.
... View more
09-30-2016
01:34 AM
1 Kudo
Sqoop Probelm solved: From CM -> Sqoop -> Actions -> upgrade Sqoop
... View more
09-30-2016
01:28 AM
Ciao, I have performed an upgrade of my cluster using the upgrade feature from Cloudera manager (from 5.8.0 to 5.8.2). I have got 2 issues: Oozie: Test of whether the correct Oozie Server shared library is installed. Bad : The Oozie Server build version(4.1.0-cdh5.8.2) and the Oozie Server shared library version(4.1.0-cdh5.8.0) do not match. Sqoop 2 Error: 2016-09-29 16:34:31,692 INFO org.apache.sqoop.repository.JdbcRepositoryTransaction: Attempting transaction roll-back 2016-09-29 16:34:31,693 ERROR org.apache.sqoop.core.SqoopServer: Server startup failure org.apache.sqoop.common.SqoopException: CONN_0007:Connector registration failed at org.apache.sqoop.connector.ConnectorManager.registerConnectors(ConnectorManager.java:229) at org.apache.sqoop.connector.ConnectorManager.initialize(ConnectorManager.java:186) at org.apache.sqoop.connector.ConnectorManager.initialize(ConnectorManager.java:155) at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:57) at org.apache.sqoop.server.ServerInitializer.contextInitialized(ServerInitializer.java:41) at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210) at org.apache.catalina.core.StandardContext.start(StandardContext.java:4709) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:802) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:583) at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:944) at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:779) at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:505) at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1322) at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:325) at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142) at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1068) at org.apache.catalina.core.StandardHost.start(StandardHost.java:822) at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1060) at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463) at org.apache.catalina.core.StandardService.start(StandardService.java:525) at org.apache.catalina.core.StandardServer.start(StandardServer.java:759) at org.apache.catalina.startup.Catalina.start(Catalina.java:595) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) Caused by: org.apache.sqoop.common.SqoopException: JDBCREPO_0026:Upgrade required but not allowed - Connector: kite-connector at org.apache.sqoop.repository.JdbcRepository$3.doIt(JdbcRepository.java:174) at org.apache.sqoop.repository.JdbcRepository.doWithConnection(JdbcRepository.java:92) at org.apache.sqoop.repository.JdbcRepository.doWithConnection(JdbcRepository.java:63) at org.apache.sqoop.repository.JdbcRepository.registerConnector(JdbcRepository.java:158) at org.apache.sqoop.connector.ConnectorManager.registerConnectors(ConnectorManager.java:212) ... 28 more 2016-09-29 16:34:31,695 ERROR org.apache.sqoop.server.ServerInitializer: Sqoop server failed to start Any feedback is welcome. Johann
... View more
Labels:
- Labels:
-
Apache Oozie
-
Apache Sqoop
-
Cloudera Manager
09-21-2016
05:25 AM
Hello guys, I am using Scoop to transfer data from postgresql to hive usaing storage parquet. I have a problem with the postgresql format "timestamp without time zone" which is mapped to BIGINT and becomes unsable for queriing. I found the import option: --map-column-hive varname=type. I have tried with the type:STRING and TIMESTAMP, both are ignored and I do not get any message about it. Version used: SQOOP 1.4.6, Postgresql 9.4, CDH 5.8. any idea is welcome.
... View more
Labels:
09-01-2016
05:45 AM
Thanks for the feedback, the point is that after the configuration of the cluster performed by Cloudera Director there was no time synchonization setup. Cheers Johann
... View more
08-31-2016
06:01 AM
hello, I have installed a cluster on EC2 (centos 7), CDH: 5.8, Services: HDFS, Hive, Hue, Impala, Oozie, Sqoop 2, YARN, ZooKeeper. ntpd was not started on the cluster nodes, in order to fix it I started and registered it as service. Is it on purpose? This means I should have my images with ntpd already registered as service or are you planning to add this in the CDH installation scripts? Johann
... View more