Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 06-16-2016 11:05 AM
Hello all!
I`m trying to use sqoop with postgresql connector:
sqoop list-tables --connect jdbc:postgresql://my.server.com:6543/abserver-bigdata --username bigdata --password xxxxx
And it returns me an error:
Warning: /usr/hdp/2.2.8.0-3150/accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. 16/06/16 13:36:24 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5.2.2.8.0-3150 16/06/16 13:36:24 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead. 16/06/16 13:36:25 INFO manager.SqlManager: Using default fetchSize of 1000 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/2.2.8.0-3150/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/2.2.8.0-3150/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/2.2.8.0-3150/hive/lib/hive-jdbc-0.14.0.2.2.8.0-3150-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 16/06/16 13:36:25 ERROR manager.CatalogQueryManager: Failed to list tables org.postgresql.util.PSQLException: ERROR: Unsupported startup parameter: extra_float_digits at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:398) at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:173) at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64) at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:136) at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29) at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21) at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:31) at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24) at org.postgresql.Driver.makeConnection(Driver.java:397) at org.postgresql.Driver.connect(Driver.java:267) at java.sql.DriverManager.getConnection(DriverManager.java:571) at java.sql.DriverManager.getConnection(DriverManager.java:215) at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:877) at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) at org.apache.sqoop.manager.CatalogQueryManager.listTables(CatalogQueryManager.java:102) at org.apache.sqoop.tool.ListTablesTool.run(ListTablesTool.java:49) at org.apache.sqoop.Sqoop.run(Sqoop.java:148) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:184) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:226) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:235) at org.apache.sqoop.Sqoop.main(Sqoop.java:244) 16/06/16 13:36:25 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: org.postgresql.util.PSQLException: ERROR: Unsupported startup parameter: extra_float_digits java.lang.RuntimeException: org.postgresql.util.PSQLException: ERROR: Unsupported startup parameter: extra_float_digits at org.apache.sqoop.manager.CatalogQueryManager.listTables(CatalogQueryManager.java:118) at org.apache.sqoop.tool.ListTablesTool.run(ListTablesTool.java:49) at org.apache.sqoop.Sqoop.run(Sqoop.java:148) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:184) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:226) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:235) at org.apache.sqoop.Sqoop.main(Sqoop.java:244) Caused by: org.postgresql.util.PSQLException: ERROR: Unsupported startup parameter: extra_float_digits at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:398) at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:173) at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64) at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:136) at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29) at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21) at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:31) at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24) at org.postgresql.Driver.makeConnection(Driver.java:397) at org.postgresql.Driver.connect(Driver.java:267) at java.sql.DriverManager.getConnection(DriverManager.java:571) at java.sql.DriverManager.getConnection(DriverManager.java:215) at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:877) at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) at org.apache.sqoop.manager.CatalogQueryManager.listTables(CatalogQueryManager.java:102) ... 7 more
I`m using:
HDP 2.2.8.0-3150
Sqoop 1.4.5.2.2
postgresql-9.4.1208.jre7.jar as jdbc-connector
java 1.7.0_55
Created 06-16-2016 11:53 AM
By chance is the pgBouncer (lightweight connection pooler for PostgreSQL) installed along with yout Postgress Install.
If so set this param ignore_startup_parameters = extra_float_digits in pgbouncer.ini (/etc/pgbouncer/pgbouncer.ini)
http://lists.pgfoundry.org/pipermail/pgbouncer-general/2011-July/000830.html
Created 06-16-2016 11:11 AM
Ca you please try with this connector?
https://jdbc.postgresql.org/download/postgresql-9.1-903.jdbc4.jar
Created 06-16-2016 11:24 AM
I tried all this connectors:
But I had the same error with each of them
Created 06-16-2016 11:41 AM
can you try like this?
sqoop list-tables -Dignore_startup_parameters=extra_float_digits --connect jdbc:postgresql://my.server.com:6543/abserver-bigdata --username bigdata --password xxxxx
Looks like it
Created 06-17-2016 09:32 AM
Thank you for advise, but it does not work too... The same error.
@Dileep Kumar Chiguruvada`s answer resolves this issue.
Created 06-16-2016 11:53 AM
By chance is the pgBouncer (lightweight connection pooler for PostgreSQL) installed along with yout Postgress Install.
If so set this param ignore_startup_parameters = extra_float_digits in pgbouncer.ini (/etc/pgbouncer/pgbouncer.ini)
http://lists.pgfoundry.org/pipermail/pgbouncer-general/2011-July/000830.html
Created 06-17-2016 09:33 AM