Created 06-16-2016 11:05 AM
Hello all!
I`m trying to use sqoop with postgresql connector:
sqoop list-tables --connect jdbc:postgresql://my.server.com:6543/abserver-bigdata --username bigdata --password xxxxx
And it returns me an error:
Warning: /usr/hdp/2.2.8.0-3150/accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. 16/06/16 13:36:24 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5.2.2.8.0-3150 16/06/16 13:36:24 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead. 16/06/16 13:36:25 INFO manager.SqlManager: Using default fetchSize of 1000 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/2.2.8.0-3150/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/2.2.8.0-3150/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/2.2.8.0-3150/hive/lib/hive-jdbc-0.14.0.2.2.8.0-3150-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 16/06/16 13:36:25 ERROR manager.CatalogQueryManager: Failed to list tables org.postgresql.util.PSQLException: ERROR: Unsupported startup parameter: extra_float_digits at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:398) at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:173) at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64) at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:136) at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29) at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21) at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:31) at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24) at org.postgresql.Driver.makeConnection(Driver.java:397) at org.postgresql.Driver.connect(Driver.java:267) at java.sql.DriverManager.getConnection(DriverManager.java:571) at java.sql.DriverManager.getConnection(DriverManager.java:215) at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:877) at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) at org.apache.sqoop.manager.CatalogQueryManager.listTables(CatalogQueryManager.java:102) at org.apache.sqoop.tool.ListTablesTool.run(ListTablesTool.java:49) at org.apache.sqoop.Sqoop.run(Sqoop.java:148) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:184) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:226) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:235) at org.apache.sqoop.Sqoop.main(Sqoop.java:244) 16/06/16 13:36:25 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: org.postgresql.util.PSQLException: ERROR: Unsupported startup parameter: extra_float_digits java.lang.RuntimeException: org.postgresql.util.PSQLException: ERROR: Unsupported startup parameter: extra_float_digits at org.apache.sqoop.manager.CatalogQueryManager.listTables(CatalogQueryManager.java:118) at org.apache.sqoop.tool.ListTablesTool.run(ListTablesTool.java:49) at org.apache.sqoop.Sqoop.run(Sqoop.java:148) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:184) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:226) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:235) at org.apache.sqoop.Sqoop.main(Sqoop.java:244) Caused by: org.postgresql.util.PSQLException: ERROR: Unsupported startup parameter: extra_float_digits at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:398) at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:173) at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64) at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:136) at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29) at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21) at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:31) at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24) at org.postgresql.Driver.makeConnection(Driver.java:397) at org.postgresql.Driver.connect(Driver.java:267) at java.sql.DriverManager.getConnection(DriverManager.java:571) at java.sql.DriverManager.getConnection(DriverManager.java:215) at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:877) at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) at org.apache.sqoop.manager.CatalogQueryManager.listTables(CatalogQueryManager.java:102) ... 7 more
I`m using:
HDP 2.2.8.0-3150
Sqoop 1.4.5.2.2
postgresql-9.4.1208.jre7.jar as jdbc-connector
java 1.7.0_55
Created 06-16-2016 11:53 AM
By chance is the pgBouncer (lightweight connection pooler for PostgreSQL) installed along with yout Postgress Install.
If so set this param ignore_startup_parameters = extra_float_digits in pgbouncer.ini (/etc/pgbouncer/pgbouncer.ini)
http://lists.pgfoundry.org/pipermail/pgbouncer-general/2011-July/000830.html
Created 06-16-2016 11:11 AM
Ca you please try with this connector?
https://jdbc.postgresql.org/download/postgresql-9.1-903.jdbc4.jar
Created 06-16-2016 11:24 AM
I tried all this connectors:
But I had the same error with each of them
Created 06-16-2016 11:41 AM
can you try like this?
sqoop list-tables -Dignore_startup_parameters=extra_float_digits --connect jdbc:postgresql://my.server.com:6543/abserver-bigdata --username bigdata --password xxxxx
Looks like it
Created 06-17-2016 09:32 AM
Thank you for advise, but it does not work too... The same error.
@Dileep Kumar Chiguruvada`s answer resolves this issue.
Created 06-16-2016 11:53 AM
By chance is the pgBouncer (lightweight connection pooler for PostgreSQL) installed along with yout Postgress Install.
If so set this param ignore_startup_parameters = extra_float_digits in pgbouncer.ini (/etc/pgbouncer/pgbouncer.ini)
http://lists.pgfoundry.org/pipermail/pgbouncer-general/2011-July/000830.html
Created 06-17-2016 09:33 AM