About bramhanaelem

bramhanaelem · ‎07-01-2021

Hi - We are laoding data from sqoop to Hive table in parquest format where the dates are showing properly in hadoop. We are distcping the data to AWS S3 and creating the tables in Athean using Glue Crawler. When we query both tables(Hadoop & AWS) we are seeing different values for timestamp & date columns. Hadoop Query Data: SELECT effective_dt FROM "dbname"."table" where Pk_id='78393904' output 0001-01-03 07:00:00.000 Athean Query Data SELECT effective_dt FROM "dbname"."table" where Pk_id='78393904' output 0001-01-01 12:00:00.000 Any suggestions how to overcome this issue.

bramhanaelem · ‎07-10-2017

Hi Dennis, Even though I declared --null-string as --null-string '\\N' in the sqoop import synatax. still i am seeing "null" string value for all string fields where value is null in source schma. can you please provide any solution to it. below is my sqoop import syntax. import -Dhadoop.security.credential.provider.path=${jceks_loc} --password-alias ${passwordAlias} --username ${userName} --connect ${connection} --table ${sourceSchema}.${sourceTable} --hive-import --hive-table ${hiveTable} --target-dir ${hdfsDir} --fields-terminated-by "|" --delete-target-dir --null-string '\\N' -m 1 Thanks, Brahma

Online	Offline
Last Visited	‎07-01-2021 06:20 PM

Member Since	‎05-30-2017 06:17 PM
Last Visited	‎07-01-2021 06:20 PM
Posts	6

Cloudera Community

Parquet Timestamp Inconsistent values Hive Vs AWS...

Re: sqoop import writes NULL when reading Null val...