Cloudera Community
Announcements
Celebrating as our community reaches 100,000 members! Thank you!
bramhanaelem
user rank
Explorer

Parquet Timestamp Inconsistent values Hive Vs AWS...

by Explorer in Support Questions
‎07-01-2021 11:14 AM
‎07-01-2021 11:14 AM
Hi -   We are laoding data from sqoop to Hive table in parquest format where the dates are showing properly in hadoop.   We are distcping the data to AWS S3 and creating the tables in Athean using Glue Crawler.   When we query both tables(Hadoop & AWS) we are seeing different values for timestamp & date columns.   Hadoop Query Data: SELECT effective_dt FROM "dbname"."table" where Pk_id='78393904' output 0001-01-03 07:00:00.000   Athean Query Data SELECT effective_dt FROM "dbname"."table" where Pk_id='78393904' output 0001-01-01 12:00:00.000   Any suggestions how to overcome this issue. ... View more
Labels:

Re: sqoop import writes NULL when reading Null val...

by Explorer in Support Questions
‎07-10-2017 04:20 PM
‎07-10-2017 04:20 PM
Hi Dennis, Even though I declared --null-string as --null-string '\\N' in the sqoop import synatax. still i am seeing "null" string value for all string fields where value is null in source schma. can you please provide any solution to it. below is my sqoop import syntax. import -Dhadoop.security.credential.provider.path=${jceks_loc} --password-alias ${passwordAlias} --username ${userName} --connect ${connection} --table ${sourceSchema}.${sourceTable} --hive-import --hive-table ${hiveTable} --target-dir ${hdfsDir} --fields-terminated-by "|" --delete-target-dir --null-string '\\N' -m 1 Thanks, Brahma ... View more
Contact Me
Online
Offline
Last Visited
‎07-01-2021 06:20 PM
Community Statistics
Member Since ‎05-30-2017 06:17 PM
Last Visited ‎07-01-2021 06:20 PM
Posts 6