@smruti  I've validated it with the user, and here's what happens. The date field comes in string format and it only comes with 8 fields "Yyyy-mm-dd" and it was converting to time stamp which in this case aggregates the time fields, and that's where the divergence was. Is there anything in the tool that can be done to standardize this or do I need to change the data engineering? ... View more

@AhXian I hope we have copied the bucket files correctly, and also ran MSCK REPAIR. Could you also run ANALYZE.. COMPUTE STATISTICS on the external table once. Make sure the DESCRIBE command on the external table reflects the number of data files correctly.  Please share describe and  "hdfs dfs -ls -R <externa table location>" o/p ... View more

@ldylag you can check which database the service uses by checking its configuration in the cloudera manager. For instance, go to hive service » configuration » and search for database. The configuration named "hive_metastore_database_name" will tell you the actual database hive service is using.  I hope this helps! ... View more

@kaif Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks. ... View more

@kaif Hive does have information_schema database, that you can access from beeline or Hue. You also have SYS db that fetches different information from the RDBMS that is used to store hive metadata.  Here's the DDLs of those tables, and this will also give you some idea on what data they store. ... View more

There has been a update in external db hive is using and new version instance is running on a new port this config change was made when whole cluster was stopped @smruti Can you please  help with how is the data loaded from hive metastore to postgres sql is it through pyscopg and where is it stored in database server cause we need to get the missing data from older version of db but cannot locate where the source of this corrupted data is on db server ... View more

Thanks @smruti  I changed data type to String and data is stored without encoding as I want.  Is there any documentation where I can find "Why the encoding is being performed by HBase SerDe, for the binary data"? regards, Marks ... View more

@shofialau great! Now we can download mysql jdbc connector and place in the HMS node under the location /usr/share/java Detailed information can be found here - https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade-hdp/topics/amb-install-mysql-jdbc.html#pnavId2 ... View more

Hello @smruti , Thanks for the help.  ... View more