Member since
12-12-2017
3
Posts
0
Kudos Received
0
Solutions
09-28-2022
06:59 AM
The script in the accepted solution was not working for me, so I modified it: #!/bin/bash
usage="Usage: dir_diff.sh [path] [-gt|-lt] [days]"
if (( $# < 3 ))
then
echo $usage
exit 1
fi
now=$(date +%s)
hdfs dfs -ls $1 | grep -v "^d" | grep -v '^Found ' | while read f; do
dir_date=`echo $f | awk '{print $6}'`
difference=$(( ( $now - $(date -d "$dir_date" +%s) ) / (24 * 60 * 60 ) ))
if [ $difference $2 $3 ]; then
echo $f
# hdfs dfs -ls `echo $f| awk '{ print $8 }'`;
fi
done
... View more
09-08-2022
06:19 AM
This issue is still present in CDP 7.1.7 sp1. We had to edit the advanced snippet for hive-site.xml for the Metastore service and add: metastore.storage.schema.reader.impl org.apache.hadoop.hive.metastore.SerDeStorageSchemaReader
... View more