Hello all,
I have the following script which works:
sudo -u hdfs sqoop import --connect jdbc:postgresql://xxxx --username foo --password bar --table upstream_lead_vendors --hcatalog-database default --hcatalog-table test_orc_sqoop_2 --create-hcatalog-table --hcatalog-storage-stanza "stored as orcfile" -m 1 --driver org.postgresql.Driver
I would like to add dynamic partitioning to my script. More specifically using the dates from date column in my postgres table. So my script would use the different dates from my postgres table for partitioning.
How should I proceed? I haven't found a lot about this online. Any help or examples would be very appreciated
Thanks,
Marc