question Re: Sqoop logging when invoked via CLI in Archives of Support Questions (Read Only)

Sqoop logging when invoked via CLI

abajwa — Fri, 11 Dec 2015 03:21:31 GMT

Sqoop today does not seem to provide any option to specify location to save the logs when invokes from the CLI: it always prints details on the console.

Is there a way to capture Sqoop output in a file? If not any plans for this?

Re: Sqoop logging when invoked via CLI

aervits — Fri, 11 Dec 2015 04:03:08 GMT

you can try something like this

sqoop command 2>&1| tee -a log

Re: Sqoop logging when invoked via CLI

gbraccialli3 — Sat, 12 Dec 2015 02:09:43 GMT

I tried this once and didn't work. let me know it works for you.

Re: Sqoop logging when invoked via CLI

nsabharwal — Sat, 12 Dec 2015 21:14:59 GMT

@Guilherme Braccialli I tried this ..I do see log

-rw-r--r--. 1 root root 4573 Dec 12 05:13 log

[root@phdns01 ~]# sqoop import --connect jdbc:mysql://localhost:3306/test --username root --password root --table t1 --hive-import --direct --hive-table t1 2>&1| tee -a log

Re: Sqoop logging when invoked via CLI

aervits — Sat, 12 Dec 2015 23:35:19 GMT

I use the same trick with mapreduce jobs, hive -f commands, etc, it's proven to work guys. @Ali Bajwa @Guilherme Braccialli

Re: Sqoop logging when invoked via CLI

kuppusamy_sella — Tue, 18 Jul 2017 14:57:47 GMT

Yes. you just need suffix this "2>&1| tee -a sqooptest.log" along with your SQOOP EXPORT/IMPORT command

Re: Sqoop logging when invoked via CLI

rene_sluiter — Tue, 18 Jul 2017 16:57:37 GMT

if you also want your sqoop command included you can expend the command like this (with set -x and set +x:

{
echo $(date) 
set -x
beeline -u ${hive2jdbcZooKeeperUrl} -f "file.hql"
set +x
echo $(date)
} 2>&1 | tee /tmp/sqoop.log