Member since
10-01-2015
3933
Posts
1150
Kudos Received
374
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3365 | 05-03-2017 05:13 PM | |
2796 | 05-02-2017 08:38 AM | |
3074 | 05-02-2017 08:13 AM | |
3005 | 04-10-2017 10:51 PM | |
1515 | 03-28-2017 02:27 AM |
12-31-2015
05:22 PM
the tutorial link was invalid, removed the extraneous parenthesis
... View more
12-31-2015
02:37 AM
@Enis @Devaraj Das I'd be curious to know the answer, my guess would be no, how many records inserted a day?
... View more
12-31-2015
02:23 AM
can you provide the logs?
... View more
12-31-2015
02:19 AM
is there a specific unit test you're referring to? Ambari unit tests are written in Java using JUnit, so you'd use mvn, just like your example. Here's the development guide, https://cwiki.apache.org/confluence/display/AMBARI... and here's latest build reports https://builds.apache.org/job/Ambari-trunk-Commit/... For general python unit testing and running single tests, you can do so by referring to Python docs: The unittest module can be used from the command line to run tests from modules, classes or even individual test methods: python -m unittest test_module1 test_module2
python -m unittest test_module.TestClass
python -m unittest test_module.TestClass.test_method
... View more
12-30-2015
07:46 PM
1 Kudo
@Grace Xu you'd have something like below, remove call to print when your import statement is ready. Test this first obviously. collection = ['tbl1', 'tbl2', 'tbl3'] for i in collection: print 'sqoop import --connnect <connect-str> --table ' + i + ' --target-dir /dest/' + i keep in mind this is Python so take care of your indents, at this point your most important work is to figure out how to populate your collection. Cheers!
... View more
12-30-2015
01:55 PM
can you provide the command you executed? You can follow advice in this thread https://community.hortonworks.com/questions/7165/how-to-copy-hdfs-file-to-aws-s3-bucket-hadoop-dist.html
... View more
12-30-2015
01:51 PM
@vishnu rao alternatively, you can try building your own widget in Ambari, I'll be honest I didn't try it but as far as I know you can build widget per host or aggregated.
... View more
12-30-2015
01:42 PM
@Suresh Bonam did you check in the resourcemanager UI whether it is really stuck or just trying to complete the final reduce attempt? Also I recommend you try with --direct flag to take advantage of the Oracle accelerator for Sqoop, it should make your sqoop jobs a lot faster. Furthermore, you're passing --password that will appear in clear text in your job xml, consider using --password-file or -P to enter the password at the prompt.
... View more
12-30-2015
01:39 PM
@Grace Xu you might need to write a shell script to get a list of tables and iterate through the collection to sqoop.
... View more
12-30-2015
03:20 AM
1 Kudo
I'd check the results of the hdp-select tool and whether you finanlized the previous upgrade.
... View more