Member since
07-31-2013
1924
Posts
462
Kudos Received
311
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1966 | 07-09-2019 12:53 AM | |
| 11827 | 06-23-2019 08:37 PM | |
| 9114 | 06-18-2019 11:28 PM | |
| 10074 | 05-23-2019 08:46 PM | |
| 4516 | 05-20-2019 01:14 AM |
07-27-2016
01:23 AM
Hi sairamvj, I would suggest you open a new thread for your question, as it is not related to this topic of this thread. Martin
... View more
07-07-2016
07:31 PM
LazyOutputFormat is available for both APIs. Here's the one for the older API: http://archive.cloudera.com/cdh5/cdh/5/hadoop/api/org/apache/hadoop/mapred/lib/LazyOutputFormat.html
... View more
07-06-2016
03:08 PM
The `delete` named column in your retailSKU table is actually a reserved word, and that's the central point of the issue. When Sqoop's building out the query, its currently not escaping the column names with backticks (``) which is necessary when not intending to mean using a reserved word ( https://dev.mysql.com/doc/refman/5.7/en/keywords.html). Would it be possible for you to alter the column name on the source retailSKU table, or pass a custom query instead which uses the right escape syntax, via --query: http://archive.cloudera.com/cdh5/cdh/5/sqoop/SqoopUserGuide.html#_free_form_query_imports ? Edit: Just noticed you've mentioned that free-form works just fine.
... View more
07-01-2016
04:16 AM
1 Kudo
While MultipleInputs was designed for such a thing, your requirement is unique in that you need to process the same input 2x but with different params each time. It seems a bit redundant to me given that you can do it in a single task run vs. 2x the I/O cost… But I believe the way you can solve your identifier problem is by writing your own InputFormat wrapper over the existing InputFormat, which generates special types of InputSplit objects (wrapper over regular FileSplit classes). These input splits need to add in your identifiers as an extra field, and you can extract and cast the same from your context.getInputSplit() in the map-end to then differentiate the input.
... View more
06-24-2016
07:44 AM
We are also seeing same issue but we have 3 agents and a CM. I could see all the agents in the CM as connected but its not working when trying to install via Parcels. I have created local parcel directory and files in that directory but its still grayed out in the CM to proceed further. Can you suggest if something is missing or in the parcel. Thanks in advance!
... View more
06-23-2016
06:42 PM
1 Kudo
When an RS exits, it logs a lot of content from the many threads it runs. Your log snippet is just the post-exit-decision messages, as you can note from the several "exiting" messages. Please instead pass us your entire log file, or look for the entire line and its following exception stack trace matching the word "FATAL", which would be in a line well before these logs appear.
... View more
06-20-2016
04:31 AM
2 Kudos
What directory are you looking under for the keytab files? Ensure to look under the most recent role-related directory. Note that you don't need to access these directories directly and that you can find the same process files under CM at CM -> [Service] -> Instances tab -> [Instance of the service roles you are interested in] -> Processes tab -> In the files section, keytab should be available for download.
... View more
06-20-2016
04:13 AM
yeah... its working.. i was able to find out its hex value (its control-v + control-a) character but was not applying '$' symbol. Thank you so much .. 🙂 really appreciated..
... View more