Member since
04-15-2016
11
Posts
4
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
294 | 04-20-2016 06:23 PM |
01-19-2017
07:45 AM
I am trying to generate Sqoop command using python . I am able to pass and fire the Sqoop query. I wanted to map the column name in Sqoop command --map-column-java and number of columns are different in each column . only BLOB and CLOB needs to be mapped . Data: Column Datatype C460 VARCHAR2 C459 CLOB C456 BLOB C60901 Varchar C8 BLOB Sample code i am using :- proc=subprocess.Popen(["sqoop", "eval", "--connect","jdbc:oracle:thin:@" + config["Production_host"]+":"+config["port"]+"/"+config['Production_SERVICE_NAME'],"--username", config["Production_User"], "--password", config["Production_Password"], "--query","SELECT column_name, data_type FROM all_tab_columns where table_name =" + "'"+ Tablename + "'"],stdout=subprocess.PIPE)
COl_Re=re.compile('(?m)(C\d+)(?=.+[CB]LOB)')
columns=COl_Re.findall(proc.stdout.read()) i am able to get the required column names C459,C456,C8 using the above code . output ['C459', 'C456','C8'] i should get with below format sqoop import --connect "--connect","jdbc:oracle:thin:@" + config["Production_host"]+":"+config["port"]+"/"+config['Production_SERVICE_NAME'],"--username", config["Production_User"], "--password", config["Production_Password"], --table table --fields-terminated-by '|' --map-column-java C456=String,C459=String,C8=String --hive-drop-import-delims --input-null-string '\\N' --input-null-non-string '\\N' --as-textfile --target-dir <Location> -m 1 i only need to add this part --map-column-java C456=String,C459=String,C8=String dynamically so that my next code subprocess.call can use this.
... View more
Labels:
12-30-2016
10:58 AM
I am using Hortonwork sandbox 2.5 in Oracle virtual box.i am not compiling anything . So it should be there by default.
... View more
12-30-2016
09:32 AM
1 Kudo
Hdfs dfs -ls command not working in hortonworks HDP_2.5
... View more
11-29-2016
01:02 PM
hortonwork sandbox 2.5 is hang and unable to start properly .I was able to run hortonwork sandbox 2.4 perfectly fine with this configuration . But now hortonwork sandbox 2.5 giving issue to start. Configuration on virtual box hang more than 30 min in this same position tried repeatedly but unable to get to the login screen. Any help or lead on this much appricited
... View more
11-28-2016
05:24 PM
@Raf Mohammed That means with * GB system i can not start this Sandbox . And why two OS option are coming during start up and asking to select one . Which one needs to select.
... View more
11-28-2016
10:38 AM
hortonworks sandbox taking too much time to start (Assigned Ram 5 GB )and when the virtual box starting two OS version coming which one needs to be selected . And its getting stuck after starting container .
... View more
05-04-2016
12:54 PM
1 Kudo
I have tried to install the Elastcsearch from https://www.elastic.co/downloads/elasticsearch as well as Kibana. i placed the both the file in Desktop and when i tried to start the service by command ./elasticsearch . It showing the right downloaded version as started .But when i checks the in ui http://100.96.156.198:9200/ it shows the older version ..Due to which Kibana unable to start ..I have performed the same step in Clouderaquickstart vm everything works perfect.I have tried to follow the step in https://github.com/Symantec/ambari-elasticsearch-service but still no luck. I placed the downloaded version this time in "/var/lib/ambari-server/resources/stacks/HDP/${hdp.version}/services/ELASTICSEARCH/" {
"status" : 200,
"name" : "Captain Barracuda",
"version" : {
"number" : "1.2.1",
"build_hash" : "6c95b759f9e7ef0f8e17f77d850da43ce8a4b364",
"build_timestamp" : "2014-06-03T15:02:52Z",
"build_snapshot" : false,
"lucene_version" : "4.8"
},
"tagline" : "You Know, for Search"
}
... View more
Labels:
04-20-2016
06:23 PM
Thanks .. sudo su - hdfs hdfs dfs -mkdir /user/root hdfs dfs -chown root:hdfs /user/root got the answer as well from another thread
... View more
04-15-2016
06:09 AM
1 Kudo
Thanks Laurence Da Luz . It helped me
... View more
04-15-2016
05:30 AM
1 Kudo
hortonworks Sandbox dont have the Action option in Service Tab . The service action option is available in sandbox 2.3 but unable to find in latest version.
... View more