Member since
02-03-2016
123
Posts
23
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3802 | 04-13-2017 08:09 AM |
12-23-2016
10:26 AM
sorry, CSV file name is warehouse.csv warehouse.zip
... View more
12-23-2016
10:23 AM
Hi, Attaching a sample CSV which I am trying to load in HBase using importtsv. Command gets successfully executed however I can't see records in the table. 1) CSV file name warehouse.dat (comma separated). 1st column in the CSV is the unique key 2) HBase table : create 'warehouse','mycf' 3) importtsv command : hbase org.apache.hadoop.hbase.mapreduce.ImportTsv -Dimporttsv.separator=, -Dimporttsv.columns="HBASE_ROW_KEY,mycf:w_warehouse_id,mycf:w_warehouse_name,mycf:w_warehouse_sq_ft,mycf:w_street_number,mycf:w_street_name,mycf:w_street_type,mycf:w_suite_number,mycf:w_city,mycf:w_county,mycf:w_state,mycf:w_zip,mycf:w_country,mycf:w_gmt_offset" warehouse /user/tcs_ge_user/warehouse/warehouse.csv 4) Scan table shows below output. hbase(main):027:0> scan 'warehouse'
ROW COLUMN+CELL
0 row(s) in 0.0210 seconds
Need your URGENT help on this.
... View more
Labels:
- Labels:
-
Apache HBase
12-15-2016
05:58 AM
Do I need to add the data bricks package in spark class path? As I am new to spark so struggling to understand how to use the package. Also are there any other way without using the databricks package for parsing an XML and generating a CSV?
... View more
12-14-2016
11:42 AM
1 Kudo
Hi Guys,
We have a use cases to parse XML files using Spark RDD. Got some examples to use spark xml utils as per the link.
https://github.com/databricks/spark-xml There are some examples here. However can you guys also provide some sample code for this?
Also can you please mention the how and external package can be added from spark-shell and pyspark?
We are looking for your guidance.
Thanks,
Rajdip
... View more
Labels:
- Labels:
-
Apache Spark
10-31-2016
03:08 PM
@Kuldeep Kulkarni - your solution of copying the jar file worked. Is this some kind of bug in HDP 2.5 because we did not faced this in 2.4 and 2.3.
... View more
10-31-2016
02:43 PM
@Kuldeep Kulkarni - in dn1.tcsgedc.com we ZK service running and we are able to telnet on port 2181 from ambari server host. To give you a bit of synopsis: nn.tcsgegdc.com -->> NN and Ambari server host dn1.tcsgedc.com -->> Data Node and Hive host dn2.tcsgedc.com -->> Data Node and Spark host
... View more
10-31-2016
02:32 PM
@Kuldeep Kulkarni - not able to do telnet from ambari server host to dn1.tcsgegdc.com. Can you please guide me what needs to be done here? Please note that telnet is installed in all the nodes in cluster. [root@nn ambari-agent]# telnet dn1.tcsgegdc.com 8080
Trying 3.209.124.206...
telnet: connect to address 3.209.124.206: Connection refused
... View more
10-31-2016
02:20 PM
@Kuldeep Kulkarni - we are able to telnet and ping to ambari-server host from the reported host. Screenshots attached. telnet-output.jpg ping-output.jpg
... View more
10-31-2016
02:11 PM
Please note that we are using local repo ......
... View more
10-31-2016
02:07 PM
@Kuldeep Kulkarni - below are logs from Ambari UI. error-logs.txt
... View more