Member since
02-24-2016
87
Posts
18
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4144 | 12-18-2017 11:47 AM | |
11531 | 11-08-2017 01:54 PM | |
65430 | 05-06-2016 11:48 AM |
08-29-2016
02:50 PM
This I need to do from hadoop namenode?
... View more
08-29-2016
02:07 PM
Query : ./sqoop import --connect jdbc:oracle:thin://<ip address>:1521/app --username APP --password APP12# --table tbemp --hive-import
... View more
08-29-2016
02:05 PM
I am getting below error while executing SQOOP import command :
ERROR manager.SqlManager: Error executing statement: java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Sqoop
05-10-2016
09:30 AM
Great !! @Bernhard Walter . Thanks for your help.
... View more
05-10-2016
09:05 AM
I tried @Bernhard Walter : But I am not getting values hive> select '_c0' from xml_table;
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_1461307169071_0063, Tracking URL = http://CDCUDHDOOPAPP02:8088/proxy/application_1461307169071_0063/
Kill Command = /chroot/hadoop/inst/hadoop/hadoop-2.4.0/bin/hadoop job -kill job_1461307169071_0063
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
2016-05-10 14:33:40,593 Stage-1 map = 0%, reduce = 0%
2016-05-10 14:33:45,811 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 0.96 sec
MapReduce Total cumulative CPU time: 960 msec
Ended Job = job_1461307169071_0063
MapReduce Jobs Launched:
Job 0: Map: 1 Cumulative CPU: 0.96 sec HDFS Read: 265 HDFS Write: 8 SUCCESS
Total MapReduce CPU Time Spent: 960 msec
OK _c0
_c0
Time taken: 17.912 seconds, Fetched: 2 row(s)
... View more
05-10-2016
08:50 AM
1) I had extracted data from xml . 2) I am getting the data correctly as below hive> select * from xml_table; OK
1 Satish Kumar Technical Lead
2 Ramya Testing 3) hive> describe xml_table; OK _c0 int
_c1 string
_c2 string issue : .. When I try to access only _c0 column , I am getting error as below hive> select _c0,_c1 from xml_table; FAILED: ParseException line 1:10 missing \' at ',' near '<EOF>'
line 1:15 missing \' at 'from' near '<EOF>'
... View more
Labels:
- Labels:
-
Apache Hive
05-06-2016
11:48 AM
2 Kudos
Its now running using below , thanks for all your help : hive> ALTER TABLE jsont1 SET LOCATION "hdfs:/jsam/j1"; OK
Time taken: 0.245 seconds hdfs:/ : Did you know then why its not running using hdfs:// (double slash)
... View more
05-06-2016
11:32 AM
@Rajkumar Singh hive> describe formatted jsont1;
OK
col_name data_type comment
# col_name data_type comment
json string
# Detailed Table Information
Database: logs
Owner: hadoop
CreateTime: Tue May 03 15:24:27 IST 2016
LastAccessTime: UNKNOWN
Protect Mode: None
Retention: 0
Location: hdfs://mycluster:8020/jsam
Table Type: EXTERNAL_TABLE
Table Parameters:
COLUMN_STATS_ACCURATE false
EXTERNAL TRUE
numFiles 0
numRows -1
rawDataSize -1
totalSize 0
transient_lastDdlTime 1462269267
# Storage Information
SerDe Library: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
InputFormat: org.apache.hadoop.mapred.TextInputFormat
OutputFormat: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
Compressed: No
Num Buckets: -1
Bucket Columns: []
Sort Columns: []
Storage Desc Params:
serialization.format 1
... View more
05-06-2016
09:58 AM
@Rajkumar Singh Yes I tried this also .. getting as below FAILED: IllegalArgumentException java.net.UnknownHostException: jsam Below text to show jsam is available in hdfs : hive> dfs -ls /jsam; Found 1 items
drwxr-xr-x - hadoop supergroup 0 2016-05-06 12:49 /jsam/j1
... View more
05-06-2016
09:20 AM
1 Kudo
1) CREATE EXTERNAL TABLE IF NOT EXISTS jsont1(
json string
)
LOCATION '/jsam'; Now I need to change the location from where above json1 points to. I tried this command - ALTER TABLE jsont1 SET LOCATION "/jsam/j2" ; but getting error as below : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. {0} is not absolute or has no scheme information. Please specify a complete absolute uri with scheme information. /jsam/j2
... View more
Labels:
- Labels:
-
Apache Hive