Member since
02-02-2016
583
Posts
518
Kudos Received
98
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3274 | 09-16-2016 11:56 AM | |
1375 | 09-13-2016 08:47 PM | |
5482 | 09-06-2016 11:00 AM | |
3183 | 08-05-2016 11:51 AM | |
5263 | 08-03-2016 02:58 PM |
06-04-2016
11:37 AM
3 Kudos
@Roberto Sancho Yes, if you are using ACID operation then these delta file should create for each partition and inside it you will see the no. of buckets which got some change during ACID operation. These delta files should be merge with base records as per the compaction policies.
... View more
06-03-2016
09:39 PM
5 Kudos
@Timothy Spann You can also use pig ORC storage and store file in ORC, afterward create external hive table and point it to orc directory. https://pig.apache.org/docs/r0.15.0/func.html#OrcStorage Data types Most Orc data type has one to one mapping to Pig data type. Several exceptions are: Loader side:
Orc STRING/CHAR/VARCHAR all map to Pig varchar Orc BYTE/BINARY all map to Pig bytearray Orc TIMESTAMP/DATE all maps to Pig datetime Orc DECIMAL maps to Pig bigdecimal Storer side:
Pig chararray maps to Orc STRING Pig datetime maps to Orc TIMESTAMP Pig bigdecimal/biginteger all map to Orc DECIMAL Pig bytearray maps to Orc BINARY
... View more
06-03-2016
07:20 PM
Can you check latest NN logs?
... View more
06-03-2016
07:08 PM
2 Kudos
@c pat Looks like your namenode process is down due to "Port in use: server1.ddns.net:50070". Check if any process occupying the port 50070. lsof -i:50070 If output shows nothing then can you please start the NN again and run the above command to see if NN process running on that port?.
... View more
06-03-2016
12:51 PM
2 Kudos
@Kumar Sanyam Looks like below jar is missing from PIG lib directory. Please cross check antlr-runtime-<version>.jar
... View more
06-03-2016
12:48 PM
1 Kudo
@Gerd Koenig It seems like the authentication was failed with zookeeper. Through which user you are perform the upgrade and is this a secure cluster? WatchedEvent state:AuthFailed type:None path:null
... View more
06-03-2016
12:35 PM
2 Kudos
Hi @Michael Dennis "MD" Uanang I see on my cluster that by default Ambari 8080 port bind with all the available interfaces on that host like eth0,eth1, eth2 etc. What issue you are facing?
... View more
06-03-2016
08:23 AM
I hope that is default postgres db, if yes then please follow the above instructions.
... View more
06-03-2016
07:54 AM
2 Kudos
Please follow below doc if you are using default ambari DB. http://docs.hortonworks.com/HDPDocuments/Ambari-2.1.2.0/bk_ambari_reference_guide/content/_back_up_current_data.html Also for config backup try using API. http://lecluster.delaurent.com/one-shot-backup-all-config-files-with-ambari-api/
... View more
06-02-2016
10:02 PM
2 Kudos
@srai Are you able to run same pig script through command line? Also looks like below jar either missing or have multiple versions while runing pig. /usr/hdp/current/hive-client/lib/hive-metastore-<version>.jar
... View more