Member since
02-01-2019
650
Posts
143
Kudos Received
117
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2834 | 04-01-2019 09:53 AM | |
1465 | 04-01-2019 09:34 AM | |
6957 | 01-28-2019 03:50 PM | |
1580 | 11-08-2018 09:26 AM | |
3827 | 11-08-2018 08:55 AM |
08-13-2018
01:43 PM
@Carlton Patterson You can use "mode("append")" to append the new data to existing one. counts.coalesce(1).write.mode("append").csv("/home/packt/Downloads/myresults7-"+currentdate+".csv") P.S please use 'reply' on this comment instead of writing a new comment. In this way we can maintain the conversaion in order.
... View more
08-13-2018
12:06 PM
2 Kudos
@rinu shrivastav No, The number of map tasks for a given job is driven by the number of input splits. For each input split a map task is spawned. So, we cannot directly change the number of mappers using a config other than changing the number of input splits.
... View more
08-13-2018
11:26 AM
What is the python version you are using? if its python 3.x Use: print(currentdate)
... View more
08-13-2018
11:11 AM
Looks like some issue with text formatting. Try this: import datetime currentdate = datetime.datetime.now().strftime("%Y-%m-%d") print currentdate >>> 2018-08-13
... View more
08-13-2018
10:59 AM
Assign to @Jonathan Sneep, You can also create a new temp table with JSON file format and use "insert into json table form existing table;" Post creating the new table, the files can be read form hdfs in json format.
... View more
08-13-2018
10:45 AM
Looks like there are 3 questions with same description...
... View more
08-13-2018
10:44 AM
@Carlton Patterson You can use the python's datetime package to obtain the current date. import datetime
currentdate = datetime.datetime.now().strftime("%Y-%m-%d") print currentdate >>> 2018-08-13 And then use the currentdate in output file name. counts.coalesce(1).write.csv("/home/packt/Downloads/myresults3-" + currentdate + ".csv") Hope this helps. P.S. If you want date and time use: datetime.datetime.now().strftime("%Y-%m-%d %H:%M")
... View more
08-12-2018
02:58 PM
@Rahul P The doc is now corrected: https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.0/hive-overview/content/hive-apache-hive-3-architecturural-overview.html *** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.
... View more
08-10-2018
03:43 PM
@Gaurang Shah I don't think you will be able to connect form the presto outside of sandbox. One easy solution i can think of is to install presto service within sandbox docker.
... View more
08-10-2018
10:44 AM
This disables 'hadoop' command completely. Well i missed this in description. Restricting only chmod is not possible without implementing authentication/authorization AFAIK.
... View more