Re: Error with using 'Store' (Pig)

daniel_hendrix · ‎02-11-2016

@Benjamin Leonhardi Me either. Just replaced my file with yours and receive the same error about line 98 which I would have received before commenting out the return statement on that line

daniel_hendrix · ‎02-11-2016

@Benjamin Leonhardi The main() at the top of mine is the one at the bottom of yours. My screenshot from vi is showing that line plus additional lines which were not visible in Notepad++. Sadly, no, nothing is being written to /flume/events

daniel_hendrix · ‎02-11-2016

@Benjamin Leonhardi Interesting! You are right, I was using Notepadd++. However, when I opened the script in vi, there are additional lines not visible in Notepad++. See the attached picture. I changed the return on line 98 to be commented as suggested on the tutorial comments and the script executed.py3.png

daniel_hendrix · ‎02-11-2016

@Benjamin Leonhardi Same error message received. Below is what is in the script which I re-downloaded and unzipped. I would paste the code from the script but it exceeds the 600 character limit. Instead Ive attached pictures. I see no issues with indentation of return statements nor do I see anything on line 98.

daniel_hendrix · ‎02-11-2016

@Benjamin Leonhardi I'm almost at the part where I should run the script. However, Ive noticed two other items about the tutorial. When I execute the mv command for flume.conf, I am told it already exists and will be overwritten. The log4jproperties file is already configured correctly.

daniel_hendrix · ‎02-11-2016

@Benjamin Leonhardi Thanks Benjamin. I'm currently completing the lengthy re-download and install of the SBX and will also re-download the script. Will let you know if I still receive an error.

daniel_hendrix · ‎02-11-2016

I am working through this tutorial and I'm encountering the error shown below. I see that others have experienced it to from looking at the comments below the walk through. I believe I have successfully completed this tutorial before. Any ideas on how to resolve this? [root@sandbox home]# python generate_logs.pyFile “generate_logs.py”, line 98return resultsSyntaxError: ‘return’ outside function

daniel_hendrix · ‎02-08-2016

@Daniel Vielvoye

daniel_hendrix · ‎02-05-2016

@rich Understood. I just wanted to raise awareness to the discrepancies as it was difficult and time-consuming to assess if I had completed the practice tasks correctly due to my outcomes differing from what was provided as solutions. Hopefully others will see this prior to the practice exam being updated and be able to navigate through my smoothly. Thanks for the quick feedback you've been providing.

daniel_hendrix · ‎02-05-2016

@rich it also affects the answer for Task 03 item #2 as well. It makes the result off by 2.

daniel_hendrix · ‎02-05-2016

@rich Rich and team, Is there a better way to contact you in regards to discovered errors in the Practice Exam? Not sure this is the correct forum for raising such issues as it seems more intended for Q&A. However, the issue noted here also affects the answer for Task 03 item #1. The correct answer should be 30,000. However, the answer shown in the solutions folder is 30,267 which is including records from the 2 weather related files which shouldn't be used until Task 07.

daniel_hendrix · ‎02-05-2016

@rich Thanks Rich. This clarifies a lot and removes some of the stress from the exam preparation. 🙂

daniel_hendrix · ‎02-05-2016

@rich Thanks Rich. Based on your response, I believe then that for a task to be marked as correct, you would only be considering a combination of: output location framework used and that there could be multiple ways of writing the code or script. For example, for the task questioned above, someone could write a single put command to copy all .csv files in the folder, OR they could execute separate put commands for every file, OR they could use copyFromLocal. Would that be correct?

daniel_hendrix · ‎02-05-2016

#2 of TASK 01 states that you should put the 3 files from the /home/horton/datasets/flightdelays directory into HDFS. However, the flightdelays directory contains 5 files. I feel that this is a bit ambiguous but assume that it is referring to the 3 with a similar name. Furthermore, when checking the solutions.txt file I can see that the correct command is set to copy all .csv files in the folder to HDFS. How will Tasks such as this one be graded (by command/s used, presence of the correct files in HDFS, etc.)? Would I not receive a PASS for this Task if I moved all 5 files instead of just the 3 with a similar naming convention?

daniel_hendrix · ‎02-05-2016

@Artem Ervits Thanks, this is very helpful.

daniel_hendrix · ‎02-05-2016

@Neeraj Sabharwal Thanks! I hadn't ran across this one yet.

daniel_hendrix · ‎02-05-2016

Are there any good walkthrough tutorials for Flume? I've seen the two listed here. However, after skimming through the second one "Analyzing Social Media and Customer Sentiment," I fail to see any use or reference of Flume within it. I would specifically like something that walks through performance of the two Flume objectives documented in the HDP Certified Developer Exam Objectives sheet: Given a Flume configuration file, start a Flume agent Given a configured sink and source, configure a Flume memory channel with a specified capacity https The 1st tutorial from the link above starts a Flume agent via Ambari, but I assume the Exam will require this to be done via the Terminal.

daniel_hendrix · ‎01-13-2016

I believe it is a matter of case-sensitivity. Please try PigStorage instead of pigstorage.

daniel_hendrix · ‎01-13-2016

Thanks Rich. Your response led me to find a discrepancy between what is written on the first link you provided and the pdf file which is available for download on the right side of that same page under Resources as ' HDP Certified Developer (HDPCD) Exam' which is what Ive been referencing during my preparation.

daniel_hendrix · ‎01-13-2016

I am preparing for the HDP Developer Certification and have been unable to find relevant tutorials related to each of the exam objectives. I'm using the labs that are part of the Hortonworks University as well as the official tutorials. I'm aware that the exam objectives list has links to documentation but I'm specifically looking for more hands-on step-by-step tutorials for things such as 'Use WebHDFS to create and write a file in HDFS'.

daniel_hendrix · ‎01-13-2016

@bsaini You can also navigate to 'My Preferences' and select to receive notifications when questions are posted and to receive a list of unanswered questions in a daily digest.

Online	Offline
Last Visited	‎08-17-2018 07:02 PM

Date Registered	‎01-13-2016 02:46 PM
Last Visited	‎08-17-2018 07:02 PM
Total Messages Posted	23
Total Kudos Received	18

Re: Error with using 'Store' (Pig)

Re: Flume Tutorial Error with Python Script

Re: Flume Tutorial Error with Python Script

Re: Flume Tutorial Error with Python Script

Re: Flume Tutorial Error with Python Script

Re: Flume Tutorial Error with Python Script

Re: Flume Tutorial Error with Python Script

Flume Tutorial Error with Python Script

Re: Ambari metrics widget (custom) for service can...

Re: HDP Developer Practice Exam Errors

Re: HDP Developer Practice Exam Errors

HDP Developer Practice Exam Errors

Re: HDP Developer Practice Exam - Task 01

Re: HDP Developer Practice Exam - Task 01

HDP Developer Practice Exam - Task 01

Re: Flume Tutorials

Re: Flume Tutorials

Flume Tutorials

Re: Error with using 'Store' (Pig)

Re: Tutorials Related to All HDP Certified Develop...

Tutorials Related to All HDP Certified Developer E...

Re: Unanswered questions