Member since
08-23-2016
261
Posts
201
Kudos Received
106
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
921 | 01-26-2018 07:28 PM | |
768 | 11-29-2017 04:02 PM | |
27261 | 11-29-2017 03:56 PM | |
1690 | 11-28-2017 01:01 AM | |
398 | 11-22-2017 04:08 PM |
05-26-2020
04:17 PM
Use Case 1 How to get all the groups in the main canvas programmatically? Answer: url="https://localhost:8080/nifi-api/" content_type= "Content-Type: application/json" end_point= "process-groups/root/process-groups" curl -k " ${url}${end_point} " -H " ${content_type} " -H " ${bearer} " Use Case 2 How to get the groups after finding the root and it's child groups ? For example From the Root --> Karthik Playground ==> Csv_2_Kafka, JSON_2_KAFKA Karthik Playground consists of 2 process group csv_2_kafka and json_2_kafka Root. (uuid "aaaa-bbbb" ==> Karthik Playground. (uuid "cccc-dddd") ==> csv_2_kafka. (uid "eeee-fff") ==> json_2_kafka. (uid "gggg-hhhh") From the use case 1, we get all the UUid under Component for all the process groups in root. Get the uuid for karthik playground and pass like this url="https://localhost:8080/nifi-api/" content_type= "Content-Type: application/json" end_point= "process-groups/cccc-dddd/process-groups" curl -k " ${url}${end_point} " -H " ${content_type} " -H " ${bearer} " This will fetch csv_2_kafka and json_2_kafka Do the same process to get the information from csv_2_kafka and json_2_kafka
... View more
04-28-2020
04:40 PM
The link to port forwarding is invalid !! Please assist. Regards Raj
... View more
04-19-2020
04:44 AM
Hi Manoj, We are using textfiles with separationchar as '|', but the problem we have embedded new lines in columns which is resulting data empty in hive as its considering as new line. Rest data is migrating perfectly fine. Could you please suggest us how to avoid new line characters in between column-data. Thanks&Regards Sreeja
... View more
03-31-2020
07:16 AM
@pvillard How does this work exactly? Im having issues segmenting large files as well. When i split them do i do it multiple times or just once and then I can recombine them successively. Thanks for you help!
... View more
12-24-2019
03:44 PM
@mykola_mykhalov I am also getting same error: DeprecationWarning: The pymssql project has been discontinued. To install the last working released version, use a
version specifier like "pymssql<3.0". For details and alternatives see:
https://github.com/pymssql/pymssql/issues/668
----------------------------------------
ERROR: Failed building wheel for pymssql
Running setup.py clean for pymssql
Successfully built pendulum
Failed to build pymssql
ERROR: Could not build wheels for pymssql which use PEP 517 and cannot be installed directly
... View more
11-29-2017
03:56 PM
2 Kudos
Hi @Nilesh If you are using HDP via Ambari, you can use the Stacks and Versions feature to see all of the installed components and versions from the stack. Via command line, you can navigate to /usr/hdp/current/kafka-broker/libs and see the jar files with the versions. See the attachments for examples of each. I don't believe there is a --version type of command in any of the Kafka cli scripts from what I remember. screen-shot-2017-11-29-at-84935-am.pngscreen-shot-2017-11-29-at-85206-am.png
... View more
10-16-2017
03:12 PM
1 Kudo
Hi @Ni Pal I just signed into my account (US West region) and searched for "Hortonworks" in the community AMIs and am able to see it - see attached
... View more
10-11-2017
03:32 PM
1 Kudo
Hi @nisha vittal this appears to be a vmware issue with the cpu. Could you try using VirtualBox instead of vmware? Unfortunately that will require downloading the virtualbox sandbox, but could be worth the download time if it gets you up and running faster. We typically see less issues with the sandbox on virtualbox.
... View more
09-22-2017
10:04 AM
1 Kudo
Sonu Sahi yes it is possible , so in row leve filter you can give a nested condition so for your use case it will be: country not in (select country from TableB) try out this!!
... View more
09-14-2017
04:33 PM
1 Kudo
Hi @R M I see from the URL in the screenshot that you are using the HDF Sandbox to do this work? The HDF Sandbox is optimized for the streaming components. You might want to try the HDP sandbox instead for services such as Hive. I'd recommend downloading the latest HDP sandbox, where the services will likely work out of the box.
... View more
08-31-2017
03:51 PM
@Samir Sinha Happy to help. If this solved the problem, perhaps you can Accept the answer above.
... View more
12-01-2017
08:31 PM
FYI, the tutorial has recently been updated: Learning the Ropes of the Hortonworks Sandbox
... View more
05-07-2018
01:30 PM
My custom processor is pretty easy to customize. https://github.com/tspannhw/nifi-extracttext-processor You can tweak it to extract just somethings, Apache Tika is very powerful.
... View more
08-24-2017
07:57 AM
Hi @bkosaraju, sorry, was my fault! Solution runs fine !!! My input data was wrong! Thanks, great solution. Timo
... View more
08-22-2017
02:35 PM
hi @nfleming No I am not claiming that. You can change the property within the same session as you see fit.
... View more
08-17-2017
07:51 AM
Hi Sonu I see three different versions of centos . what could you the reason ? Please refer to attached screenshot.I pressed Esc to see what is happening behind the scenes and found what is been attache in capture5.png. There's a failed operation. Thanks Chaithanya M
... View more
08-09-2017
12:07 AM
1 Kudo
Hi @JT Ng I've answered on your other post.
... View more
08-11-2017
03:15 PM
You where correct I was ssh'd to the wrong machine... Once I used port 22 everything is where it should be...thanks
... View more
10-12-2017
10:24 PM
Sahil, @Sahil Jindal Were you able to figure this out? I am having the same problem. The first two OS load options, stop on the load page but the Amabari UI homepage comes up (I am getting connection refused error inside the Ambari portal) but for the third option, the boot up is complete but neither the Ambari homepage nor putty to the machine works! Appreciate if you could share your solution. Thanks, Sam.
... View more
07-06-2017
03:49 PM
1 Kudo
hi @Sami Ahmad The pig view isnt created by default, nor created with teh installation of the pig service. Using an admin account in Ambari, navigate to Manage Ambari -> Views -> Pig and click the Create Instance view and fill out the details. The view will then appear in the dropdown list.
... View more
07-01-2017
10:05 AM
Yes, i login as raj_ops and its works, on maria_dev its not working. But i have new issue, i cant restart hive its always aborted.(
... View more
07-06-2017
03:44 PM
Big thanks for that!! Now back on track with the tutorial because I was getting an error trying to delete that record!!
... View more
07-31-2017
04:09 PM
hi @Manoj Dixit We have a case open on the issue intenrally now 🙂
... View more
06-27-2017
04:47 PM
1 Kudo
Hi @John Cleveland Both the popular HDP and HDF Sandboxes are delivered as Dockerized containers. You are correct that there is a Docker container, as well as a Host machine that are different but ship within the same VM appliance. The following link from the docs might help provide additional clarity as well: https://hortonworks.com/tutorial/hortonworks-sandbox-guide/section/2/
... View more
06-27-2017
04:53 PM
1 Kudo
hi @John Cleveland If you are using the HDF VirtualBox sandbox, you should be able to boot the machine and follow the Getting To Know the Sandbox guide here: https://hortonworks.com/tutorial/getting-started-with-hdf-sandbox/ I don't recall having to do any setup via scripts, just point my browser to the NiFi UI (http://sandbox.hortonworks.com:19090/nifi) Can you reach the NiFi URL after booting the machine?
... View more
06-23-2017
04:37 PM
1 Kudo
Hi @sai saiedfar I've seen this in the Ambari Hive View 2.0, where if you once select a property, it becomes grey and cannot be selected again. I suspect its a UI bug, and will report it internally. To work around it, get out of the Hive View 2.0 and come back in and the property will be selectable again. When I tried just now, I just went back to the Ambari dashboard, waited it for the dashboard to load, then went back into the Hive View 2.0 and the property was again selectable for me to set. In the first screenshot, the values I've tried to select, did not update, and re-select are grey. In the second screenshot, ascreen-shot-2017-06-23-at-103601-am.pngfter going out and back into the Hive View 2.0, they are selectable again and able for me to set the execution engine to 'tez'. screen-shot-2017-06-23-at- 102625-am.png
... View more
06-23-2017
03:49 PM
@Sonu Sahi Finally got it. Thanks!
... View more
06-21-2017
04:03 PM
1 Kudo
Hi @Sami Ahmad Normally, master services can be spread across the master nodes to ensure proper resource allocation depending on the cluster. If you have two datanodes/worker nodes that you do not want to run master services on, then, no problem, just allocate the host you want and move on to the next step. In Ambari, you click on the Hosts tab to see what services are installed on what host, but, you may need to go through them host by host.
... View more
06-27-2017
04:29 PM
Hi @Vamsi N the "Files" view in Ambari Views is a file explorer for HDFS. You should see it in the dropdown for the views. If you don't see it under the Ambari account you are using, you can use the instructions that Jay has above to add an instance of the Files view.
... View more