Welcome to the Cloudera Community
Your Enterprise Data Cloud Community. With over 62,400 members and 17,800 solutions, you've come to the right place!
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for
- Cloudera Community
- :
- Search
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
- « Previous
- Next »
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
50,000 results
Sorted by:
This article describes various "recipes" on how to accomplish certain tasks with the NiFi processor ExecuteScript, with examples given in Groovy, Jython, Javascript (Nashorn), and JRuby. Recipes in t...
- Find more articles tagged with:
- Data Ingestion & Streaming
- executescript
- How-ToTutorial
- NiFi
Labels:
Show results in comments (8)
-
Extremely usefull examples. However, I'm not sure how to receive one flowfile but transfer several ...
-
@Matt Burgess I just wanted to clarify your 2 recipes for getting incoming flowfiles. The first men...
-
Thank you! Also just for interest's sake and hope you don't mind answering here, but when will you ...
-
Thanks, Matt. This is very informative.
-
Yes we currently build with JDK 8 so we get Nashorn "for free". This will be the case when building...
-
Hey Matt, great series of articles. I have learnt everything I know about ExecuteScript from here a...
-
IIRC Jython returns the last thing evaluated, so you shouldn't need a "return" statement? Also the ...
-
hi Matt, thank you for the tutorial-series. can you maybe show an example how to return in Jython?...
Summary
The purpose of this article is to assist you in starting up your Cloudera Quickstart Virtual Machine once you have downloaded it.
Applies To
Quickstart VM 5.5...
- Find more articles tagged with:
- Hadoop 101
Show results in comments (8)
-
Hi! My laptop is already running on Ubuntu. So, I feel downloading the VM would be redundant. Howev...
-
Hi dave. In this case I would suggest starting a new thread in the Hadoop 101 area. It may end up b...
-
I have just downloaded the Quickstart 5.12.0 and all appears to be working well except - I cannot ...
-
Once installation is done how to start CDH 5 default (4 Gb RAM required) VM? I can see the ic...
-
problems with vm on virtual box - mac. posted as new topic - virtual-box-quic...
-
I have to switch to VMWare image(cloudera-quickstart-vm-5.7.0-0-vmware), and run the VM with VMWare...
-
Hi, I have a thinkpad w520 installed with Windows 10(64bit) as Host OS, I am able to run Debian Li...
-
Thanks for the info,cjervis! I did it a different way yesterday: I clicked on the "new bottom" a...
How to Submit Spark Application through Livy REST API Apache Livy supports using REST APIs to submit Spark applications, it is quite similar to use “spark-submit” in vanilla Spark. In this article w...
- Find more articles tagged with:
- Data Science & Advanced Analytics
- How-ToTutorial
- livy
- Spark
- zeppelin
Labels:
Show results in comments (4)
-
@sshao am submitting spark job through livy , below are my conf parameters data = {'kind': 'pyspar...
-
hi i have exception java.io.FileNotFoundException 2019-06-01 00:43:19,160 WARN util.NativeCodeLoad...
-
I am newer in BigData, i have tried to call spark jobs with apache Livy . With submit command line ...
-
This is great thanks! Also, before too long there should be a NiFi processor and controller service...
This article describes various "recipes" on how to accomplish certain tasks with the NiFi processor ExecuteScript, with examples given in Groovy, Jython, Javascript (Nashorn), and JRuby. This is Part...
- Find more articles tagged with:
- Data Ingestion & Streaming
- executescript
- How-ToTutorial
- NiFi
Labels:
Show results in comments (8)
-
Hi, Matt! very useful and informative articles. Thank you veru much! Could you tell me how do I r...
-
The formatting on this Article that folks in previous comments were complaining about (at least sin...
-
I found an old version somewhere else: https://web.archive.org/web/20190102224526/https://communit...
-
There seems to be some formatting error in the code snippets however, making it hard to read? Can ...
-
Also I'm pretty sure I wasn't having this problem over the weekend
-
Hey Matt, I think something is going wrong with the rendering of this page, perhaps it's just on my...
-
I have an issue with Nifi v1.6 i was trying to write small python script inside ExecuteScript proce...
-
formatting bug seems to be back. Please fix
Short Description: This article targets to describe and demonstrate Apache Hive Warehouse Connector which is a newer generation to read and write data between Apache Spark and Apache Hive. 1. Motiva...
- Find more articles tagged with:
- Data Processing
- Hive
- How-ToTutorial
- llap
- Spark
- spark-sql
- structured-streaming
Labels:
Show results in comments (7)
-
Hi guys, i followed the above steps, and was able to execute commands like ( show databases, show...
-
Continued previous post: at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructo...
-
Thank you for posting this very informative Hive Warehouse Connector article. I followed your step...
-
Hi Hyukjin Kwon and thank you for your article! I'm trying to write to MongoDB, using spark, a Dat...
-
How to save a table using HWC of a dataframe with hundred columns. This seems very impractical. v...
-
Thanks, very helpful.
-
Great article !!!
05-21-2016
08:35 AM
Guru
Created on 05-21-2016 08:35 AM
The key thing to remember is that in Spark RDD/DF are immutable. So once created you can not change them. However there are many situation where you want the column type to be different. E.g By def...
- Find more articles tagged with:
- Data Science & Advanced Analytics
- Issue Resolution
- issue-resolution
- Spark
- spark-sql
- SparkSQL
- zeppelin
Labels:
Show results in comments (3)
-
I am also looking for something like this. I need to convert all my date datatypes to varchar in a ...
-
Nice article. I am looking for a solution, Instead of specifying a each column separately. is there...
-
Hi, Its not working for me ..Unable to cast the column data type.Here is my code.I am getting only...
09-04-2019
11:47 AM
2 Kudos
Super Guru
Created on 09-04-2019 11:47 AM - edited 09-04-2019 01:53 PM
My Kubernetes series (Part1, Part2) was strictly focused on MiNiFi on K8S. NiFi and MiNiFi may communicate over Site 2 Site; however, often the pattern is to...
Labels:
In NiFi the data being passed between operators is referred to as a FlowFile and can be accessed via various scripting languages in the ExecuteScript operator. In order to access the data in the Flo...
- Find more articles tagged with:
- Data Ingestion & Streaming
- How-ToTutorial
- json
- NiFi
- python
Labels:
Show results in comments (8)
-
Thank you @Vasilis Vagias
-
Hello @Vasilis Vagias, some other tutorials state that "NOTE: ExecuteScript will perform a session....
-
@Vasilis Vagias I am trying to create a data flow with nifi using python scripts. To begin the proc...
-
Hi @Vasilis Vagias Great article. I am scraping facebook page contents using python and want to u...
-
In the example above, ExecuteScript Processor is showing some error and write is zero bytes from it...
-
Hi, My flowFile seems to be null although its being generated in a previous GetFile processor. Cre...
-
It looks like flowFile.get() is in a method in a class All that script does is define a class and e...
-
Hi We are experiencing trouble in flowFile = session.write(flowFile, ModJSON()) that line. javax....
Objective
With the release of NiFi Registry 0.2.0, flow contents can now be stored under a Git directory using the new
GitFlowPersistenceProvider .
This tutorial walks you through how to ...
- Find more articles tagged with:
- apache-nifi
- Data Ingestion & Streaming
- git
- How-ToTutorial
- registry
- version
Labels:
Show results in comments (5)
-
@alim I am trying to configure git with the NIFI registry installation on windows(runnin...
-
Hi @Andrew Lim thank you for this detailed and step-by-step information, exactly what I was lookin...
-
Hi, Let's pretend that I'm being forced against my will to run Nifi on Windows. The registry isn't ...
-
Hi, let me advertise an option for git clone using git+ssh. I have put together a Docker image whi...
-
@Marshal Tito, I think you can. I just did on GitLab. Those access tokens are used by all those hos...
06-10-2019
10:38 PM
5 Kudos
Rising Star
Created on 06-10-2019 10:38 PM - edited 08-17-2019 02:15 PM
OBJECTIVE: Provide a quick-start guide for using the Jolt language within a NiFi JoltTransform (JoltTransformJSON or JoltTransformRecord). OVERVIEW: The NiFi JoltTransform uses the powerful Jo...
- Find more articles tagged with:
- Data Ingestion & Streaming
- FAQ
- jolt
- joltransformjson
- jolttransformrecord
- NiFi
Labels:
