Welcome to the Cloudera Community
Your Enterprise Data Cloud Community. With over 74,600 members and 18,900 solutions, you've come to the right place!
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for
- Cloudera Community
- :
- Search
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
- « Previous
- Next »
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
60,000 results
Sorted by:
06-10-2019
10:38 PM
5 Kudos
Rising Star
Created on 06-10-2019 10:38 PM - edited 08-17-2019 02:15 PM
OBJECTIVE: Provide a quick-start guide for using the Jolt language within a NiFi JoltTransform (JoltTransformJSON or JoltTransformRecord). OVERVIEW: The NiFi JoltTransform uses the powerful Jo...
- Find more articles tagged with:
- Data Ingestion & Streaming
- FAQ
- jolt
- joltransformjson
- jolttransformrecord
- NiFi
Labels:
Show results in comments (4)
-
@peter1_biro [ { "operation": "shift", "spec": { "log": { ...
-
Hi @wcbdata Can you explain the usage of '#' in the spec you used above: { &nbs...
-
I really appreciated your work. I bookmarked this page.
-
Hello, thanks for perfect examples! What would be the jolt specification for this input/output lo...
Interacting with Hadoop HDFS using Python codes This post will go through the following:
Introducing python “subprocess” module Running HDFS commands with Python Examples of HDFS commands fro...
- Find more articles tagged with:
- code
- coding
- Data Processing
- HDFS
- How-ToTutorial
- Linux
- python
Labels:
Show results in comments (6)
-
Hi, Thank you for this great article and code snippets. its really useful. i just face one...
-
@wasiftanveer , As this is an old article, you would have a better chance of receiving a us...
-
@VidyaSargur Thank you for the response and the suggestion, i will create a new thread for my ...
-
Hi All. Here is all steps for doing same!!! Link :- https://www.oreilly.com/library/view/hadoop-...
-
It was an excellent article on interacting of Hadoop HDFS using Python to hear from you which is v...
-
Thanks for the comment Michael. I wrote these commands for hdp environments using standard python 2...
07-23-2020
01:49 PM
1 Kudo
Expert Contributor
Created on 07-23-2020 01:49 PM - edited 07-28-2020 11:48 AM
The Cloudera Data Platform (CDP) comes with a wide variety of tools that move data, these are the same in any cloud as well as on-premises. Though there is no formal decision tree, I will summarize ...
08-03-2020
05:41 PM
5 Kudos
Cloudera Employee
Created on 08-03-2020 05:41 PM - edited 08-06-2020 09:32 AM
Introduction Cloudera Data Platform DC doesn't have one Quickstart/Sandbox VM like the ones for CDH/HDP releases that helped a lot of people (including me), to learn more about the open-source comp...
Labels:
Show results in comments (5)
-
@carrossoni , when I open Cloudera Manager, it is taking me to the installation page. That mea...
-
Hi Akhil, It seems that the download wasn't completed and the host isn't in a health state...
-
Just tried to follow instructions and received the error below when I run Vagrant Up command. Any h...
-
Hi @AkhilTech , The primary problem is that the host isn't in health state, this is evalua...
-
@carrossoni , Thanks for the inputs. After checking the file /etc/cloudera-scm-agent/con...
This article describes various "recipes" on how to accomplish certain tasks with the NiFi processor ExecuteScript, with examples given in Groovy, Jython, Javascript (Nashorn), and JRuby. Recipes in t...
- Find more articles tagged with:
- Data Ingestion & Streaming
- executescript
- How-ToTutorial
- NiFi
Labels:
Show results in comments (9)
-
@mburgess this is just awesome! Thank you so much for this. I am trying to call a rest API vi...
-
You can call a REST API from Nashorn/Javascript in ExecuteScript, but since Nashorn doesn't have ac...
-
Awesome! just tested out... Works like a charm! Thank you so much... just in case if you have any r...
-
Extremely usefull examples. However, I'm not sure how to receive one flowfile but transfer several ...
-
@Matt Burgess I just wanted to clarify your 2 recipes for getting incoming flowfiles. The first men...
-
Thank you! Also just for interest's sake and hope you don't mind answering here, but when will you ...
-
Thanks, Matt. This is very informative.
-
Yes we currently build with JDK 8 so we get Nashorn "for free". This will be the case when building...
-
Hey Matt, great series of articles. I have learnt everything I know about ExecuteScript from here a...
08-16-2016
09:56 PM
20 Kudos
Super Guru
Created on
08-16-2016
09:56 PM
- edited on
02-12-2020
06:33 AM
by
SumitraMenon
NiFi is most effectively used as an "always-on" system, meaning that the data flows are often always operational (running). Doing batch processing is a more difficult task and usually requires some u...
- Find more articles tagged with:
- Data Ingestion & Streaming
- How-ToTutorial
- incremental
- NiFi
- nifi-processor
- querydatabasetable
- rdbms
Labels:
Show results in comments (9)
-
@mburgess , Could you please suggest how I can achieve the same with Cassandra. I tried to us...
-
Hi Matt, Is there a suggested way to perform incremental fetching when the columns increas...
-
Hi @mattburgess i am using the same processor for fetching incremental data from relational tables....
-
Thanks, Matt. Very informative for beginners like me.
-
You may use ExecuteSQL processor for that. You can write custom SQL query with that processor.
-
@Matt Burgess Really helpful!! But, I have a question By using this flow How we will get the upda...
-
Hi, is there any way to use this processor to check for a change in a specific record that may not ...
-
Thanks Matt , one more good article from you. If my nifi went down or processor stopped somehow. A...
-
This feature was added in NiFi 1.4.0 (NIFI-4257)
09-26-2016
03:05 PM
3 Kudos
Expert Contributor
Created on 09-26-2016 03:05 PM - edited 08-17-2019 09:36 AM
Controlling the environment of an application is vital for it's
functionality and stability. Especially in a distributed environment it
is important for developers to have control over the version ...
- Find more articles tagged with:
- conda
- Data Processing
- How-ToTutorial
- pyspark
- Spark
Labels:
Show results in comments (4)
-
Thanks for this great tutorial and I got your tutorial mostly working. However, the Python workers ...
-
Hi @hkropp I followed your post and when I trigger my spark-submit and the application is accepted ...
-
Hello thank you so much for this post it is awesome as we could ship any version of python interpre...
-
Hi, I've tried your article with a simpler example using HDP2.4.x. Instead of NLTK, I created a sim...
Objective This tutorial will walk you through the process of using the PyHive Python module from Dropbox to query HiveServer2. You can read more about PyHive here: PyHive Prerequisites
You sho...
- Find more articles tagged with:
- Hive
- How-ToTutorial
- python
- Sandbox
- Sandbox & Learning
- tableau
Labels:
Show results in comments (5)
-
Can I use pyhive to connect to Hive using Hive JDBC string instead of a single hostname? The follow...
-
Hive doesn't use thrift anymore. new Python APIs work fine. https://github.com...
-
Hi @TimothySpann , Could you please let me know if you was able to resolve issue, since I ...
-
Login with username
-
Great article...BUT...this only seems to work for small queries "show databases", "show tables", "S...
Synopsis This tutorial will demonstrate using Spark for data processing operations on a large set of data consisting of pipe delimited text files. Delimited text files are a common format seen in Da...
- Find more articles tagged with:
- Data Science & Advanced Analytics
- DataFrame
- How-ToTutorial
- pyspark
- rdd
- SparkSQL
Labels:
Show results in comments (4)
-
Is the input dataset available somewhere?
-
Is this still valid? I mean there are many improvements on spark-sql & catalyst engine since sp...
-
can we say this difference is only due to the conversion from RDD to dataframe ? because as per ap...
-
Very interesting, but I think it'd have been as more even comparision if you'd have used SparkSQL c...
09-04-2019
11:47 AM
2 Kudos
Super Guru
Created on 09-04-2019 11:47 AM - edited 09-04-2019 01:53 PM
My Kubernetes series (Part1, Part2) was strictly focused on MiNiFi on K8S. NiFi and MiNiFi may communicate over Site 2 Site; however, often the pattern is to...
Labels:
