Welcome to the Cloudera Community
Your Enterprise Data Cloud Community. With over 64,100 members and 18,000 solutions, you've come to the right place!
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for
- Cloudera Community
- :
- Search
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
- « Previous
- Next »
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
50,000 results
Sorted by:
06-10-2019
10:38 PM
5 Kudos
Rising Star
Created on 06-10-2019 10:38 PM - edited 08-17-2019 02:15 PM
OBJECTIVE: Provide a quick-start guide for using the Jolt language within a NiFi JoltTransform (JoltTransformJSON or JoltTransformRecord). OVERVIEW: The NiFi JoltTransform uses the powerful Jo...
- Find more articles tagged with:
- Data Ingestion & Streaming
- FAQ
- jolt
- joltransformjson
- jolttransformrecord
- NiFi
Labels:
Objective
With the release of NiFi Registry 0.2.0, flow contents can now be stored under a Git directory using the new
GitFlowPersistenceProvider .
This tutorial walks you through how to ...
- Find more articles tagged with:
- apache-nifi
- Data Ingestion & Streaming
- git
- How-ToTutorial
- registry
- version
Labels:
Show results in comments (5)
-
@alim I am trying to configure git with the NIFI registry installation on windows(runnin...
-
Hi @Andrew Lim thank you for this detailed and step-by-step information, exactly what I was lookin...
-
Hi, Let's pretend that I'm being forced against my will to run Nifi on Windows. The registry isn't ...
-
Hi, let me advertise an option for git clone using git+ssh. I have put together a Docker image whi...
-
@Marshal Tito, I think you can. I just did on GitLab. Those access tokens are used by all those hos...
11-27-2019
08:58 AM
1 Kudo
Cloudera Employee
Created on 11-27-2019 08:58 AM - edited 11-28-2019 10:19 PM
Traditional Prometheus Architecture Prometheus is great. It has a huge number of integrations and provides a great metric monitoring platform, especially when working with Kubernetes. How...
- Find more articles tagged with:
- NiFi
- nifi-processor
- nifi-templates
Labels:
Objective
This tutorial walks you through the process of using the CaptureChangeMySQL, EnforceOrder and PutDatabaseRecord processors in Apache NiFi to replicate a database using MySQL event logs. ...
- Find more articles tagged with:
- apache-nifi
- cdc
- Data Ingestion & Streaming
- How-ToTutorial
- MySQL
Labels:
Show results in comments (8)
-
Can we do similar with postgres CDC, MS SQL SERVER CDC using CaptureChangeMySQL processor ?
-
@Andrew Lim ,I am getting the below log from the path C:\Users\XXXXX\Desktop\Work_past\nifi-1.9....
-
I'm following this article, everything works fine but I need to fetch data from large database, Eve...
-
NiFi doesn't currently support MS SQL, but it appears there is a NiFi contributor who has it in the...
-
We need to read sql server transnational logs for CDC instead of hitting DB using jdbc . Is that po...
-
@Ramkrishna Utpat, That's great to hear! Glad you were able to get the tutorial working.
-
Hello @Andrew Lim, Thanks for the solution and the documentation you have created. It is really g...
-
Hi @Ramkrishna Utpat I was able to upload the template using Chrome as my browser and NiFi 1.5.0. ...
Short Description: This article targets to describe and demonstrate Apache Hive Warehouse Connector which is a newer generation to read and write data between Apache Spark and Apache Hive. 1. Motiva...
- Find more articles tagged with:
- Data Processing
- Hive
- How-ToTutorial
- llap
- Spark
- spark-sql
- structured-streaming
Labels:
Show results in comments (7)
-
Hi guys, i followed the above steps, and was able to execute commands like ( show databases, show...
-
Continued previous post: at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructo...
-
Thank you for posting this very informative Hive Warehouse Connector article. I followed your step...
-
Hi Hyukjin Kwon and thank you for your article! I'm trying to write to MongoDB, using spark, a Dat...
-
How to save a table using HWC of a dataframe with hundred columns. This seems very impractical. v...
-
Thanks, very helpful.
-
Great article !!!
04-21-2017
07:23 PM
3 Kudos
Master Guru
Created on 04-21-2017 07:23 PM - edited 08-17-2019 01:17 PM
Note: This article was written as of HDF 2.1.2 release which is based off Apache NiFi 1.1.0. NiFi has several processors that can be used to retrieve FlowFiles from a SFTP server. It is important to...
- Find more articles tagged with:
- Data Ingestion & Streaming
- How-ToTutorial
- NiFi
- nifi-processor
- sftp
Labels:
08-23-2016
09:51 AM
14 Kudos
Contributor
Created on 08-23-2016 09:51 AM - edited 08-17-2019 10:40 AM
Introduction Apache NiFi 1.0 was recently released
and being integrated into Hortonworks Data Flow (HDF) that will be release very
soon. In this easy tutorial we will see how
we can stream data fro...
- Find more articles tagged with:
- Data Ingestion & Streaming
- Hive
- hive-streaming
- How-ToTutorial
- ingestion
- NiFi
- nifi-streaming
- olympics
- streaming
Labels:
Show results in comments (8)
-
hi @nshawa, I am having the following error on PutHiveStreaming processor after running the t...
-
Even if its possible, doesn't makes sense to make an external table, transactional. External Table ...
-
Hi, Nice article.. ORC Table created, but the flow was configured for Avro.. I'm little confused he...
-
Yes, its possible. Alter table <table_name> set tblproperties ('transactional'='true');
-
Thanks for the nice explanation Ned. When I have created the flow, NiFi processor is able to store...
-
how can you set transactional'='true' for external table in hive? I dont think its possible.
-
Hi Ned, This is a great example over NiFi data flow. I have faced below issue while testing the sam...
-
@Ned Shawa please suggest if HIVE needs to be started with ACID and compactor on? or any other pr...
One of the first cases we get to see with Hbase is loading it up with Data, most of the time we will have some sort of data in some format like CSV availalble and we would like to load it in Hbase, l...
- Find more articles tagged with:
- csv
- Data Processing
- HBase
- how-to-tutorial
- import
- loadtsv
- ned
Labels:
Show results in comments (5)
-
This is not an hbase shell command, we just need to run as a command from Unix (or Windows) sh...
-
I am unable to load my data in HBase with this command, I get the following error SyntaxError: (hb...
-
@Ned Shawa I tried to follow the example above to import a csv file named drivers. hbase(main):001...
-
Hi Ned, I have this following csv file with me- userId,prodId,rating,Date:M,Date:D,Date:Y,Help:a,...
-
Hi, I am using Apache Hbase (Version 1.1.3) I used the same importtsv syntax to import the same ...
04-02-2016
12:22 AM
12 Kudos
New Contributor
Created on 04-02-2016 12:22 AM - edited 08-17-2019 12:53 PM
Step 1 : Log into AWS your credentials Step 2 : From the AWS console go to the following options and create a user in for the demo in AWS Security & Identity --> Identity and Access Manageme...
- Find more articles tagged with:
- aws
- Cloud & Operations
- Hive
- How-ToTutorial
- Pig
- S3
Labels:
Show results in comments (6)
-
How to take care of the s3 user level permissions if the user does following? Can we leverage range...
-
newbie question: I don't know how I add a user in the hadoop environment ( Step 8 above) ? Can so...
-
S3N is deprecated in newer versions of Hadoop, so it's better to use s3a. To use s3a, specify s3a:/...
-
I have a question about accessing multiple AWS S3 buckets of different accounts in Hive. I have se...
-
Thank you! The above posts are very helpful. I have a question on S3 access. Please help me on t...
-
Hi, Thanks much for the step by step information to access aws s3 files from Hadoop. I followed t...
Objective
This tutorial walks you through a NiFI flow that utilizes the
ConvertRecord processor and Record Reader/Writer controller services to easily convert a CVS file into JSON format. Addit...
- Find more articles tagged with:
- apache-nifi
- Avro
- csv
- Data Ingestion & Streaming
- How-ToTutorial
- json
- xml
Labels:
Show results in comments (5)
-
Hi @Andrew Lim , Thanks for a detailed explaination. Following your article i am trying to convert ...
-
NiFi 1.7.0 introduced XML Record Reader/Writers. So CSV to XML conversion using a ConvertRecord pr...
-
If you are using Apache NiFi 1.5.0, the script body used for the CSV to XML conversion needs to be ...
-
Hi @Surendra Shringi, Probably best to post a new question on HCC for your issue. I'm not sure ho...
-
Hi @Andrew Lim I am having problem in Nifi data flow. How to resolve this pls guide me . I have ...
