Member since
11-16-2015
905
Posts
666
Kudos Received
249
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 489 | 09-30-2025 05:23 AM | |
| 809 | 06-26-2025 01:21 PM | |
| 741 | 06-19-2025 02:48 PM | |
| 912 | 05-30-2025 01:53 PM | |
| 11643 | 02-22-2024 12:38 PM |
03-26-2018
03:28 PM
No, you'd have to use ExecuteStreamCommand or ExecuteProcess for things like Anaconda environments, non-pure (CPython) modules, etc.
... View more
03-21-2018
01:36 PM
1 Kudo
You should be able to use UpdateAttribute with ExpressionLanguage (probably the ifElse() function along with isNull()) in order to set http.headers.orgId to http.headers.OrgID if it is not already populated. Then you can keep the JOLT spec as-is.
... View more
03-13-2018
07:55 PM
JOLT can be fairly complicated. In this case the * on the left is a non-greedy match, the &(x,y) on the right is to grab the individual pieces.
... View more
03-13-2018
05:12 PM
3 Kudos
You can use the following JOLT spec in the JoltTransformJSON processor: [
{
"operation": "shift",
"spec": {
"*-*-*": "&(0,1)_&(0,2)_&(0,3)",
"*-*": "&(0,1)_&(0,2)",
"*": "&"
}
}
] Note that you have to add an entry for each "level" of name matching, so if you could have elements with 4 dashes, you'd need an extra line at the top, following the same pattern.
... View more
03-09-2018
02:34 PM
2 Kudos
I think you can provide a core-site.xml that refers to a local filesystem as the default FS rather than an HDFS file system by setting the fs.default.name property to file:/// (see the answer on this SO post for more details).
... View more
03-07-2018
03:05 PM
1 Kudo
Will it always be the same ctl file? If so then you could use LookupAttribute to add attributes from the ctl file based on some key (like ID). Alternatively, you could read in a ctl file, extract the values to attributes, then set the filename attribute to 2.txt and use FetchFile to get 2.txt into the flow file's content (and the ctl attributes should remain in the flow file). Selective merging is IMO not a "natural" operation in a flow-based paradigm. It can be accomplished with something like ExecuteScript, but hopefully one of the above options would work better for your use case.
... View more
03-06-2018
06:14 PM
1 Kudo
The default filename is the timestamp when they were created, so since they are created quickly I'm not totally surprised they have the same filename. However you can use the flow file's UUID as the filename, that is guaranteed to be unique. You can set the filename with an UpdateAttribute processor, add a user-defined property with key "filename" and value "${UUID()}".
... View more
03-05-2018
04:44 PM
What line gives that error? I tried the original script and just added the toString(), and it worked fine.
... View more
03-05-2018
04:03 PM
Looks like you are referring to the script provided in this SO post. The variable createTable is a GString, not a Java String. This causes invocation of Sql.execute(GString), which converts the embedded expressions into parameters, and you can't use a parameter for a table name. Use the following instead:
SQL.mydb.execute(createTable.toString()) This will cause the invocation of Sql.execute(String), which does not try to parameterize the statement.
... View more
03-05-2018
02:57 PM
1 Kudo
The underlying Hosebird library that GetTwitter uses to interface with the Twitter REST API does not yet support the extended tweets. Unfortunately, it also looks like the project is not very active so I'm not sure we'd see that capability added anytime soon.
... View more