If you know how to split it up, you can split the file into others and route each file to its own PutSQL processor. https://community.hortonworks.com/questions/48492/split-data-into-multiple-files-using-nifi-based-on.html ... View more

Hi @M R I don't believe those components are included in Hortonworks Data Flow out of the box. The release notes in the documentation outline exactly what products (and versions) are supported in HDF. Here is a link for you: https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.0.1/bk_release-notes/content/ch_hdf_relnotes.html ... View more

hi @rama Typically, the variable would be defined somewhere earlier in the script that contains the query, or in the CLI, with a SET statement. Something like: SET TB_MASTER=table_name; If you don't see where it was defined, then you would most likely be guessing from the total databases and tables within your system. If the system is very small, that might be feasible. You can use the "show databases" command to list the databases. If you see one that makes sense, you can issue a "use <database_name>" command and then issue a "show tables" to view the list of table names that exist within that Hive database. Here are some links on Hive variables and how they work. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+VariableSubstitution#LanguageManualVariableSubstitution-UsingVariables https://community.hortonworks.com/articles/60309/working-with-variables-in-hive-hive-shell-and-beel.html ... View more

@Dhiraj As far as I am aware, if your local users exist before the LDAP synch, they should still work though Ranger supports only one source. See the following link for a bit more detail: https://community.hortonworks.com/questions/87388/how-to-sync-users-and-groups-from-both-ldap-and-un.html ... View more

Hi @Hardik Dave Cluster sizing and planning would require much more detail and in-depth conversation about the use case, the data sizing, etc. A good guide that can help you down the path of sizing your cluster can be found here: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cluster-planning/bk_cluster-planning.pdf I would suggest using Ambari to manage your cluster where the memory allocation and settings/config will be much more visible in the UI for each technology/service being used in your cluster. ... View more

hi @Sahil Jindal Please check your first post on this topic. ... View more