If the different types of files are in different directories in HDFS, for example, you can use Expression Language to set the values for fragment.index and metric, using a single ListHDFS -> FetchHDFS -> UpdateAttribute.   The expression below sets the value for metric according to the path where the file came from:   ${path:equals("/tmp/input/dir1"):ifElse("a", ${path:equals("/tmp/input/dir2"):ifElse("b", ${path:equals("/tmp/input/dir3"):ifElse("c", ${path:equals("/tmp/input/dir4"):ifElse("d", ${path:equals("/tmp/input/dir5"):ifElse("e", ${path:equals("/tmp/input/dir6"):ifElse("f", "other")})})})})})}   You can do the same for fragment.index.   ... View more

How do you differentiate the files in HDFS? Are they in different directories? Have different filenames? ... View more

Are all the files similar and you assign the fragment indexes in a round robin fashion? (1,2,3,4,5,6,1,2,3,...) Or do the different index numbers identify different types of files? When you merge, can you merge as many files as possible or do they always need to be merged 6 by 6? Can you give an example of how you are going to use the index in the QueryRecord processor? ... View more

Which steps did you take to enable Kerberos? Did you use the wizard in Cloudera Manager?   How many nodes does your cluster have? Which node are you running these commands from? Have you tried from others nodes (e.g have you tried from the Name node host?) ... View more

Try changing udp_preference_limit to 1 in the krb5.conf file on all the hosts and restart your cluster.   Also notice that you have a typo in that parameter's name. The correct is udp_preference_limit and not udp_prefrence_limit. ... View more

Thanks! ... View more

This looks like your HDFS service is misconfigured. Are you using CDP or open-source HDFS? Could you please share your HDFS configuration, specifically the properties that you set to enable Kerberos?   André   ... View more

Thanks. The context of it is much clearer now. Could you also provide a screenshot of the Login Credentials page of the wizard? ... View more