Member since
06-03-2019
7
Posts
0
Kudos Received
0
Solutions
07-15-2020
01:38 AM
@MattWho Your guide was really helpful and it worked well. However, I think there is some problems if "Full Path" has deeper hierarchy. Firstly, I set full path like below. aa/bb/cc/dd/ It created only one flow file which was "dd", of course its type was a directory. I removed "dd" and set a dir filter and file filter to get files only I wanted. After changed full path from "aa/bb/cc/dd" to "aa/bb/cc", it made all flow file information under the cc directory. Thanks for your advice. Cheers.
... View more
06-25-2019
02:00 PM
1 Kudo
@Juhyeon Yun Configure directory as /user/paxata/job and keep recursive sub directories to true will list all the files in the sub directories. Similar question reported in this HCC thread.
... View more
06-03-2019
07:06 PM
Hi Ben, Appreciate your quick and kind response. I have one more question. After reading your answer, I've started to develope using "time-seriese" api. During programming, I found a problem with data before about 30 days. I'd like to obtain a every single minute's data of whole period but, It might be only available every 10 minute's( or longer) data set when I tried to get old resource data. I used this api below. Could you help me know how to get every single minute's such as, cpu/mem usage ? import time import datetime api_instance = cm_client.TimeSeriesResourceApi(api_client) from_time = datetime.datetime.fromtimestamp(time.time() - 7776000) to_time = datetime.datetime.fromtimestamp(time.time()) query = "select cpu_user_rate "\ " where entityname = 'xx' " # Retrieve time-series data from the Cloudera Manager (CM) time-series data store using a tsquery. result = api_instance.query_time_series(_from=from_time, query=query, to=to_time)#, desired_rollup='RAW', must_use_desired_rollup = 'true') ts_list = result.items[0] for ts in ts_list.time_series: print (ts.metadata.attributes['entityName'], ts.metadata.metric_name) for point in ts.data: print (point.timestamp, point.value) Appreciate your response. Ben,
... View more