After setting the flume agent with http-source type and sink as hdfs. I am doing some get and post requests using the url of my flume source ( http-source).
>>> import json
>>> b={'a':'b'}
>>> a=json.dumps(b)
>>> a
'{"a": "b"}'
>>> res=requests.post('http://hdp.localdomain:41414',data=a)
>>> res.status_code
400
>>> res=requests.get('http://hdp.localdomain:41414')
>>> res.status_code
500
But i am not getting ok status_code for my requests. I have two question. One is the url of the flume source correct().
http://hdp.localdomain:41414
hostname:portnumber. The port is defined in the agent configuration. The agent log shows its running oki.
2nd question is how should i know what type of data i can pass. In the above i passed a as a json. Due to these issue i cannot see anything on the sink.
I am really stuck here. I dont know where is the deadlock