https://community.cloudera.com/t5/Support-Questions/How-to-use-Google-Analytics-API-to-import-data-to/m-p/153635#M116093 <P>How to to use Google Analytics API to import data in hadoop file system? Is there a tool that can interact directly with the API and import data to the warehouse or Do I need to write programs for it? Could someone please point me to an example that shows import of data from Google Analytics to HDFS, more precisely to hive ?</P> Fri, 16 Sep 2022 10:20:28 GMT simran_k 2022-09-16T10:20:28Z https://community.cloudera.com/t5/Support-Questions/How-to-use-Google-Analytics-API-to-import-data-to/m-p/153635#M116093 <P>How to to use Google Analytics API to import data in hadoop file system? Is there a tool that can interact directly with the API and import data to the warehouse or Do I need to write programs for it? Could someone please point me to an example that shows import of data from Google Analytics to HDFS, more precisely to hive ?</P> Fri, 16 Sep 2022 10:20:28 GMT https://community.cloudera.com/t5/Support-Questions/How-to-use-Google-Analytics-API-to-import-data-to/m-p/153635#M116093 simran_k 2022-09-16T10:20:28Z https://community.cloudera.com/t5/Support-Questions/How-to-use-Google-Analytics-API-to-import-data-to/m-p/153636#M116094 <P>Sounds like <A href="https://community.hortonworks.com/questions/33961/how-to-import-data-return-by-google-analytic-s-api.html" target="_blank">https://community.hortonworks.com/questions/33961/how-to-import-data-return-by-google-analytic-s-api.html</A> was a repost of this earlier question. I provided my (more generic) answer over there, but maybe someone has a more specific response tied directly to Google Analytics and Hadoop. Good luck!</P> Wed, 18 May 2016 21:03:38 GMT https://community.cloudera.com/t5/Support-Questions/How-to-use-Google-Analytics-API-to-import-data-to/m-p/153636#M116094 LesterMartin 2016-05-18T21:03:38Z https://community.cloudera.com/t5/Support-Questions/How-to-use-Google-Analytics-API-to-import-data-to/m-p/153637#M116095 <P>We kind of built a data warehouse around the same idea that you have talked about in your article. </P><P>Integrating Salesforce and Google analytics as data-warehouse @infocaptor <A href="http://www.infocaptor.com" target="_blank">http://www.infocaptor.com</A></P><P>The benefit is you can also co-relate with your financial data When you design using GA api, you need to load the initial historical data for a certain date range. This has its own complications as you might run into segmentation issues, loss of data etc. You need to handle pagination etc. </P><P>Once the initial data load is complete, you then run it in incremental mode where you just bring new data only. This data gets appended to the same Data warehouse tables and does not cause duplicate with overlapping dates. The minimum you would need to design is some kind of background daemon that runs everyday or at some frequency. </P><P>You will need job tables to monitor the success and failure of the extracts so that it can resume from where the error occurred. </P><P>Some of the other considerations </P><P>1. What happens if you run the extract for the same data range </P><P>2. What if a job fails for certain dates It is important to set your primary keys for your DW target tables.</P><P>The extracted data is stored as CSV files and these can be easily pushed to Hadoop file system.</P> Sat, 21 Jan 2017 01:41:57 GMT https://community.cloudera.com/t5/Support-Questions/How-to-use-Google-Analytics-API-to-import-data-to/m-p/153637#M116095 contact 2017-01-21T01:41:57Z