When I try to search for historical data for events on BigQuery I can only find events from the last week. I couldn't find anywhere the information if this is correct, or if I am doing something wrong. Basically it seems that I can only query events_YYYYMMDD from the past week. Is this correct?
Did you by any chance enable the BigQuery export from Firebase a week ago?
Keep in mind: Firebase will only write to BigQuery that it receives from the moment you enable the integration. It won't write historical data.
Related
I connected my Firebase Project to Google BigQuery in order to access the raw event data, create custom queries and display them in Google DataStudio.
Everything works like a charm.
However, in BigQuery I can only see 2 weeks of data in the database.
I expected that I would have all the data from the first day since I turned on this integration.
I did not find anything about this 2 weeks limitation. Did I miss something in the documentation? Is it possible having in BigQuery not just 2 weeks but all data beginning from the first day of the integration?
Bigquery event data
Data from Firebase Analytics starts uploading into BigQuery the day you enable the connection between both.
So the answer is no, you did not miss anything in the documentation and you only have the data from the day you activated it. And there is not way of uploading the historic afterwards.
I activated google analytics 4 bigquery linking, and it works correctly. I wonder what is the limitation of this link. Api metrics shows that link using api methods below.
google.cloud.bigquery.v2.JobService.GetJob
google.cloud.bigquery.v2.JobService.GetQueryResults
google.cloud.bigquery.v2.JobService.InsertJob
google.cloud.bigquery.v2.TableDataService.List
But I can't found the exact match API name on bigquery documents.
https://cloud.google.com/bigquery/quotas
https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs/insert?hl=ja
Any ideas?
Thanks.
The limit for how many hits you can export from the free version of GA4 to BigQuery is 1M hits per day.
Standard properties have a daily BigQuery Export limit of 1 million events. If your property consistently exceeds the export limit, the daily BigQuery export will be paused and previous days’ exports will not be reprocessed.
https://support.google.com/analytics/answer/9823238?hl=en#zippy=%2Cin-this-article
If you go above that, Google will stop your pipeline.
There are only two solutions to overcome this that I know of.
Upgrade to GA360
Use Parallel Tracking
Once you set up the link from GA360 to BigQuery, as far as I know, there is no limit to this link. According to the document, usually GA sends data 3 times a day to BigQuery. You will see partitioned table for GA data in BigQuery for each day. (This link is only available in Analytics 360, which is not free.)
For more information, refer to the official documents. support.google.com/analytics
Also, limits and quotas for BigQuery.
cloud.google.com/bigquery/quotas
About API names you listed appear here.
https://cloud.google.com/bigquery/docs/reference/auditlogs
I have setup Firebase analytics data to BigQuery. However I received my first export today and it contains all yesterdays user statistics. That is great but I need lifetime statistics history or at least last month's data.
Do I already have access to my entire historic analytics data threw Big Query but I and I do not know how to access it? If so can you point to documentation or give a quick walk threw?
Is it even possible to get the full (or at least a longer period than a day) historic analytics data?
Bonus question: Can I directly access data that is used in Firebase analytics console? They should be feeding it with some API for some things I need aggregates would be sufficient. So is there http://analytics.firebase/data.json I could access while logged in to my Firebase account to save data to my machine?
firebaser here
Firebase Analytics does not expose the historical event level data. It only exposes aggregate information.
Complete event data is only available from the moment you enabled the BigQuery connection. No data from before that time will be added to BigQuery.
The data from the analytics reports that is shown in the Firebase Console is available through the Analytics Data API. See Is there any api for dashboard analytics data?
I know that we can link the Firebase analytics to BigQuery to run our own custom analytics on the current data. But what about historical data. Is there any way to get the historical event data.
Data from Firebase to Big Query is not retroactive. The point in time since the linkage was established would only be available in Big Query.
Historical data before that would be available in Firebase Console for analysis.
I have setup Firebase analytics data to BigQuery. However I received my first export today and it contains all yesterdays user statistics. That is great but I need lifetime statistics history or at least last month's data.
Do I already have access to my entire historic analytics data threw Big Query but I and I do not know how to access it? If so can you point to documentation or give a quick walk threw?
Is it even possible to get the full (or at least a longer period than a day) historic analytics data?
Bonus question: Can I directly access data that is used in Firebase analytics console? They should be feeding it with some API for some things I need aggregates would be sufficient. So is there http://analytics.firebase/data.json I could access while logged in to my Firebase account to save data to my machine?
firebaser here
Firebase Analytics does not expose the historical event level data. It only exposes aggregate information.
Complete event data is only available from the moment you enabled the BigQuery connection. No data from before that time will be added to BigQuery.
The data from the analytics reports that is shown in the Firebase Console is available through the Analytics Data API. See Is there any api for dashboard analytics data?