I activated google analytics 4 bigquery linking, and it works correctly. I wonder what is the limitation of this link. Api metrics shows that link using api methods below.
google.cloud.bigquery.v2.JobService.GetJob
google.cloud.bigquery.v2.JobService.GetQueryResults
google.cloud.bigquery.v2.JobService.InsertJob
google.cloud.bigquery.v2.TableDataService.List
But I can't found the exact match API name on bigquery documents.
https://cloud.google.com/bigquery/quotas
https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs/insert?hl=ja
Any ideas?
Thanks.
The limit for how many hits you can export from the free version of GA4 to BigQuery is 1M hits per day.
Standard properties have a daily BigQuery Export limit of 1 million events. If your property consistently exceeds the export limit, the daily BigQuery export will be paused and previous days’ exports will not be reprocessed.
https://support.google.com/analytics/answer/9823238?hl=en#zippy=%2Cin-this-article
If you go above that, Google will stop your pipeline.
There are only two solutions to overcome this that I know of.
Upgrade to GA360
Use Parallel Tracking
Once you set up the link from GA360 to BigQuery, as far as I know, there is no limit to this link. According to the document, usually GA sends data 3 times a day to BigQuery. You will see partitioned table for GA data in BigQuery for each day. (This link is only available in Analytics 360, which is not free.)
For more information, refer to the official documents. support.google.com/analytics
Also, limits and quotas for BigQuery.
cloud.google.com/bigquery/quotas
About API names you listed appear here.
https://cloud.google.com/bigquery/docs/reference/auditlogs
Related
Currently, we have an app that uses Firebase, with Google Analytics enabled, and linked to BigQuery. The firebase account is on the Spark program.
In BigQuery, I can see the event-based schema, with fields around events and users and a few additional things like geo.
I am not sure what I need to do to get the session-related data in BigQuery, with things like session.visitId (found it referenced as part of ga_analytics_* table that I am missing). Does this require enabling the Blaze plan and export the google analytics data to BigQuery? Is this the reason why I am not seeing the session related fields in BigQuery?
If that is the case, what is the event-driven data model that I am currently seeing called in the Firebase context?
Firebase Export to BigQuery has a specific schema. In the docs the tables are in the form events_YYYYMMDD (this could be the event-driven data you asked for) and session.visitId is not listed as a field.
The field visitId seems to belong to Google Analytics BigQuery Export whose table is in the form ga_sessions_YYYYMMDD. Firebase docs specify that if your Firebase project is on the free Spark plan, you can link ... Google Analytics ... to the BigQuery sandbox, so, it should be feasible to access the ga tables in the sandbox. It is possible that an additional step is missing to get ga tables exported to BigQuery.
I am trying to build an application using Google Analytics real-time API. So, I see this quota limit at 50,000/project. I am aware of 10,000/Google Analytics View limit. So, based on these values, my application can handle only 5 users/day.
Am I doing something wrong? Is there any workaround for this?
Its 50,000 API calls per day to query your data, not for collecting data.
What is this 10,000 Google Analytics View limit you refer to? It is not listed on the GA quotas and limits page
There is a 10million hits per month limit per web property, if you go over that then they ask you pay for GA360
I have setup Firebase analytics data to BigQuery. However I received my first export today and it contains all yesterdays user statistics. That is great but I need lifetime statistics history or at least last month's data.
Do I already have access to my entire historic analytics data threw Big Query but I and I do not know how to access it? If so can you point to documentation or give a quick walk threw?
Is it even possible to get the full (or at least a longer period than a day) historic analytics data?
Bonus question: Can I directly access data that is used in Firebase analytics console? They should be feeding it with some API for some things I need aggregates would be sufficient. So is there http://analytics.firebase/data.json I could access while logged in to my Firebase account to save data to my machine?
firebaser here
Firebase Analytics does not expose the historical event level data. It only exposes aggregate information.
Complete event data is only available from the moment you enabled the BigQuery connection. No data from before that time will be added to BigQuery.
The data from the analytics reports that is shown in the Firebase Console is available through the Analytics Data API. See Is there any api for dashboard analytics data?
I've found some old resources on that:
Why is (other) Showing Up in My Reports?
Google Analytics daily URL limit: does it affect URL-sequence goal tracking?
Merging Google Analytics with your Data Warehouse
I haven't been able to find any official documentation.
Is this limit still actual?
Especially for gtag.js
The daily limit that i have heard of is around 2 hits per day anything more than that and Google starts to drop hits. The official limits can be found in the documentation below.
Directly from the documentation Limits and quotas
These limits apply to the Web Property / Property / Tracking ID.
10 million hits per month per property
If you go over this limit, the Google Analytics team might contact you and ask you upgrade to Analytics 360 or implement client sampling to reduce the amount of data being sent to Google Analytics.
For monthly total Analytics 360 limits, please contact your account manager or service representative.
The gtag.js appears to be the same doc
I have setup Firebase analytics data to BigQuery. However I received my first export today and it contains all yesterdays user statistics. That is great but I need lifetime statistics history or at least last month's data.
Do I already have access to my entire historic analytics data threw Big Query but I and I do not know how to access it? If so can you point to documentation or give a quick walk threw?
Is it even possible to get the full (or at least a longer period than a day) historic analytics data?
Bonus question: Can I directly access data that is used in Firebase analytics console? They should be feeding it with some API for some things I need aggregates would be sufficient. So is there http://analytics.firebase/data.json I could access while logged in to my Firebase account to save data to my machine?
firebaser here
Firebase Analytics does not expose the historical event level data. It only exposes aggregate information.
Complete event data is only available from the moment you enabled the BigQuery connection. No data from before that time will be added to BigQuery.
The data from the analytics reports that is shown in the Firebase Console is available through the Analytics Data API. See Is there any api for dashboard analytics data?