Having a problem where Datorama data streams connected to Google Analytics are failing due to '403: User Rate Limit Exceeded' - we have attempted to spread the credential load across different accounts but had no success with that.
Reading this article - Limits and quotas a fix is to increase the quota from 100 to 1000 requests per 100 seconds in Google Cloud Platform.
Needing some guidance on how to set up the API connection in Google Cloud Platform and the credentials needed to link the change with Google Analytics.
Has anyone else had a similar issue before?
There are a number of google quotas. These quotas are split up in project based and user based quotas. Project based quotas can be extended user based quotas can not.
Project based. (Can be increased)
50,000 requests per project per day, which can be increased.
50 write requests per project per day, which can be increased
User based: (Can NOT be increased)
10 queries per second (QPS) per IP address.
In the API Console, there is a similar quota referred to as Requests per 100 seconds per user. By default, it is set to 100 requests per 100 seconds per user and can be adjusted to a maximum value of 1,000. But the number of requests to the API is restricted to a maximum of 10 requests per second per user.
If your application makes all API requests from a single IP address (i.e., on behalf of your users), use the userIP or quotaUser parameter with each request to get full QPS quota for each user. See the standard query parameters summary for details.
1.5 queries per second (QPS) per Account ID
'403: User Rate Limit Exceeded'
Is a flood protection quota. Each user denoted by ip address or the user who is currently authenticated can max make 100 requests per 100 seconds. This number is not perfect due to clock skew. Sometimes you can make 110 requests sometimes only 90. The only thing you can do with this quota error is to slow down and implement exponential backoff. This is a user based quota and can NOT be extended. Your only option is to slow down.
Limits & Quotas
Related
In the GA Limits & Quotas documentation, they mention 200,000 hits per user per day for free Universal Analytics.
Does per user mean per GA account in this case, or is it per website user?
I'd assume 200k per website user sounds like an unrealistic limitation to reach.
its per user.
A single user on your web site which is most often denoted by their IP address unless you are sending a userid along with your hits. can max cause 200,000 hits per day to be created in your google analytics account.
Seriously though think about it 200,000 hits is a lot of hits what do you think a user would be doing to cause that kind of traffic?
What is the Google Analytics Management Write API quota limit? Is it 50 requests per day or 500, because the documentation states that it is 50 requests per day but when I'm filling the quota augmentation demand form, it says that it's 500 requests.
50 requests seem to be too low and it is the case for my project.
On the other hand, where can I check my daily usage of write requests? The console usage tab doesn't show it.
EDIT: Here is a screenshot of the Google Form to demand an increase in quota limits
Google form quota limits
Google Management Write API is at 500 requests per day.
The quota limits depend a lot upon which methods you are using. Please consult the Quota Limits documentation.
The following quotas apply to Management API, Core Reporting API v3, MCF Reporting API, Metadata API, User Deletion API, and Real Time Reporting API:
50,000 requests per project per day, which can be increased.
10 queries per second (QPS) per IP address.
In the API Console, there is a similar quota referred to as Requests per 100 seconds per user. By default, it is set to 100 requests per 100 seconds per user and can be adjusted to a maximum value of 1,000. But the number of requests to the API is restricted to a maximum of 10 requests per second per user.
If your application makes all API requests from a single IP address (i.e., on behalf of your users), use the userIP or quotaUser parameter with each request to get full QPS quota for each user. See the standard query parameters summary for details.
Write APIs
These quotas apply to the write (insert, update, patch, and delete) requests:
50 write requests per project per day, which can be increased
1.5 queries per second (QPS) per Account ID
actually quota
response from Google
the default quota is 50.
There used to be a whitelist so it was effectively 0 until you got whitelisted and then it was 500 (once whitelisted). We removed the whitelist and reduced it to 50 so that people can use the API without having to wait to be whitelsited. If they need more they can request additional quota.
I wonder exactly the same. I wish to get my write quota increased to 500.
From my experience, the usage of your write requests is under "Queries per day". This morning I only made 50 write requests and it now shows 50/50 000 queries for today. Doesn't really make sense...
This post won't clear up the write quota but it will show a source of the confusion - hopefully Google will clarify this
This api-quota-faqs page clarifies a number of ambiguities regarding quotas and batching (e.g. batching doesn't help with the Management API write quota).
But the 50 vs 500 ambiguity is currently still perpetuated: The current version of that page shows "Last updated April 13, 2018":
What is the maximum quota increase limit for Management API write requests?
The maximum daily quota per project for Management API write requests is 500. We normally don't grant more than 1,000 to 2,000 write requests per project per day. In some cases, we grant higher limits temporarily. Please include your justification in the quota increase request form.
That page is required reading before submitting the form to request an increase but that shows 50 - see image
Our usage metrics shows 71 successful Management API write requests for the day but we still got write quota errors - so neither 50 nor 500 is validated.
Regarding finding the usage:
(I don't see our Management API write quota listed with the other quotas)
The traffic and error metrics are found at APIs & Services > Dashboard.
Clicking on the Analytics API will take you to detailed metrics with listings by method (e.g. insert, update, etc)
URL is:
https://console.developers.google.com/apis/api/analytics.googleapis.com/metrics?project=project-id-9731708857265513301 (replace with your project id)
I have a problem with my project Analytics API into Google Developer Console.
Every day, when daily quotas are refreshed (at midnight Pacific time), my project calls a lot of requests so i must disable and then enable again analytics API.
In this way, quota stops and Google will not show me the error "Quota Error: profileId ga:xxxxxx has exceeded the daily request limit." when reach quota of 10,000 requests per view (profile) per day.
None of my projects called requests at midnight Pacific time so I don't understand because of this increase of quota.
What methods are you calling? Write methods (e.g. insert) are more strict 500 per day.
There's also a limit of concurrent 10 calls per second.
I am getting a HTTP 403 error with message: "... returned "User Rate Limit Exceeded">. after about 5K message translation. I have a deadline to get this done and the forum postings are not getting any responses from Google support.
The FAQ page states the following:
I get an HTTP 403 error when I call the API.
You may be exceeding your quota: either the daily billable total, or the limit on request characters per second.
To view or change usage limits for your project, or to request an increase to your quota, open the API Library in the Cloud Platform Console.
If you have enabled billing for your project, you can see the quota percentage for each API. You can view and change quotas from the API section's API Library and Enabled APIs links
======================*
I have my rate at the maximum allowable which is 10K/100sec/user, I cannot increase past that.
characters/100seconds/user 10,000
And when I go to the quota request page to ask Google support to increase it, the only thing I see is the character increase request, not the rate increase, and it does not let me submit the form.
How do I get someone at Google to look at this without paying $300 for silver support - that is the lowest level at which they provide phone support.
===============
*Translate API Quota Increase Request
This form should be used by customers of Google Cloud Platform for the following:
Owners of applications that wish to increase quota limit of Translate API to higher than 50M characters/day
If you wish to increase your quota, but will stay below 50M characters/day, please follow the steps listed on the Translate API FAQ page.
If you have other questions related to Translate API, please check this public forum for further help.
=================
I got the answer back from Google - you need to input 51 or greater into the request form (not 51M which I was trying and the form would just not let me submit).
At the current rate, my program will take about 8 hours to run if I put in the right timing delays, and I cannot monitor my program...hoping Google will increase the rate quota
If seems you're hitting the characters/100seconds/user quota. Currently there isn't any separate form to request an increase to this specific quota. You can request an increase by filling out the Translate API Quota Increase Request form. You'll need to specify 'Approximate translate volume (M characters/day)' as anything > 50 (e.g. 51) to get past the form validation. Inside 'Detailed description of API Usage' section, please explain in details that you need an increase to the characters/100seconds/user quota (along with desired increase) and not to characters/day.
I am a developer and working on a website that uses Google Analytics standard account. I use core-analytics Apis (for .Net) for querying GA to fetch different details such as total page hits, unique page hits, avg. time spent on a page, last viewed date for each web object in the web site.
I need to make 2 queries for each web object to get all these details and we have a large number of such web objects to fetch data for. In past few days I have noticed that these statistics are not being retrieved for some objects. In the logs I found an exception “Quota Error: User Rate Limit Exceeded” which states that I am exceeding the quota limit.
When researched this error, I found that below are some threshold limits that are applicable to GA standard account:
General quotas:
50,000 requests per project per day
10 queries per second (QPS) per IP
Core reporting API quotas:
10,000 requests per view (profile) per day
10 concurrent requests per view (profile)
I am not sure if which of these quotas are being exceeded. But I suspect that either 10 QPS or 10,000 req/view is being exceeded.
Question 1 : Could you please let me know if there is any way by which I can increase these quota limits(even if it involves extra cost by switching to premium account).
Question 2 : If we cannot increase the quota, can anyone please guide me how can we fetch details such as total page hits, unique page hits, avg. time spent on a page, last viewed date in a single query instead of two.
Please let me know in case you need any other details from my end.
First off you cant increase either the 10 queries per second (QPS) per IP or 10,000 requests per view (profile) per day
If you rerun the request and it doesn't work then you may be hitting the 10,000 requests per view (profile) per day once you hit that its not going to work again for that profile until the next day.
If you are unable to make any requests against any views then you are probably hitting the 50 k limit which you can request an extension of. It normally takes a month or so to get an extension.
As for the 10 requests a second I suggest you slow down your application and make sure that you aren't running to fast. You can also add quota user which can help with that.