Receiving a 429 error when trying to create a storage account during ARM deploy - azure-resource-manager

Reciving this error when trying to deploy to a recently deleted resource group.
Have left this running for 40 minutes but it never clears.
When i use a completley newly named resource group this doesnt happen.
In my ARM template I create this storage account before i try and create the serverfarm associated with it.
Any help would be very grateful, i can also repeat this with the same resource group.
OPERATION ID90AB707C6611418B
TRACKING ID67c301c6-93a6-4372-98bf-5bfe60f7df5f
STATUS429
PROVISIONING STATERunning
TIMESTAMP29/08/2018, 12:16:59
DURATION37 seconds
TYPEMicrosoft.Web/serverfarms
RESOURCE ID/subscriptions/<removed>/resourceGroups/<removed>/providers/Microsoft.Web/serverfarms/<removed>
STATUSMESSAGE{
"Code": "Conflict",
"Message": "Cannot modify this web hosting plan because another operation is in progress. Details: Id: 39c36b85-ea54-4bc0-899f-7776e15f2511, OperationName: Create, CreatedTime: 8/29/2018 8:41:20 AM, RequestId: ce52f313-8193-4e09-bfab-28892d69adb4, EntityType: 9",
"Target": null,
"Details": [
{
"Message": "Cannot modify this web hosting plan because another operation is in progress. Details: Id: 39c36b85-ea54-4bc0-899f-7776e15f2511, OperationName: Create, CreatedTime: 8/29/2018 8:41:20 AM, RequestId: ce52f313-8193-4e09-bfab-28892d69adb4, EntityType: 9"
},
{
"Code": "Conflict"
},
{
"ErrorEntity": {
"ExtendedCode": "59205",
"MessageTemplate": "Cannot modify this web hosting plan because another operation is in progress. Details: {0}",
"Parameters": [
"Id: 39c36b85-ea54-4bc0-899f-7776e15f2511, OperationName: Create, CreatedTime: 8/29/2018 8:41:20 AM, RequestId: ce52f313-8193-4e09-bfab-28892d69adb4, EntityType: 9"
],
"Code": "Conflict",
"Message": "Cannot modify this web hosting plan because another operation is in progress. Details: Id: 39c36b85-ea54-4bc0-899f-7776e15f2511, OperationName: Create, CreatedTime: 8/29/2018 8:41:20 AM, RequestId: ce52f313-8193-4e09-bfab-28892d69adb4, EntityType: 9"
}
}
],
"Innererror": null
}

Storage accounts can be notoriously slow to delete. Your conflict is likely caused by that resource not having been removed yet.
You should be able to see the resource group in the portal to verify that the assets still exist, or you can query the status with Get-AzureRmResourceGroupDeployment -ResourceGroupName ResourceGroupName.
You can also check activity logs.

Related

Cloud tasks permission error when adding TASK_ID

I have been creating a task following the convention from the documentation - projects/PROJECT_ID/locations/LOCATION_ID/queues/QUEUE_ID which in my real example would look something like this - projects/staging/locations/us-central1/queues/members. That is all working fine, but i wanted to add the TASK_ID so i can enable the de-duplication feature and i used this projects/PROJECT_ID/locations/LOCATION_ID/queues/QUEUE_ID/tasks/TASK_ID which translates to something like this projects/staging/locations/us-central1/queues/members/tasks/testing-id. When i try to use the TASK_ID i get the following error code:
{
"message": "The principal (user or service account) lacks IAM permission \"cloudtasks.tasks.create\" for the resource \"projects\/staging\/locations\/us-central1\/queues\/members\/tasks\/testing-id\" (or the resource may not exist).",
"code": 7,
"status": "PERMISSION_DENIED",
"details": [
{
"#type": "grpc-server-stats-bin",
"data": "<Unknown Binary Data>"
}
]
}
Why is this error happening? Why should adding the TASK_ID change what permission do i need?

CRM Portal: WebAPI: Error while executing WebAPI request: Attribute {0} cannot be found for table {1}

I am getting this response back when trying to execute a WebAPI request, but can't figure out why its erroring out. Moreover the error is not very helpful, as it doesn't tell which entity or which field, and I cannot identify any fields missing.
{
"error": {
"code": "90040100",
"message": "Attribute {0} cannot be found for table {1}.",
"innererror": {
"code": "90040100",
"message": "Attribute {0} cannot be found for table {1}.",
"type": "InvalidAttribute"
}
}
}
I tried this myself a few times but got the same errors that you describe here. According to the Microsoft documentation this is explicitly not supported.
Calling actions and functions using the portals Web API is not supported.

BigQueryInsertJobOperator - required Parameter is missing, but which?

I've been trying to get this operator working for some time since switching to airflow 2.0 BigQueryInsertJobOperator.
The error I'm seeing shows there is something missing from our connection, oddly enough this connection works in another DAG where we are using google's api to access google sheets:
export AIRFLOW_CONN_GOOGLE_CLOUD_DEFAULT=
"google-cloud-platform://?extra__google_cloud_platform__project=\analytics&extra__google_cloud_platform__keyfile_dict=
{\"type\": \"service_account\", \"project_id\": \"analytics\",
\"private_key_id\": \"${GCLOUD_PRIVATE_KEY_ID}\", \"private_key\": \"${GCLOUD_PRIVATE_KEY}\",
\"client_email\": \"d#lytics.iam.gserviceaccount.com\", \"client_id\": \"12345667\",
\"auth_uri\": \"https://accounts.google.com/o/oauth2/auth\",
\"token_uri\": \"https://accounts.google.com/o/oauth2/token\",
\"auth_provider_x509_cert_url\": \"https://www.googleapis.com/oauth2/v1/certs\",
\"client_x509_cert_url\": \"https://www.googleapis.com/robot/v1/metadata/x509/d#lytics.iam.gserviceaccount.com\"}"
This is the error I'm seeing:
{
"error": {
"code": 401,
"message": "Request is missing required authentication credential. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project.",
"errors": [
{
"message": "Login Required.",
"domain": "global",
"reason": "required",
"location": "Authorization",
"locationType": "header"
}
],
"status": "UNAUTHENTICATED"
}
}
is there a way I can look up what else might be required in terms of formatting, etc, perhaps a really good example on how to get the correct connection setup for this Operator??
In my logs I'm seeing this error which makes me think perhaps it might not be a credential issue?
File "/usr/local/lib/python3.8/site-packages/google/cloud/_http.py", line 438, in api_request
raise exceptions.from_http_response(response)
google.api_core.exceptions.BadRequest: 400 POST https://bigquery.googleapis.com/bigquery/v2/projects/vice-analytics/jobs?prettyPrint=false: Required parameter is missing
Create a service account json key, which contains all the required info posted in your error message.
https://cloud.google.com/iam/docs/creating-managing-service-account-keys
Then you can paste the json key into the Airflow UI: Admin -> Connections in the json key field and reference this in your dag with: gcp_conn_id="name of connection you created"
Or add the json key as an env variable (on macos):
export GOOGLE_APPLICATION_CREDENTIALS="link to your json key file"

WS02 API Manager Fault and Error Message Payload Structure Change

Mavens,
I have managed to change the response for fault and error from xml to json using the below link
https://docs.wso2.com/display/AM260/Error+Handling
However, I am now left with how to change the payloads for the faults or errors generated by the system itself
Something which is generated by default from the system
{ "fault": { "code": 900901, "message": "Invalid Credentials", "description": "Access failure for API: /employee/1.0.0, version: 1.0.0 status: (900901) - Invalid Credentials. Make sure you have provided the correct security credentials" }}
to something customized like this
{ "status": "fault", "description":{ "code": 900901, "message": "Invalid Credentials", "description": "Access failure for API: /employee/1.0.0, version: 1.0.0 status: (900901) - Invalid Credentials. Make sure you have provided the correct security credentials" }}
Update 1 :
Having a look at: https://medium.com/#azinneera/transforming-backend-error-messages-in-wso2-api-manager-91bf8d744ad4

StackDriver Custom Metric Resource Type cloud_composer_environment

I have a problem when I create timeseries on StackDriver.
So basically I create time series by executing the API from this site https://cloud.google.com/monitoring/api/ref_v3/rest/v3/projects.timeSeries/create
and for the resource type I set it as `cloud_composer_environment'.
and the JSON looks like
"resource": {
"type": "cloud_composer_environment",
"labels": {
"project_id": "MY PROJECT ID",
"environment_name": "MY ENVIRONTMENT",
"location": "us-central1"
}
},
and when I execute the API, the result was
{
"error": {
"code": 400,
"message": "One or more TimeSeries could not be written: Metrics cannot be written to cloud_composer_environment.: timeSeries[0]",
"status": "INVALID_ARGUMENT"
}
}
and I dont know How to fix it, there is no information why was it a bad request
Composer stackdriver metrics are not publicly writable today and we are currently working on exposing more workflow-related metrics. Meanwhile, you may want to create your own metrics for reporting and/or use composer stackdriver logs for monitoring/alerting as described here.

Resources