I have previous experience of running Astronomer (Airflow - through Astro CLI ) in my local Docker. But now, I have been provided with AWS VPN. I also Astro cloud UI. Do I need Docker to be installed in AWS VPN ? If so how?
Thanks
Sabarisri
Related
I have started learning/trying Airflow. Part of my research, I have installed airflow in my local through Docker. I referred official page Airflow Install Docker
I am looking for a (standard) process when I can deploy Airflow to Azure.
Can I directly use same docker-compose file for that ?
Any help will be appreciated.
Likely the easiest way is to use AKS (Azure Kubernetes Service) and use the official Helm Chart of Apache Airflow from the Apache Airflow community to deploy Airflow on it:
https://airflow.apache.org/docs/helm-chart/stable/index.html
I reckon, Installing Airflow through Docker-compose.yml on Azure wouldn't be the right approach. It is probably encouraged for local installations only.
The way we have set this up in Azure is like this:
Database: Azure Database for PostgreSQL server
Webserver + Scheduler: Azure App Service on a Linux App Service Plan
Docker: Azure Container Registry
Build the Docker image (either locally or in CICD pipeline)
Push the Docker image to Azure Container Registry
Setup Postgres server and create airflow database
Setup Azure App Service to pull Docker image from ACR (You can also setup continuous integration). Remember to configure Environment variables.
Obviously, as Jarek mentioned, you could also go with setting up AKS.
You can try the preconfigured images of Kubernertes AirFlow2 packaged by Bitnami. And perform the Deploy in AKS
bitnami.airflow
I want to get advantage is Aurora serverless since my current DB has over 1 million records. I can connect to it from my computer via ssh to ec2 in the same vpc with Aurora.
I installed WP in the same ec2, yet WP can't connect to it, any idea is it supported, or it should be used only with serverless platform by API?
Thanks,
You should be able to use AWS aurora serverless with WordPress as well as other PHP stacks, WordPress is compatible with MySQL 5.6 which serverless built on
the only thing I can think of is to make sure your database security group has access to the ec2 server and both are under same VPC
https://www.jeremydaly.com/aurora-serverless-the-good-the-bad-and-the-scalable/
I have a running dev installation of a dockerized wordpress project( via docker-compose) and was wondering what would be the best approach to deploying it to Azure. Most tutorials assume you are starting from scratch however I already have an installation and was wondering if I just need to integrate the azure-cli to the compose or setup an azure and migrate what was already done.
I have an account but do I invoke a docker VM or a wordpress from azure ??
What about the database?
The easiest path is for you to create a new Azure Container Service, which can host Docker Swarm, and deploy it there. Install the Azure CLI 2.0 on your machine and follow the tutorial to get started.
We are trying to deploy the docker images on redhat openshift platform and was able to deploy with default Ubuntu base files
But we need the docker files align with the production environment so we need to convert the base from Ubuntu to redhat
Has anyone deployed api manager in openshift or converted the docker images to redhat
OpenShift is running kubernetes underneath therefore wso2 products can be deployed in OpenShift with kubernetes membership scheme for clustering.
Converting wso2 docker images to RedHat should not be a problem. You only need to convert dockerfile and few scripts from ubuntu to RedHat.
There are existing deployments running wso2 products on OpenShift.
We occasionally have the need to restart services that are deployed with AWS CodeDeploy. Is it possible to have the CodeDeploy agent do this directly, without having to create a new deployment?
The AWS service you're looking for is AWS Systems Manager. You can run arbitrary commands or scripts on instances with this2. All recent Ubuntu and Amazon Linux instances have AWS SSM agent installed. But if you have an older instance, you'll have to install the SSM agent manually or through your configuration manager.
No, you need to have a deployment to restart. The agent does not take actions on its own. It receives commands from the CodeDeploy service.
Depending on your usecase you can have your application emit CloudWatch event and have that trigger a deployment in the deploymentGroup. Note that it will create a deployment that will deploy to the entire fleet.
To expand on eternaltyro's answer, you could leverage CodeDeploy's CLI tool via SSM to run the same CodeDeploy event hooks that were/are used to start and stop your application.