OpenStack binding port failed - openstack

Question

I've been setting up OpenStack Victoria follow its installation documents on Ubuntu 20.04.4 LTS, after setting up the most services, I tried to create a server using openstack server create command, but it was failed to create.
According to the nova compute logs, I checked neutron logs
Binding failed for port 50065651-2336-494e-bcd2-314bc76b5542, please check neutron logs for more information.
There are two main errors in neutron logs
Port 50065651-2336-494e-bcd2-314bc76b5542 does not have an IP address assigned and there are no driver with 'connectivity' = 'l2'. The port cannot be bound.
Failed to bind port 50065651-2336-494e-bcd2-314bc76b5542 on host controller01 for vnic_type normal using segments [{'id': 'de296ba3-73da-47ed-9312-d4aa48f0b1e7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 43, 'network_id': '733427cc-bc91-451c-903c-fa60a368b693'}]
Here are some main conf files
/etc/neutron/neutron.conf
[DEFAULT]
core_plugin = ml2
auth_strategy = keystone
dhcp_lease_duration = 86400
dns_domain = learningneutron.com
notify_nova_on_port_status_changes = true
notify_nova_on_port_data_changes = true
transport_url = rabbit://openstack:rabbit#controller01
[agent]
root_helper = "sudo /usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf"
[cors]
[database]
connection = mysql+pymysql://neutron:neutron#controller01/neutron
[ironic]
[keystone_authtoken]
www_authenticate_uri = http://controller01:5000
auth_url = http://controller01:5000
memcached_servers = controller01:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = neutron
password = neutron
[nova]
auth_url = http://controller01:5000
auth_type = password
project_domain_name = default
user_domain_name = default
region_name = RegionOne
project_name = service
username = nova
password = nova
[oslo_concurrency]
lock_path = /var/lib/neutron/tmp
...
/etc/neutron/plugins/ml2/ml2_conf.ini
[DEFAULT]
[ml2]
type_drivers = local,flat,vlan,vxlan
tenant_network_types = vlan,vxlan
machanism_drivers = linuxbridge,l2population,openvswitch
extension_drivers = port_security
[ml2_type_flat]
flat_networks = physnet1
[ml2_type_geneve]
[ml2_type_gre]
tunnel_id_ranges = 1:1000
[ml2_type_vlan]
network_vlan_ranges = physnet1:40:43
[ml2_type_vxlan]
vni_ranges = 1:1000
[ovs_driver]
[securitygroup]
firewall_driver = iptables_hybrid
enable_security_group = true
enable_ipset = true
[sriov_driver]
/etc/neutron/plugins/ml2/openvswitch_agent.ini
[DEFAULT]
[agent]
vxlan_udp_port = 8472
l2_population = true
arp_responder = true
[network_log]
[ovs]
local_ip = 192.168.40.129
bridge_mappings = physnet1:br-ens38
[securitygroup]
firewall_driver = iptables_hybrid
[xenapi]
/etc/nova/nova.conf
[DEFAULT]
log_dir = /var/log/nova
lock_path = /var/lock/nova
state_path = /var/lib/nova
my_ip = 192.168.253.134
transport_url = rabbit://openstack:rabbit#controller01:5672/
[api]
auth_strategy = keystone
[api_database]
connection = mysql+pymysql://nova:nova#controller01/nova_api
...
[database]
connection = mysql+pymysql://nova:nova#controller01/nova
...
[glance]
api_servers = http://controller01:9292
...
[keystone_authtoken]
www_authenticate_uri = http://controller01:5000/
auth_url = http://controller01:5000/
memcached_servers = controller01:11211
auth_type = password
project_domain_name = Default
user_domain_name = Default
project_name = service
username = nova
password = nova
...
[neutron]
url = http://controller01:9696
auth_url = http://controller01:5000
auth_type = password
project_domain_name = default
user_domain_name = default
region_name = RegionOne
project_name = service
username = neutron
password = neutron
service_metadata_proxy = true
metadata_proxy_shared_secret = MetadataSecret123
[notifications]
[oslo_concurrency]
lock_path = /var/lib/nova/tmp
...
[placement]
region_name = RegionOne
project_domain_name = Default
project_name = service
auth_type = password
user_domain_name = Default
auth_url = http://controller01:5000/v3
username = placement
password = placement
...
I've seen one similar questions, but none of the solutions worked for my situation:
failed to bind port in openstack-neutron
I also checked service and agent status, it's seems like good to me
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
link/ether 00:0c:29:ae:8d:f7 brd ff:ff:ff:ff:ff:ff
inet 192.168.253.134/24 brd 192.168.253.255 scope global dynamic ens33
valid_lft 1066sec preferred_lft 1066sec
inet6 fe80::20c:29ff:feae:8df7/64 scope link
valid_lft forever preferred_lft forever
3: ens37: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
link/ether 00:0c:29:ae:8d:01 brd ff:ff:ff:ff:ff:ff
inet 192.168.40.129/24 brd 192.168.40.255 scope global dynamic ens37
valid_lft 1063sec preferred_lft 1063sec
inet6 fe80::20c:29ff:feae:8d01/64 scope link
valid_lft forever preferred_lft forever
4: ens38: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel master ovs-system state UP group default qlen 1000
link/ether 00:0c:29:ae:8d:0b brd ff:ff:ff:ff:ff:ff
inet6 fe80::20c:29ff:feae:8d0b/64 scope link
valid_lft forever preferred_lft forever
5: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 42:d9:38:7c:cd:db brd ff:ff:ff:ff:ff:ff
6: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 72:5b:5a:b7:ce:4f brd ff:ff:ff:ff:ff:ff
8: br-ens38: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 00:0c:29:ae:8d:0b brd ff:ff:ff:ff:ff:ff
9: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
link/ether 52:54:00:d8:a4:c6 brd ff:ff:ff:ff:ff:ff
inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
valid_lft forever preferred_lft forever
10: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel master virbr0 state DOWN group default qlen 1000
link/ether 52:54:00:d8:a4:c6 brd ff:ff:ff:ff:ff:ff
e52483be-c1e4-4dc6-87bf-77f8cefe6674
Manager "ptcp:6640:127.0.0.1"
is_connected: true
Bridge br-int
Controller "tcp:127.0.0.1:6633"
is_connected: true
fail_mode: secure
datapath_type: system
Port tape077c6b7-02
tag: 4095
trunks: [4095]
Interface tape077c6b7-02
type: internal
Port tap509692c4-f9
tag: 4095
trunks: [4095]
Interface tap509692c4-f9
type: internal
Port int-br-ens38
Interface int-br-ens38
type: patch
options: {peer=phy-br-ens38}
Port br-int
Interface br-int
type: internal
Bridge br-ens38
Controller "tcp:127.0.0.1:6633"
is_connected: true
fail_mode: secure
datapath_type: system
Port phy-br-ens38
Interface phy-br-ens38
type: patch
options: {peer=int-br-ens38}
Port ens38
Interface ens38
Port br-ens38
Interface br-ens38
type: internal
ovs_version: "2.13.5"
- Agent Type: Open vSwitch agent
Alive: true
Availability Zone: null
Binary: neutron-openvswitch-agent
Host: controller01
ID: 61146449-41a0-4d41-992e-d24b2d378c4c
State: true
- Agent Type: DHCP agent
Alive: true
Availability Zone: nova
Binary: neutron-dhcp-agent
Host: controller01
ID: 6f0c43b8-26ed-426c-bb99-7aaf763f74e8
State: true
- Agent Type: Metadata agent
Alive: true
Availability Zone: null
Binary: neutron-metadata-agent
Host: controller01
ID: 9292d5ca-342e-4718-a52e-2d6ce2bb2afe
State: true
- Binary: nova-scheduler
Host: controller01
ID: 3
State: up
Status: enabled
Updated At: '2022-08-14T17:48:50.000000'
Zone: internal
- Binary: nova-conductor
Host: controller01
ID: 5
State: up
Status: enabled
Updated At: '2022-08-14T17:48:43.000000'
Zone: internal
- Binary: nova-compute
Host: controller01
ID: 9
State: up
Status: enabled
Updated At: '2022-08-14T17:48:44.000000'
Zone: nova
As expected the port status are down
- Fixed IP Addresses:
- ip_address: 192.168.200.2
subnet_id: b95f00f4-4862-4783-9cbb-8b20a6eac84c
ID: 509692c4-f908-4582-9ca2-1c8381c3df9f
MAC Address: fa:16:3e:3a:63:91
Name: ''
Status: DOWN
- Fixed IP Addresses:
- ip_address: 192.168.100.2
subnet_id: db8c14df-11f6-4bd6-b39a-f06a3c33ce85
ID: e077c6b7-02e4-4720-b873-9278e2e1886a
MAC Address: fa:16:3e:f5:7d:89
Name: ''
Status: DOWN