使用Kolla部署Stein版本OpenStack（含Ceph存儲(chǔ)部分）
并于Kolla的介紹這里不進(jìn)行過多的闡述，網(wǎng)上有很多文檔。本文主要是針對(duì)最新版本的Kolla，解決單節(jié)點(diǎn)無法部署ceph-osd問題（在測(cè)試時(shí)發(fā)現(xiàn)多節(jié)點(diǎn)也無法部署Ceph-osd）。在最新版本的kolla中，官網(wǎng)已經(jīng)給出要下架Ceph的公告，具體信息如下圖：
此片文章會(huì)通過修改kolla-ansible源碼解決不能部署ceph問題。
部署具體過程如下：
創(chuàng)新互聯(lián)是一家專業(yè)從事成都網(wǎng)站建設(shè)、網(wǎng)站建設(shè)、網(wǎng)頁設(shè)計(jì)的品牌網(wǎng)絡(luò)公司。如今是成都地區(qū)具影響力的網(wǎng)站設(shè)計(jì)公司,作為專業(yè)的成都網(wǎng)站建設(shè)公司,創(chuàng)新互聯(lián)依托強(qiáng)大的技術(shù)實(shí)力、以及多年的網(wǎng)站運(yùn)營經(jīng)驗(yàn),為您提供專業(yè)的成都網(wǎng)站建設(shè)、營銷型網(wǎng)站建設(shè)及網(wǎng)站設(shè)計(jì)開發(fā)服務(wù)！
1. 準(zhǔn)備工作
1.1 安裝Centos7.5系統(tǒng)，過程略。本人使用virtualbox創(chuàng)建虛擬機(jī)，使用兩張網(wǎng)卡即可。第一張為管理網(wǎng)絡(luò)，可以訪問外網(wǎng)，第二張為實(shí)例使用網(wǎng)絡(luò)，啟動(dòng)即可，無需配置IP。
[root@openstack ~]# cat /etc/centos-release
CentOS Linux release 7.5.1804 (Core)1.2 關(guān)閉防火墻、設(shè)置selinux
[root@localhost ~]# systemctl disable firewalld
[root@localhost ~]# systemctl stop firewalld
[root@localhost ~]# getenforce
Disabled1.3 重啟機(jī)器
[root@localhost ~]# reboo71.4 設(shè)置主機(jī)名
[root@localhost ~]# hostnamectl set-hostname openstack
[root@localhost ~]# cat /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.137.2 openstack1.5 配置DNS
[root@openstack ~]# cat /etc/resolv.conf
nameserver 114.114.114.1141.6 添加阿里yum源
[root@openstack ~]# rm -rfv * /etc/yum.repos.d/*
[root@openstack ~]# curl -o /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo2. 系統(tǒng)基本配置
2.1 安裝常用工具
[root@openstack ~]# yum install vim bash-completion net-tools2.2 安裝epel
[root@openstack ~]# yum install epel-release2.3 安裝依賴
[root@openstack ~]#yum install python-devel libffi-devel gcc openssl-devel libselinux-python -y2.4 安裝pip
[root@openstack ~]# yum install python-pip2.5 配置pip，使用阿里源
[root@openstack ~]# mkdir ~/.pip
[root@openstack ~]# vim ~/.pip/pip.conf
[global]
index-url = https://mirrors.aliyun.com/pypi/simple/
[install]
trusted-host=mirrors.aliyun.com2.6 更新pip
[root@openstack ~]# pip install -U pip3. 安裝docker
3.1 添加docker源，使用阿里源
[root@openstack ~]#yum install -y yum-utils device-mapper-persistent-data lvm2
[root@openstack ~]#yum-config-manager --add-repo http://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo3.2 安裝docker
[root@openstack ~]#yum -y install docker-ce3.3 配置docker，使用阿里加速器
[root@openstack ~]# mkdir -p /etc/docker/
[root@openstack ~]# vim /etc/docker/daemon.json
{
"registry-mirrors": ["https://fl791z1h.mirror.aliyuncs.com"]
}3.4 添加kolla.conf
[root@openstack ~]# mkdir -p /etc/systemd/system/docker.service.d/
[root@openstack ~]# vim /etc/systemd/system/docker.service.d/kolla.conf
[Service]
MountFlags=shared3.5 啟動(dòng)docker
[root@openstack ~]# systemctl daemon-reload
[root@openstack ~]# systemctl enable docker
[root@openstack ~]# systemctl start docker4. 安裝ansible
4.1 安裝ansible
[root@openstack ~]# yum install ansible4.2 配置ansible
[root@openstack ~]# vim /etc/ansible/ansible.cfg
[defaults]
host_key_checking=False
pipelining=True
forks=1005. 安裝kolla-ansible
5.1 安裝依賴
kolla分為兩個(gè)倉庫，一個(gè)為https://github.com/openstack/kolla , 另一個(gè)為https://github.com/openstack/kolla-ansible 在這兩個(gè)倉庫中有requirements.txt文件，需要將其中的依賴安裝
[root@openstack ~]# vim 1.txt
pbr!=2.1.0,>=2.0.0 # Apache-2.0
docker>=2.4.2 # Apache-2.0
Jinja2>=2.8 # BSD License (3 clause)
GitPython>=1.0.1 # BSD License (3 clause)
six>=1.10.0 # MIT
oslo.config>=5.1.0 # Apache-2.0
oslo.utils>=3.33.0 # Apache-2.0
setuptools!=24.0.0,!=34.0.0,!=34.0.1,!=34.0.2,!=34.0.3,!=34.1.0,!=34.1.1,!=34.2.0,!=34.3.0,!=34.3.1,!=34.3.2,!=36.2.0,>=21.0 # PSF/ZPL
netaddr>=0.7.18 # BSD[root@openstack ~]# vim 2.txt
pbr!=2.1.0,>=2.0.0 # Apache-2.0
docker>=2.4.2 # Apache-2.0
Jinja2>=2.10 # BSD License (3 clause)
six>=1.10.0 # MIT
oslo.config>=5.2.0 # Apache-2.0
oslo.utils>=3.33.0 # Apache-2.0
setuptools!=24.0.0,!=34.0.0,!=34.0.1,!=34.0.2,!=34.0.3,!=34.1.0,!=34.1.1,!=34.2.0,!=34.3.0,!=34.3.1,!=34.3.2,!=36.2.0,>=21.0.0 # PSF/ZPL
PyYAML>=3.12 # MIT
netaddr>=0.7.18 # BSD
cryptography>=2.1 # BSD/Apache-2.0
jmespath>=0.9.3 # MIT以上兩個(gè)文件，是我直接新requirements.txt，復(fù)制過來的，直接安裝即可
root@openstack ~]# pip install -r 1.txt
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Looking in indexes: https://mirrors.aliyun.com/pypi/simple/
Requirement already satisfied: pbr!=2.1.0,>=2.0.0 in /usr/lib/python2.7/site-packages (from -r 1.txt (line 1)) (5.4.2)
Requirement already satisfied: docker>=2.4.2 in /usr/lib/python2.7/site-packages (from -r 1.txt (line 2)) (4.0.2)
Requirement already satisfied: Jinja2>=2.8 in /usr/lib64/python2.7/site-packages (from -r 1.txt (line 3)) (2.10.1)
Requirement already satisfied: GitPython>=1.0.1 in /usr/lib/python2.7/site-packages (from -r 1.txt (line 4)) (3.0.2)
ERROR: Package 'GitPython' requires a different Python: 2.7.5 not in '>=3.0, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*'在安裝的時(shí)候會(huì)提示GitPython無法安裝，可以使用pip指定GitPython進(jìn)行安裝
[root@openstack ~]# pip install GitPython==3.0.2安裝第二個(gè)依賴
[root@openstack ~]# pip install -r 2.txt5.2 安裝kolla-ansible
[root@openstack ~]# pip install kolla-ansible在安裝kolla-ansible的時(shí)候會(huì)出現(xiàn)下面的錯(cuò)誤
ERROR: Cannot uninstall 'PyYAML'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.解決方法，在安裝kolla-ansible的時(shí)候忽略PyYAML
[root@openstack ~]# pip install kolla-ansible --ignore-installed PyYAML5.3 安裝kolla
[root@openstack ~]# pip install kolla6. 配置kolla-ansible
6.1 創(chuàng)建kolla目錄，復(fù)制globals.yml，passwords.yml
[root@openstack ~]# mkdir -p /etc/kolla/
[root@openstack ~]# cp /usr/share/kolla-ansible/etc_examples/kolla/* /etc/kolla/6.2 由于此環(huán)境在虛擬機(jī)部署，所以virt_type的類型設(shè)置為qemu
[root@openstack ~]# mkdir -p /etc/kolla/config/nova/
[root@openstack ~]# vim /etc/kolla/config/nova/nova-compute.conf
[libvirt]
virt_type = qemu
cpu_mode = none6.3 配置ceph.conf，設(shè)備ceph副本數(shù)，此環(huán)境為一臺(tái)節(jié)點(diǎn)，3個(gè)OSD盤，設(shè)置副本為1即可，如果是三臺(tái)節(jié)點(diǎn)，9OSD盤，副本為3。
[root@openstack ~]# vim /etc/kolla/config/ceph.conf
[global]
osd pool default size = 1
osd pool default min size = 16.4 配置globals.yml
[root@openstack ~]# cat /etc/kolla/globals.yml | grep -v ^$| grep -v ^#
kolla_base_distro: "centos"
kolla_install_type: "source"
openstack_release: "stein"
kolla_internal_vip_address: "192.168.137.254"
docker_registry: "registry.cn-hangzhou.aliyuncs.com"
docker_namespace: "openstackbl"
network_interface: "enp0s3"
neutron_external_interface: "enp0s8"
neutron_plugin_agent: "linuxbridge"
enable_ceph: "yes"
ceph_osd_store_type: "bluestore"
enable_ceph_rgw: "yes"
enable_cinder: "yes"
enable_neutron_qos: "yes"
enable_ceph_rgw_keystone: "yes"
glance_backend_ceph: "yes"
glance_enable_rolling_upgrade: "no"
cinder_backend_ceph: "{{ enable_ceph }}"
nova_backend_ceph: "{{ enable_ceph }}"
ironic_dnsmasq_dhcp_range:
tempest_image_id:
tempest_flavor_ref_id:
tempest_public_network_id:
tempest_floating_network_name:以上的配置中，本人使用了自己在阿里上搭建的docker倉庫。里面的鏡像，是從docker的官網(wǎng)push而來。這個(gè)倉庫是私有倉庫，要是需要使用的話，請(qǐng)聯(lián)系本作者。
注：如果此環(huán)境所在的網(wǎng)絡(luò)中還有其它使用Kolla部署的openstack，那么需要修改globals.yml中的
#keepalived_virtual_router_id: "51"把51改成1到99的之間的整數(shù)即可。
7 部署openstack
7.1 本環(huán)境使用Ceph作為后端存儲(chǔ)，需要添加磁盤，做OSD，并且修改硬盤標(biāo)簽
[root@openstack ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 200G 0 disk
├─sda1 8:1 0 1G 0 part /boot
└─sda2 8:2 0 199G 0 part
├─centos-root 253:0 0 150G 0 lvm /
├─centos-swap 253:1 0 7.9G 0 lvm [SWAP]
└─centos-home 253:2 0 41.1G 0 lvm /home
sdb 8:16 0 100G 0 disk
sdc 8:32 0 100G 0 disk
sdd 8:48 0 100G 0 disk 可以看到有三塊空白盤，修改這三塊盤的標(biāo)簽
[root@openstack ~]# parted /dev/sdb -s -- mklabel gpt mkpart KOLLA_CEPH_OSD_BOOTSTRAP 1 -1
[root@openstack ~]# parted /dev/sdc -s -- mklabel gpt mkpart KOLLA_CEPH_OSD_BOOTSTRAP 1 -1
[root@openstack ~]# parted /dev/sdd -s -- mklabel gpt mkpart KOLLA_CEPH_OSD_BOOTSTRAP 1 -1
[root@openstack ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 200G 0 disk
├─sda1 8:1 0 1G 0 part /boot
└─sda2 8:2 0 199G 0 part
├─centos-root 253:0 0 150G 0 lvm /
├─centos-swap 253:1 0 7.9G 0 lvm [SWAP]
└─centos-home 253:2 0 41.1G 0 lvm /home
sdb 8:16 0 100G 0 disk
└─sdb1 8:17 0 100G 0 part
sdc 8:32 0 100G 0 disk
└─sdc1 8:33 0 100G 0 part
sdd 8:48 0 100G 0 disk
└─sdd1 8:49 0 100G 0 part 7.2 生成openstack密碼
[root@openstack ~]# kolla-genpwd7.3 pull鏡像
[root@openstack ~]# kolla-ansible pull
...........
PLAY RECAP ************************************************************************************************************************************************
localhost : ok=40 changed=0 unreachable=0 failed=0 skipped=77 rescued=0 ignored=0 出現(xiàn)以上提示，pull成功。如果在pull中出現(xiàn)問題，可以在評(píng)論中留言
7.4 檢查Kolla
[root@openstack ~]# kolla-ansible prechecks
PLAY RECAP ************************************************************************************************************************************************
localhost : ok=102 changed=0 unreachable=0 failed=0 skipped=147 rescued=0 ignored=0 出現(xiàn)以上提示，prechecks成功。如果在檢查的過程中，有遇到問題，請(qǐng)?jiān)谠u(píng)論區(qū)留言。
7.5 部署Kolla
[root@openstack ~]# kolla-ansible deploy -vvvTASK [ceph : Enable ceph dashboard] ***************************************************************************************************************************************
task path: /usr/share/kolla-ansible/ansible/roles/ceph/tasks/start_ceph_dashboard.yml:2
<localhost> ESTABLISH LOCAL CONNECTION FOR USER: root
<localhost> EXEC /bin/sh -c 'echo ~root && sleep 0'
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /root/.ansible/tmp/ansible-tmp-1567411390.78-165388867051828 `" && echo ansible-tmp-1567411390.78-165388867051828="` echo /root/.ansible/tmp/ansible-tmp-1567411390.78-165388867051828 `" ) && sleep 0'
Using module file /usr/lib/python2.7/site-packages/ansible/modules/commands/command.py
<localhost> PUT /root/.ansible/tmp/ansible-local-7809exM0Cg/tmpteinHV TO /root/.ansible/tmp/ansible-tmp-1567411390.78-165388867051828/AnsiballZ_command.py
<localhost> EXEC /bin/sh -c 'chmod u+x /root/.ansible/tmp/ansible-tmp-1567411390.78-165388867051828/ /root/.ansible/tmp/ansible-tmp-1567411390.78-165388867051828/AnsiballZ_command.py && sleep 0'
<localhost> EXEC /bin/sh -c '/usr/bin/python /root/.ansible/tmp/ansible-tmp-1567411390.78-165388867051828/AnsiballZ_command.py && sleep 0'
<localhost> EXEC /bin/sh -c 'rm -f -r /root/.ansible/tmp/ansible-tmp-1567411390.78-165388867051828/ > /dev/null 2>&1 && sleep 0'
fatal: [localhost]: FAILED! => {
"changed": false,
"cmd": [
"docker",
"exec",
"ceph_mon",
"ceph",
"mgr",
"module",
"enable",
"dashboard"
],
"delta": "0:00:00.990347",
"end": "2019-09-02 04:03:11.952770",
"invocation": {
"module_args": {
"_raw_arams": "docker exec ceph_mon ceph mgr module enable dashboard",
"_uses_shell": false,
"argv": null,
"chdir": null,
"creates": null,
"executable": null,
"removes": null,
"stdin": null,
"stdin_add_newline": true,
"strip_empty_ends": true,
"warn": true
}
},
"msg": "non-zero return code",
"rc": 2,
"start": "2019-09-02 04:03:10.962423",
"stderr": "Error ENOENT: all mgr daemons do not support module 'dashboard', pass --force to force enablement",
"stderr_lines": [
"Error ENOENT: all mgr daemons do not support module 'dashboard', pass --force to force enablement"
],
"stdout": "",
"stdout_lines": []
}
NO MORE HOSTS LEFT ********************************************************************************************************************************************************
PLAY RECAP ****************************************************************************************************************************************************************
localhost : ok=194 changed=111 unreachable=0 failed=1 skipped=105 rescued=0 ignored=0 加入-vvv參數(shù)可以在部署的過程進(jìn)行調(diào)試。在部署此步時(shí)提示如上錯(cuò)誤，部署中斷。解決方法：
[root@openstack ~]# vim /usr/share/kolla-ansible/ansible/roles/ceph/tasks/start_ceph_dashboard.yml
---
- name: Enable ceph dashboard
become: true
command: docker exec ceph_mon ceph mgr module enable dashboard --force
changed_when: false
run_once: true在command最后加上 --force，即可解決此問題。
把剛才部署好的容器卸載，然后重新部署：
[root@openstack ~]# kolla-ansible destroy --yes-i-really-really-mean-it
Destroy Kolla containers, volumes and host configuration : ansible-playbook -i /usr/share/kolla-ansible/ansible/inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla /usr/share/kolla-ansible/ansible/destroy.yml
[DEPRECATION WARNING]: The TRANSFORM_INVALID_GROUP_CHARS settings is set to allow bad characters in group names by default, this will change, but still be user
configurable on deprecation. This feature will be removed in version 2.10. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.
[WARNING]: Invalid characters were found in group names but not replaced, use -vvvv to see details
PLAY [Apply role destroy] *************************************************************************************************************************************************
TASK [Gathering Facts] ****************************************************************************************************************************************************
ok: [localhost]
TASK [destroy : include_tasks] ********************************************************************************************************************************************
included: /usr/share/kolla-ansible/ansible/roles/destroy/tasks/validate_docker_execute.yml for localhost
TASK [destroy : Ensure the docker service is running] *********************************************************************************************************************
changed: [localhost]
TASK [destroy : include_tasks] ********************************************************************************************************************************************
included: /usr/share/kolla-ansible/ansible/roles/destroy/tasks/cleanup_containers.yml for localhost
TASK [destroy : Destroying all Kolla containers and volumes] **************************************************************************************************************
changed: [localhost]
TASK [destroy : include_tasks] ********************************************************************************************************************************************
included: /usr/share/kolla-ansible/ansible/roles/destroy/tasks/cleanup_images.yml for localhost
TASK [destroy : Removing Kolla images] ************************************************************************************************************************************
skipping: [localhost]
TASK [destroy : include_tasks] ********************************************************************************************************************************************
included: /usr/share/kolla-ansible/ansible/roles/destroy/tasks/cleanup_host.yml for localhost
TASK [destroy : Destroying Kolla host configuration] **********************************************************************************************************************
changed: [localhost]
PLAY RECAP ****************************************************************************************************************************************************************
localhost : ok=8 changed=3 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0
[root@openstack ~]#[root@openstack ~]# kolla-ansible deploy -vvv
在部署的過程中，我們可以看到在執(zhí)行ceph-osd相關(guān)任務(wù)時(shí)，沒有正確執(zhí)行的反饋，具體如上圖。此時(shí)我們可以通過ceph osd tree 命令來查看
[root@openstack ~]# docker exec ceph_mon ceph osd tree
ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF
-1 0 root default
[root@openstack ~]# docker exec ceph_mon ceph df
RAW STORAGE:
CLASS SIZE AVAIL USED RAW USED %RAW USED
TOTAL 0 B 0 B 0 B 0 B 0
POOLS:
POOL ID STORED OBJECTS USED %USED MAX AVAIL
.rgw.root 1 0 B 0 0 B 0 0 B
images 2 0 B 0 0 B 0 0 B
volumes 3 0 B 0 0 B 0 0 B
backups 4 0 B 0 0 B 0 0 B通過查看，我們得知目前ceph集群沒有運(yùn)行的osd。
等待一段時(shí)間后，部署完成，也沒有報(bào)錯(cuò)。
PLAY [Apply role blazar] **************************************************************************************************************************************************
skipping: no hosts matched
PLAY RECAP ****************************************************************************************************************************************************************
localhost : ok=411 changed=234 unreachable=0 failed=0 skipped=238 rescued=0 ignored=0
[root@openstack ~]#大概十分鐘多一點(diǎn)，openstack部署完成，也沒報(bào)錯(cuò)。
7.6 生成admin-openrc.sh
[root@openstack ~]# kolla-ansible post-deploy7.7 上傳鏡像
ceph作為glance存儲(chǔ)，鏡像格式要使用raw，操作如下
[root@openstack ~]# yum install qemu-img -y
[root@openstack ~]# qemu-img convert -f qcow2 -O raw cirros-0.3.4-x86_64-disk.img cirros.raw
[root@openstack ~]# source /etc/kolla/admin-openrc.sh
[root@openstack ~]# glance image-create --name cirros --disk-format raw --container-format bare --progress < cirros.raw
[========> ] 29%在上傳到29%的時(shí)候，無法上傳。通過查找原因，得出，glance使用Ceph作為后端存儲(chǔ)，可用空間為零，下面是glance的日志與ceph狀態(tài)
2019-09-02 04:24:15.349 24 WARNING glance_store._drivers.rbd [req-7ee511be-930b-4e41-9c08-e1a90c375fe2 1148205e534a4832ba8700ea8b410534 d722008e46fa4ef799c68c766b26781b - default default] since image size is zero we will be doing resize-before-write for each chunk which will be considerably slower than normal
[root@openstack ~]# docker exec ceph_mon ceph -s
cluster:
id: 055889bd-64a5-4129-a853-340d82bcddc5
health: HEALTH_WARN
Reduced data availability: 40 pgs inactive
services:
mon: 1 daemons, quorum 192.168.137.2 (age 14m)
mgr: localhost(active, since 14m)
osd: 0 osds: 0 up, 0 in
data:
pools: 5 pools, 40 pgs
objects: 0 objects, 0 B
usage: 0 B used, 0 B / 0 B avail
pgs: 100.000% pgs unknown
40 unknown
[root@openstack ~]#可以看到ceph的pg屬于unknown狀態(tài)，說明這個(gè)ceph集群不能使用。
8. 修改kolla-ansible源碼
8.1 在修改源碼之前，我們把已經(jīng)部署的好集群卸載
[root@openstack ~]# kolla-ansible destroy --yes-i-really-really-mean-it
Destroy Kolla containers, volumes and host configuration : ansible-playbook -i /usr/share/kolla-ansible/ansible/inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla /usr/share/kolla-ansible/ansible/destroy.yml
[DEPRECATION WARNING]: The TRANSFORM_INVALID_GROUP_CHARS settings is set to allow bad characters in group names by default, this will change, but still be user
configurable on deprecation. This feature will be removed in version 2.10. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.
[WARNING]: Invalid characters were found in group names but not replaced, use -vvvv to see details
PLAY [Apply role destroy] *************************************************************************************************************************************************
TASK [Gathering Facts] ****************************************************************************************************************************************************
ok: [localhost]
TASK [destroy : include_tasks] ********************************************************************************************************************************************
included: /usr/share/kolla-ansible/ansible/roles/destroy/tasks/validate_docker_execute.yml for localhost
TASK [destroy : Ensure the docker service is running] *********************************************************************************************************************
changed: [localhost]
TASK [destroy : include_tasks] ********************************************************************************************************************************************
included: /usr/share/kolla-ansible/ansible/roles/destroy/tasks/cleanup_containers.yml for localhost
TASK [destroy : Destroying all Kolla containers and volumes] **************************************************************************************************************
changed: [localhost]
TASK [destroy : include_tasks] ********************************************************************************************************************************************
included: /usr/share/kolla-ansible/ansible/roles/destroy/tasks/cleanup_images.yml for localhost
TASK [destroy : Removing Kolla images] ************************************************************************************************************************************
skipping: [localhost]
TASK [destroy : include_tasks] ********************************************************************************************************************************************
included: /usr/share/kolla-ansible/ansible/roles/destroy/tasks/cleanup_host.yml for localhost
TASK [destroy : Destroying Kolla host configuration] **********************************************************************************************************************
changed: [localhost]
PLAY RECAP ****************************************************************************************************************************************************************
localhost : ok=8 changed=3 unreachable=0 failed=0 skipped=1 rescued=0 ignored=08.2 修改bootstrap_osds.yml
修改第6行、第19行
[root@openstack ~]# vim /usr/share/kolla-ansible/ansible/roles/ceph/tasks/bootstrap_osds.yml
-a "partition_name='KOLLA_CEPH_OSD_BOOTSTRAP' match_mode='prefix' use_udev={{ kolla_ceph_use_udev }}"-a "partition_name='KOLLA_CEPH_OSD_CACHE_BOOTSTRAP' match_mode='prefix' use_udev={{ kolla_ceph_use_udev }}"注釋39-42行、注釋100-102行。在42、102行后面添加
# - not item.external_journal | bool
# - item.device.split('/')[2] in ansible_devices # if there is no device in setup (like loopback, we don't need to warn user
# - ansible_devices[item.device.split('/')[2]].partitions|count > 1
# - ceph_osd_wipe_disk != "yes-i-really-really-mean-it"
- item.external_journal | bool == False
- ansible_devices[item.device.split('/')[2]].partitions|count > 1
- ceph_osd_wipe_disk != "yes-i-really-really-mean-it"
# - not item.external_journal | bool
# - ansible_devices[item.device.split('/')[2]].partitions|count > 1
# - ceph_osd_wipe_disk != "yes-i-really-really-mean-it"
- item.external_journal | bool == False
- ansible_devices[item.device.split('/')[2]].partitions|count > 1
- ceph_osd_wipe_disk != "yes-i-really-really-mean-it"8.3 修改start_osds.yml
修改第六行
[root@openstack ~]# vim /usr/share/kolla-ansible/ansible/roles/ceph/tasks/start_osds.yml
-a "partition_name='KOLLA_CEPH_DATA_BS' match_mode='prefix' use_udev={{ kolla_ceph_use_udev }}"9. 重新部署openstack
執(zhí)行部署命令
[root@openstack ~]# kolla-ansible deploy -vvv部署過程中查看是不啟動(dòng)osd，如下圖
通過任務(wù)可以看到，osd盤已經(jīng)創(chuàng)建成功?？梢酝ㄟ^下面命令來查看osd容器，ceph狀態(tài)
[root@openstack ~]# docker ps | grep ceph
3b765534475d registry.cn-hangzhou.aliyuncs.com/openstackbl/centos-source-ceph-rgw:stein "dumb-init --single-…" About a minute ago Up About a minute ceph_rgw
7b326a2844f2 registry.cn-hangzhou.aliyuncs.com/openstackbl/centos-source-ceph-osd:stein "dumb-init --single-…" About a minute ago Up About a minute ceph_osd_2
6abde420cd43 registry.cn-hangzhou.aliyuncs.com/openstackbl/centos-source-ceph-osd:stein "dumb-init --single-…" About a minute ago Up About a minute ceph_osd_1
3576d8cf558c registry.cn-hangzhou.aliyuncs.com/openstackbl/centos-source-ceph-osd:stein "dumb-init --single-…" About a minute ago Up About a minute ceph_osd_0
2658dfc87737 registry.cn-hangzhou.aliyuncs.com/openstackbl/centos-source-ceph-mgr:stein "dumb-init --single-…" 2 minutes ago Up 2 minutes ceph_mgr
c3a97ff4a395 registry.cn-hangzhou.aliyuncs.com/openstackbl/centos-source-ceph-mon:stein "dumb-init --single-…" 2 minutes ago Up 2 minutes ceph_mon
[root@openstack ~]# docker exec -it ceph_mon ceph -s
cluster:
id: 055889bd-64a5-4129-a853-340d82bcddc5
health: HEALTH_WARN
too few PGs per OSD (18 < min 30)
services:
mon: 1 daemons, quorum 192.168.137.2 (age 3m)
mgr: localhost(active, since 3m)
osd: 3 osds: 3 up (since 2m), 3 in (since 2m)
rgw: 1 daemon active (radosgw.gateway)
data:
pools: 7 pools, 56 pgs
objects: 219 objects, 1.2 KiB
usage: 3.0 GiB used, 297 GiB / 300 GiB avail
pgs: 56 active+clean
[root@openstack ~]#大概十幾分鐘后，openstack部署成功
PLAY [Apply role blazar] **************************************************************************************************************************************************
skipping: no hosts matched
PLAY RECAP ****************************************************************************************************************************************************************
localhost : ok=415 changed=237 unreachable=0 failed=0 skipped=234 rescued=0 ignored=0至此ceph-osd創(chuàng)建成功。稍等片刻后，openstack部署成功后，接著下面的操作
10. 測(cè)試openstack
10.1 上傳鏡像
[root@openstack ~]# kolla-ansible post-deploy
[root@openstack ~]# source /etc/kolla/admin-openrc.sh
[root@openstack ~]# glance image-create --name cirros --disk-format raw --container-format bare --progress < cirros.raw
[=============================>] 100%
+------------------+----------------------------------------------------------------------------------+
| Property | Value |
+------------------+----------------------------------------------------------------------------------+
| checksum | 56730d3091a764d5f8b38feeef0bfcef |
| container_format | bare |
| created_at | 2019-09-02T09:18:32Z |
| disk_format | raw |
| id | 07ab1c4e-d16d-4b55-b1f1-017a0699662e |
| locations | [{"url": "rbd://055889bd-64a5-4129-a853-340d82bcddc5/images/07ab1c4e-d16d- |
| | 4b55-b1f1-017a0699662e/snap", "metadata": {}}] |
| min_disk | 0 |
| min_ram | 0 |
| name | cirros |
| os_hash_algo | sha512 |
| os_hash_value | 34f5709bc2363eafe857ba1344122594a90a9b8cc9d80047c35f7e34e8ac28ef1e14e2e3c13d55a4 |
| | 3b841f533435e914b01594f2c14dd597ff9949c8389e3006 |
| os_hidden | False |
| owner | 544d94b977234b0295726b0c7163c3e8 |
| protected | False |
| size | 41126400 |
| status | active |
| tags | [] |
| updated_at | 2019-09-02T09:18:34Z |
| virtual_size | Not available |
| visibility | shared |
+------------------+----------------------------------------------------------------------------------+
[root@openstack ~]#可以看到鏡像可以上傳成功
10.2 在ceph中查看鏡像
[root@openstack ~]# docker exec ceph_mon rbd -p images ls
07ab1c4e-d16d-4b55-b1f1-017a0699662e
[root@openstack ~]# docker exec ceph_mon rbd -p images info 07ab1c4e-d16d-4b55-b1f1-017a0699662e
rbd image '07ab1c4e-d16d-4b55-b1f1-017a0699662e':
size 39 MiB in 5 objects
order 23 (8 MiB objects)
snapshot_count: 1
id: 11939304e103
block_name_prefix: rbd_data.11939304e103
format: 2
features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
op_features:
flags:
create_timestamp: Mon Sep 2 05:18:33 2019
access_timestamp: Mon Sep 2 05:18:33 2019
modify_timestamp: Mon Sep 2 05:18:33 2019
[root@openstack ~]#可以看到鏡像的存儲(chǔ)路徑為ceph images pool
11. Q&A
分享名稱：使用Kolla部署Stein版本OpenStack（含Ceph存儲(chǔ)部分）
文章轉(zhuǎn)載：http://bm7419.com/article16/ijhjgg.html
成都網(wǎng)站建設(shè)公司_創(chuàng)新互聯(lián)，為您提供用戶體驗(yàn)、網(wǎng)站內(nèi)鏈、外貿(mào)網(wǎng)站建設(shè)、移動(dòng)網(wǎng)站建設(shè)、網(wǎng)站制作、虛擬主機(jī)
聲明：本網(wǎng)站發(fā)布的內(nèi)容（圖片、視頻和文字）以用戶投稿、用戶轉(zhuǎn)載內(nèi)容為主，如果涉及侵權(quán)請(qǐng)盡快告知，我們將會(huì)在第一時(shí)間刪除。文章觀點(diǎn)不代表本網(wǎng)站立場(chǎng)，如需處理請(qǐng)聯(lián)系客服。電話：028-86922220；郵箱：631063699@qq.com。內(nèi)容未經(jīng)允許不得轉(zhuǎn)載，或轉(zhuǎn)載時(shí)需注明來源： 創(chuàng)新互聯(lián)
- 上海網(wǎng)站制作公司都熟悉的標(biāo)簽優(yōu)化 2021-07-09
- 網(wǎng)站META標(biāo)簽優(yōu)化 2023-04-03
- 成都網(wǎng)站建設(shè)的網(wǎng)站首頁頭部title標(biāo)簽優(yōu)化 2016-08-10
- 使用TAG標(biāo)簽優(yōu)化聚合頁關(guān)鍵字的方法介紹 2023-04-26
- 那些不可忽視的title標(biāo)簽優(yōu)化方法？ 2022-06-21
- 網(wǎng)站內(nèi)頁標(biāo)簽優(yōu)化方法有哪些? 2023-04-30
- 網(wǎng)站建設(shè)中SEO標(biāo)簽優(yōu)化 2021-11-28
- 網(wǎng)站seo中title標(biāo)簽優(yōu)化技巧 2021-06-14
- SEO優(yōu)化之代碼優(yōu)化與標(biāo)簽優(yōu)化 2015-02-08
- 搜索引擎推廣中如何巧用標(biāo)簽優(yōu)化網(wǎng)站？ 2022-09-28
- 網(wǎng)站標(biāo)簽優(yōu)化-關(guān)于H標(biāo)簽的優(yōu)化策略 2016-11-10
- h標(biāo)簽優(yōu)化的重要性有哪些？ 2022-05-28