OracleRAC環(huán)境下ASM磁盤(pán)組擴(kuò)容

Oracle RAC環(huán)境下ASM磁盤(pán)組擴(kuò)容

生產(chǎn)環(huán)境注意調(diào)整以下參數(shù)：

我們提供的服務(wù)有：成都網(wǎng)站建設(shè)、網(wǎng)站設(shè)計(jì)、微信公眾號(hào)開(kāi)發(fā)、網(wǎng)站優(yōu)化、網(wǎng)站認(rèn)證、湘陰ssl等。為上千余家企事業(yè)單位解決了網(wǎng)站和推廣的問(wèn)題。提供周到的售前咨詢(xún)和貼心的售后服務(wù)，是有科學(xué)管理、有技術(shù)的湘陰網(wǎng)站制作公司

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

+ 1.節(jié)點(diǎn)間滾動(dòng)添加UDEV磁盤(pán)

+ 2.ASM 內(nèi)存大小

+ 3.POWER_LIMIT別弄太大

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

實(shí)驗(yàn)環(huán)境

--系統(tǒng)環(huán)境:Centos 6.10

--數(shù)據(jù)庫(kù)：Oracle 11g RAC

--磁盤(pán)綁定：udev

實(shí)驗(yàn)?zāi)康?/p>

--存儲(chǔ)空間不足，需要給磁盤(pán)組DATA加一塊磁盤(pán)

準(zhǔn)備工作

1.檢查各個(gè)節(jié)點(diǎn)database、asm及grid日志是否有錯(cuò)誤信息

2.檢查各個(gè)節(jié)點(diǎn)服務(wù)狀態(tài)(切換到grid用戶(hù))

--列出數(shù)據(jù)庫(kù)名

[grid@node2 ~]$ srvctl config database

RacNode

[grid@node2 ~]$

--實(shí)例狀態(tài)

[grid@node2 ~]$ srvctl status database -d RacNode

Instance RacNode1 is running on node node1

Instance RacNode2 is running on node node2

[grid@node2 ~]$

--集群狀態(tài):

[grid@node2 ~]$ crsctl check cluster -all

**************************************************************

node1:

CRS-4537: Cluster Ready Services is online

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

**************************************************************

node2:

CRS-4537: Cluster Ready Services is online

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

**************************************************************

[grid@node2 ~]$

--集群資源狀態(tài)

[grid@node2 ~]$ crsctl status res -t

3.ASM磁盤(pán)組及磁盤(pán)檢查

[grid@node1 ~]$ export ORACLE_SID=+ASM1

[grid@node1 ~]$ sqlplus /nolog

SQL> conn /as sysasm

--顯示使用ASM磁盤(pán)組的數(shù)據(jù)庫(kù)

SQL> col INSTANCE_NAME format a20

SQL> col SOFTWARE_VERSION format a20

SQL> select * from gv$asm_client order by 1,2;

INST_ID GROUP_NUMBER INSTANCE_NAME DB_NAME STATUS SOFTWARE_VERSION COMPATIBLE_VERSION

---------- ------------ -------------------- -------- ------------ -------------------- ---------------------

1 1 RacNode1 RacNode CONNECTED 11.2.0.4.0 11.2.0.4.0

1 1 +ASM1 +ASM CONNECTED 11.2.0.4.0 11.2.0.4.0

1 3 +ASM1 +ASM CONNECTED 11.2.0.4.0 11.2.0.4.0

2 1 RacNode2 RacNode CONNECTED 11.2.0.4.0 11.2.0.4.0

2 1 +ASM2 +ASM CONNECTED 11.2.0.4.0 11.2.0.4.0

2 3 +ASM2 +ASM CONNECTED 11.2.0.4.0 11.2.0.4.0

SQL>

--顯示磁盤(pán)組

SQL> select group_number,name,state,type,total_mb,free_mb,usable_file_mb,allocation_unit_size/1024/1024 unit_mb from v$asm_diskgroup order by 1;

GROUP_NUMBER NAME STATE TYPE TOTAL_MB FREE_MB USABLE_FILE_MB UNIT_MB

------------ ------------------------------ ----------- ------ ---------- ---------- -------------- ----------

1 DATA MOUNTED NORMAL 4096 477 -273 1

2 FLASH MOUNTED EXTERN 2048 1951 1951 1

3 OCRVOTE MOUNTED NORMAL 3072 2146 561 1

SQL>

--顯示磁盤(pán)

SQL> col NAME format a25

SQL> col PATH format a40

SQL> col FAILGROUP format a25

SQL> select group_number,name,path,mount_status,state,redundancy,total_mb,free_mb,failgroup,create_date from v$asm_disk order by 1,2;

GROUP_NUMBER NAME PATH MOUNT_S STATE REDUNDA TOTAL_MB FREE_MB FAILGROUP CREATE_DA

------------ ------------------------- ---------------------------------------- ------- -------- ------- ---------- ---------- ------------------------- ---------

1 DATA_0000 /dev/asm-data01 CACHED NORMAL UNKNOWN 1024 118 DATA_0000 11-DEC-18

1 DATA_0001 /dev/asm-data02 CACHED NORMAL UNKNOWN 1024 125 DATA_0001 11-DEC-18

1 DATA_0002 /dev/asm-data03 CACHED NORMAL UNKNOWN 1024 115 DATA_0002 11-DEC-18

1 DATA_0003 /dev/asm-data04 CACHED NORMAL UNKNOWN 1024 119 DATA_0003 11-DEC-18

2 FLASH_0000 /dev/asm-arch01 CACHED NORMAL UNKNOWN 1024 975 FLASH_0000 11-DEC-18

2 FLASH_0001 /dev/asm-arch02 CACHED NORMAL UNKNOWN 1024 976 FLASH_0001 11-DEC-18

3 OCRVOTE_0000 /dev/asm-ocrvote01 CACHED NORMAL UNKNOWN 1024 715 OCRVOTE_0000 11-DEC-18

3 OCRVOTE_0001 /dev/asm-ocrvote02 CACHED NORMAL UNKNOWN 1024 715 OCRVOTE_0001 11-DEC-18

3 OCRVOTE_0002 /dev/asm-ocrvote03 CACHED NORMAL UNKNOWN 1024 716 OCRVOTE_0002 11-DEC-18

SQL>

4.系統(tǒng)層面UDEV信息

[root@node2 ~]# cat /etc/udev/rules.d/99-oracle-asmdevices.rules

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB132e6928-d49d18d4", NAME="asm-ocrvote01", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB58647ee7-b466963a", NAME="asm-ocrvote02", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB4c771d58-f17105b9", NAME="asm-ocrvote03", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB88c685cb-3a4633f4", NAME="asm-data01", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB1b30fd18-af14e003", NAME="asm-data02", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB67a4423a-e151f28b", NAME="asm-data03", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB81f04366-170fc910", NAME="asm-data04", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB9a0f6e52-bcfcb52c", NAME="asm-arch01", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB1f2bac75-512a46ae", NAME="asm-arch02", OWNER="grid", GROUP="asmadmin", MODE="0660"

[root@node2 ~]#

[root@node2 ~]# ll /dev/asm-*

brw-rw---- 1 grid asmadmin 8, 16 Dec 12 17:22 /dev/asm-arch01

brw-rw---- 1 grid asmadmin 8, 32 Dec 12 16:21 /dev/asm-arch02

brw-rw---- 1 grid asmadmin 8, 48 Dec 12 17:22 /dev/asm-data01

brw-rw---- 1 grid asmadmin 8, 64 Dec 12 17:22 /dev/asm-data02

brw-rw---- 1 grid asmadmin 8, 80 Dec 12 17:22 /dev/asm-data03

brw-rw---- 1 grid asmadmin 8, 96 Dec 12 17:22 /dev/asm-data04

brw-rw---- 1 grid asmadmin 8, 112 Dec 12 17:22 /dev/asm-ocrvote01

brw-rw---- 1 grid asmadmin 8, 128 Dec 12 17:22 /dev/asm-ocrvote02

brw-rw---- 1 grid asmadmin 8, 144 Dec 12 17:22 /dev/asm-ocrvote03

[root@node2 ~]#

進(jìn)入實(shí)驗(yàn)階段

1.停止對(duì)應(yīng)數(shù)據(jù)庫(kù)的業(yè)務(wù)

2.檢查數(shù)據(jù)庫(kù)會(huì)話(huà)及停止監(jiān)聽(tīng)

--檢查各個(gè)節(jié)點(diǎn)監(jiān)聽(tīng)狀態(tài)

[grid@node1 ~]$ srvctl status listener -n node1

Listener LISTENER is enabled on node(s): node1

Listener LISTENER is running on node(s): node1

[grid@node1 ~]$ srvctl status listener -n node2

Listener LISTENER is enabled on node(s): node2

Listener LISTENER is running on node(s): node2

[grid@node1 ~]$

--禁止監(jiān)聽(tīng)自啟動(dòng)

[grid@node1 ~]$ srvctl disable listener -n node1

[grid@node1 ~]$ srvctl disable listener -n node2

--停止監(jiān)聽(tīng)

[grid@node1 ~]$ srvctl stop listener -n node1

[grid@node1 ~]$ srvctl stop listener -n node2

--查看停止及關(guān)閉自啟后的監(jiān)聽(tīng)狀態(tài)

[grid@node1 ~]$ srvctl status listener -n node1

Listener LISTENER is disabled on node(s): node1

Listener LISTENER is not running on node(s): node1

[grid@node1 ~]$ srvctl status listener -n node2

Listener LISTENER is disabled on node(s): node2

Listener LISTENER is not running on node(s): node2

[grid@node1 ~]$

3.關(guān)閉數(shù)據(jù)庫(kù)

--檢查數(shù)據(jù)庫(kù)配置

[grid@node1 ~]$ srvctl config database -d RacNode

Database unique name: RacNode

Database name: RacNode

Oracle home: /u01/app/oracle/11.2.0/dbhome_1

Oracle user: oracle

Spfile: +DATA/RacNode/spfileRacNode.ora

Domain:

Start options: open

Stop options: immediate

Database role: PRIMARY

Management policy: AUTOMATIC

Server pools: RacNode

Database instances: RacNode1,RacNode2

Disk Groups: DATA

Mount point paths:

Services:

Type: RAC

Database is administrator managed

[grid@node1 ~]$

--禁止數(shù)據(jù)庫(kù)自啟動(dòng)（需切換root用戶(hù)）

[root@node2 ~]# cd /u01/app/11.2.0/grid/bin

[root@node2 bin]# ./srvctl disable database -d RacNode

[root@node2 bin]#

--關(guān)閉數(shù)據(jù)庫(kù)

[grid@node1 ~]$ srvctl stop database -d RacNode

[grid@node1 ~]$

--檢查關(guān)閉后數(shù)據(jù)庫(kù)狀態(tài)

[grid@node1 ~]$ srvctl status database -d RacNode

Instance RacNode1 is not running on node node1

Instance RacNode2 is not running on node node2

[grid@node1 ~]$

4.關(guān)閉集群軟件

--查看各個(gè)節(jié)點(diǎn)集群是否為自啟動(dòng)

[root@node1 bin]# ./crsctl config has

CRS-4622: Oracle High Availability Services autostart is enabled.

[root@node1 bin]#

[root@node2 bin]# ./crsctl config has

CRS-4622: Oracle High Availability Services autostart is enabled.

--禁止各個(gè)節(jié)點(diǎn)的自啟動(dòng)

[root@node1 bin]# ./crsctl disable has

CRS-4621: Oracle High Availability Services autostart is disabled.

[root@node1 bin]#

[root@node2 bin]# ./crsctl disable has

CRS-4621: Oracle High Availability Services autostart is disabled.

[root@node2 bin]#

--查看各個(gè)節(jié)點(diǎn)禁止自啟動(dòng)是否生效

[root@node1 bin]# ./crsctl config has

CRS-4621: Oracle High Availability Services autostart is disabled.

[root@node1 bin]#

[root@node2 bin]# ./crsctl config has

CRS-4621: Oracle High Availability Services autostart is disabled.

[root@node2 bin]#

--停止各個(gè)節(jié)點(diǎn)集群

[root@node1 bin]# ./crsctl stop has

[root@node2 bin]# ./crsctl stop has

5.系統(tǒng)層面添加磁盤(pán)(存儲(chǔ)工程師協(xié)助完成)

6.各個(gè)節(jié)點(diǎn)使用UDEV添加磁盤(pán)

--確定盤(pán)符

fdisk -l

/dev/sdk

/dev/sdl

/dev/sdm

/dev/sdn

--獲取綁定規(guī)則

for i in k l m n

echo "KERNEL==\"sd*\", BUS==\"scsi\", PROGRAM==\"/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/\$name\", RESULT==\"`/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/sd$i`\", NAME=\"asm-disk$i\", OWNER=\"grid\", GROUP=\"asmadmin\", MODE=\"0660\""

done

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB00e4d091-5990307e", NAME="asm-data05", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB8bc8125c-72dacc92", NAME="asm-data06", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VBc195c913-00f6c68e", NAME="asm-data07", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="1ATA_VBOX_HARDDISK_VB720e4cca-32c20936", NAME="asm-data08", OWNER="grid", GROUP="asmadmin", MODE="0660"

--各個(gè)節(jié)點(diǎn)將規(guī)則添加到rule文件99-oracle-asmdevices.rules

--重啟udev

[root@node1 rules.d]# start_udev

[root@node2 rules.d]# start_udev

--確認(rèn)添加磁盤(pán)，確保各個(gè)節(jié)點(diǎn)可以識(shí)別到磁盤(pán)且一致

[root@node2 rules.d]# ll /dev/asm-*

brw-rw---- 1 grid asmadmin 8, 16 Dec 13 16:02 /dev/asm-arch01

brw-rw---- 1 grid asmadmin 8, 32 Dec 13 16:02 /dev/asm-arch02

brw-rw---- 1 grid asmadmin 8, 48 Dec 13 16:02 /dev/asm-data01

brw-rw---- 1 grid asmadmin 8, 64 Dec 13 16:02 /dev/asm-data02

brw-rw---- 1 grid asmadmin 8, 80 Dec 13 16:02 /dev/asm-data03

brw-rw---- 1 grid asmadmin 8, 96 Dec 13 16:02 /dev/asm-data04

brw-rw---- 1 grid asmadmin 8, 160 Dec 13 16:13 /dev/asm-data05

brw-rw---- 1 grid asmadmin 8, 176 Dec 13 16:13 /dev/asm-data06

brw-rw---- 1 grid asmadmin 8, 192 Dec 13 16:13 /dev/asm-data07

brw-rw---- 1 grid asmadmin 8, 208 Dec 13 16:13 /dev/asm-data08

brw-rw---- 1 grid asmadmin 8, 112 Dec 13 16:02 /dev/asm-ocrvote01

brw-rw---- 1 grid asmadmin 8, 128 Dec 13 16:02 /dev/asm-ocrvote02

brw-rw---- 1 grid asmadmin 8, 144 Dec 13 16:02 /dev/asm-ocrvote03

[root@node2 rules.d]#

7.啟動(dòng)集群

[root@node1 bin]# ./crsctl start has

CRS-4123: Oracle High Availability Services has been started.

[root@node2 bin]# ./crsctl start has

CRS-4123: Oracle High Availability Services has been started.

[root@node2 bin]#

--檢查集群的各個(gè)組件是否啟動(dòng)正常

[grid@node2 ~]$ crsctl status res -t

此時(shí)，監(jiān)聽(tīng)和數(shù)據(jù)庫(kù)服務(wù)是停掉的

8.ASM擴(kuò)容

--檢查asm是否識(shí)別到未添加的磁盤(pán)

SQL> set line 200

SQL> col NAME format a25

SQL> col PATH format a40

SQL> col FAILGROUP format a25

SQL> select group_number,name,path,mount_status,state,redundancy,total_mb,free_mb,failgroup,create_date from v$asm_disk order by 1,2;

GROUP_NUMBER NAME PATH MOUNT_S STATE REDUNDA TOTAL_MB FREE_MB FAILGROUP CREATE_DA

------------ ------------------------- ---------------------------------------- ------- -------- ------- ---------- ---------- ------------------------- ---------

0 /dev/asm-data07 CLOSED NORMAL UNKNOWN 0 0

0 /dev/asm-data08 CLOSED NORMAL UNKNOWN 0 0

0 /dev/asm-data06 CLOSED NORMAL UNKNOWN 0 0

0 /dev/asm-data05 CLOSED NORMAL UNKNOWN 0 0