查看存储节点状态
[root@localhost ~]# cellcli
CellCLI: Release 11.2.3.2.0 - Production on Mon Mar 16 16:52:31 CST 2015
Copyright (c) 2007, 2012, Oracle. All rights reserved.
Cell Efficiency Ratio: 2,169
CellCLI> list cell detail
name: localhost
bbuTempThreshold: 60
bbuChargeThreshold: 800
bmcType: absent
cellVersion: OSS_11.2.3.2.0_LINUX.X64_120713
cpuCount: 1
diagHistoryDays: 7
fanCount: 1/1
fanStatus: normal
flashCacheMode: WriteThrough
id: 029e8a73-bcc2-4759-bed1-c596778dbca8
interconnectCount: 1
iormBoost: 0.0
ipaddress1: 192.168.175.138/24
kernelVersion: 2.6.18-274.el5
makeModel: Fake hardware
metricHistoryDays: 7
offloadEfficiency: 2,168.6
powerCount: 1/1
powerStatus: normal
releaseVersion: 11.2.3.2.0
releaseTrackingBug: 14212264
status: online
temperatureReading: 0.0
temperatureStatus: normal
upTime: 0 days, 2:10
cellsrvStatus: running
msStatus: running
rsStatus: running
CellCLI>
CellCLI> list griddisk
date_CD_disk01_localhost active
date_CD_disk02_localhost active
date_CD_disk03_localhost active
date_CD_disk04_localhost active
date_CD_disk05_localhost active
date_CD_disk06_localhost active
CellCLI>
[grid@localhost ~]$ asmcmd
ASMCMD> lsdsk
Path
/dev/oracleasm/disks/VOL3
o/192.168.175.138/date_CD_disk04_localhost
o/192.168.175.138/date_CD_disk05_localhost
o/192.168.175.138/date_CD_disk06_localhost
ASMCMD>
查看计算节点状态，关闭影响的实例
[grid@localhost ~]$ sqlplus / as sysasm
SQL*Plus: Release 11.2.0.1.0 Production on Mon Mar 16 19:37:46 2015
Copyright (c) 1982, 2009, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
With the Automatic Storage Management option
SQL> select path from v$asm_disk;
PATH
--------------------------------------------------------------------------------
o/192.168.175.138/date_CD_disk01_localhost
o/192.168.175.138/date_CD_disk02_localhost
o/192.168.175.138/date_CD_disk03_localhost
/dev/oracleasm/disks/VOL3
o/192.168.175.138/date_CD_disk05_localhost
o/192.168.175.138/date_CD_disk04_localhost
o/192.168.175.138/date_CD_disk06_localhost
7 rows selected.
SQL>
SQL> select dg.name,a.value from v$asm_diskgroup dg, v$asm_attribute a
2 where dg.group_number=a.group_number and a.name='disk_repair_time';
NAME
------------------------------
VALUE
--------------------------------------------------------------------------------
DG00
3.6h
DG1
3.6h
SQL> shutdown immediate
ASM diskgroups dismounted
ASM instance shutdown
SQL>
配置信任关系
[root@localhost ~]# dcli -g cell_group -l root 'hostname -i'
Address 192.168.175.138 maps to localhost, but this does not map back to the address - POSSIBLE BREAK-IN ATTEMPT!
192.168.175.138: 127.0.0.1
[root@localhost ~]#
ssh-keygen -t rsa
dcli -g cell_group -l root -k
[root@localhost ~]# dcli -g cell_group -l root "cellcli -e alter cell shutdown services all"
Address 192.168.175.138 maps to localhost, but this does not map back to the address - POSSIBLE BREAK-IN ATTEMPT!
192.168.175.138:
192.168.175.138: Stopping the RS, CELLSRV, and MS services...
192.168.175.138: The SHUTDOWN of services was successful.
[root@localhost ~]# ps -ef|grep cell
root 5073 3218 0 15:00 pts/1 00:00:00 /bin/bash /opt/oracle/cell11.2.3.2.0_LINUX.X64_120713/cellsrv/bin/cellcli
root 5081 5073 0 15:00 pts/1 00:00:01 /usr/java/jdk1.5.0_15//bin/java -client -Dpid=5073 -classpath /opt/oracle/cell11.2.3.2.0_LINUX.X64_120713/cellsrv/deploy/dependencies/jline-0.9.9.jar:/opt/oracle/cell11.2.3.2.0_LINUX.X64_120713/cellsrv/lib/ossmgmt-cli.jar:/opt/oracle/cell11.2.3.2.0_LINUX.X64_120713/cellsrv/deploy/dependencies/wsclient_extended.jar
-Djava.util.logging.config.file=/opt/oracle/cell11.2.3.2.0_LINUX.X64_120713/cellsrv/deploy/config/jse-logging.properties jline.ConsoleRunner oracle.ossmgmt.ms.cli.CellCLI 8888
root 29787 28700 0 16:59 pts/3 00:00:00 grep cell
[root@localhost ~]#
[root@localhost ~]# echo $consoletype
pty
[root@localhost ~]#
上传文件
sftp> put -r "F:\p19166601_112331_Linux-x86-64.zip"
Uploading p19166601_112331_Linux-x86-64.zip to /root/p19166601_112331_Linux-x86-64.zip
100% 1716844KB 7948KB/s 00:03:36
F:/p19166601_112331_Linux-x86-64.zip: 1758049168 bytes transferred in 216 seconds (7948 KB/s)
sftp>
解压文件
[root@localhost ~]# unzip p19166601_112331_Linux-x86-64.zip
Archive: p19166601_112331_Linux-x86-64.zip
creating: patch_11.2.3.3.1.140708/
inflating: patch_11.2.3.3.1.140708/sundcs_36p_repository_2.1.3_4.pkg
inflating: patch_11.2.3.3.1.140708/upgradeIBSwitch.sh
creating: patch_11.2.3.3.1.140708/linux.db.rpms/
inflating: patch_11.2.3.3.1.140708/linux.db.rpms/perl-XML-Parser-2.34-6.1.2.2.1.x86_64.rpm
creating: patch_11.2.3.3.1.140708/plugins/
inflating: patch_11.2.3.3.1.140708/plugins/010-check_17854520.sh
inflating: patch_11.2.3.3.1.140708/plugins/000-check_dummy_bash
inflating: patch_11.2.3.3.1.140708/plugins/000-check_dummy_perl
inflating: patch_11.2.3.3.1.140708/11.2.3.3.1.140708.iso
inflating: patch_11.2.3.3.1.140708/imageLogger
inflating: patch_11.2.3.3.1.140708/ExadataSendNotification.pm
inflating: patch_11.2.3.3.1.140708/dostep.sh
inflating: patch_11.2.3.3.1.140708/patchmgr
inflating: patch_11.2.3.3.1.140708/ExaXMLNode.pm
inflating: patch_11.2.3.3.1.140708/11.2.3.3.1.140708.patch.tar
inflating: patch_11.2.3.3.1.140708/README.txt
inflating: patch_11.2.3.3.1.140708/dcli
creating: patch_11.2.3.3.1.140708/etc/
creating: patch_11.2.3.3.1.140708/etc/config/
inflating: patch_11.2.3.3.1.140708/etc/config/inventory.xml
inflating: patch_11.2.3.3.1.140708/README.html
inflating: patch_11.2.3.3.1.140708/sundcs_36p_repository_1.3.3_2.pkg
creating: patch_11.2.3.3.1.140708/ibdiagtools/
creating: patch_11.2.3.3.1.140708/ibdiagtools/topologies/
inflating: patch_11.2.3.3.1.140708/ibdiagtools/topologies/Torus.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/topologies/QuarterRack.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/topologies/FatTree.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/topologies/HalfRack.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/topologies/fetchTopology.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/topologies/mapCheck.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/topologies/fattree.map
inflating: patch_11.2.3.3.1.140708/ibdiagtools/topologies/nm2ports.map
extracting: patch_11.2.3.3.1.140708/ibdiagtools/xmonib.sh
inflating: patch_11.2.3.3.1.140708/ibdiagtools/infinicheck
inflating: patch_11.2.3.3.1.140708/ibdiagtools/dcli
inflating: patch_11.2.3.3.1.140708/ibdiagtools/verify-topology
inflating: patch_11.2.3.3.1.140708/ibdiagtools/topology-zfs
inflating: patch_11.2.3.3.1.140708/ibdiagtools/README
inflating: patch_11.2.3.3.1.140708/ibdiagtools/setup-ssh
inflating: patch_11.2.3.3.1.140708/ibdiagtools/SampleOutputs.txt
inflating: patch_11.2.3.3.1.140708/ibdiagtools/ibping_test
inflating: patch_11.2.3.3.1.140708/ibdiagtools/monitord
inflating: patch_11.2.3.3.1.140708/ibdiagtools/tar_ibdiagtools
extracting: patch_11.2.3.3.1.140708/ibdiagtools/VERSION_FILE
creating: patch_11.2.3.3.1.140708/ibdiagtools/netcheck/
inflating: patch_11.2.3.3.1.140708/ibdiagtools/netcheck/LinuxAdapter.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/netcheck/CommonUtils.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/netcheck/OSAdapter.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/netcheck/spawnProc.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/netcheck/remoteLauncher.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/netcheck/remoteScriptGenerator.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/netcheck/remoteConfig.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/netcheck/SolarisAdapter.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/netcheck/runDiagnostics.pm
inflating: patch_11.2.3.3.1.140708/ibdiagtools/checkbadlinks.pl
inflating: patch_11.2.3.3.1.140708/md5sum_files.lst
inflating: patch_11.2.3.3.1.140708/dostep.sh.tmpl
inflating: patch_11.2.3.3.1.140708/ExadataImageNotification.pl
inflating: patch_11.2.3.3.1.140708/exadataLogger.pm
[root@localhost ~]#
[root@localhost ~]#
升级步骤
(Recommended) Reset the server to a known state using the following command:
[root@localhost patch_11.2.3.3.1.140708]# ./patchmgr -cells ../cell_group -reset_force
2015-03-16 17:13:56 +0800 :DONE: reset_force
[root@localhost patch_11.2.3.3.1.140708]#
Clean up any previous patchmgr utility runs using the following command:
[root@localhost patch_11.2.3.3.1.140708]# ./patchmgr -cells ../cell_group -cleanup
2015-03-16 17:17:34 +0800 :Working: DO: Cleanup ...
2015-03-16 17:17:39 +0800 :SUCCESS: DONE: Cleanup
[root@localhost patch_11.2.3.3.1.140708]#
_EXIT_TIMEOUT_ 2015-03-16 17:55:16 +0800 2015-03-16 17:55:16 +0800
2015-03-16 17:55:16 +0800 :FAILED: Details in files <cell_name>.log /root/patch_11.2.3.3.1.140708/patchmgr.stdout, /root/patch_11.2.3.3.1.140708/patchmgr.stderr
2015-03-16 17:55:16 +0800 :FAILED: DONE: Copy, extract prerequisite check archive to cells. If required start md11 mismatched partner size correction.
[ERROR] Patch prerequisite checks failed. Please run cleanup before retrying.
root@localhost patch_11.2.3.3.1.140708]# ./patchmgr -cells ../cell_group -cleanup
2015-03-16 18:10:30 +0800 :Working: DO: Cleanup ...
cat: /tmp/_EXA_AXE_cell_list_patch_hctap_tsitl_llec_: No such file or directory
2015-03-16 18:10:56 +0800 :FAILED: Details in files /root/patch_11.2.3.3.1.140708/patchmgr.stdout, /root/patch_11.2.3.3.1.140708/patchmgr.stderr
2015-03-16 18:10:56 +0800 :FAILED: DONE: Cleanup
[root@localhost patch_11.2.3.3.1.140708]#
#### 错误原因&& 主要是真实的存储节点文件系统不一样，真实存在系统镜像！
more /root/patch_11.2.3.3.1.140708/patchmgr.stdout
================PatchMgr run started 2015-03-16 18:26:38 +0800 ===========
With arguments: -cells ../cell_group -patch
2015-03-16 18:28:37 +0800 :Working: DO: Initialize files, check space and state of cell services. Up to 1 minute ...
2015-03-16 18:28:59 +0800 ++++++++++++++++++ Logs so far begin ++++++++++
192.168.175.138:
192.168.175.138: _EXIT_PASS_Cell localhost 127.0.0.1
192.168.175.138: ./dostep.sh: line 1966: imageinfo: command not found
192.168.175.138: ./dostep.sh: line 1967: imageinfo: command not found
192.168.175.138: [INFO] Found invalid mount: /dev/mapper/VolGroup00-LogVol00 on / type ext3 (rw).
192.168.175.138: [INFO] Umount -f /dev/mapper/VolGroup00-LogVol00.
192.168.175.138: umount2: Device or resource busy
192.168.175.138: umount: /: device is busy
192.168.175.138: umount2: Device or resource busy
192.168.175.138: umount: /: device is busy
192.168.175.138: umount2: Device or resource busy
192.168.175.138: umount: /var/lib/nfs/rpc_pipefs: device is busy
192.168.175.138: umount2: Device or resource busy
192.168.175.138: umount: /var/lib/nfs/rpc_pipefs: device is busy
192.168.175.138: [ERROR] Failed to umount /dev/mapper/VolGroup00-LogVol00.
192.168.175.138: [INFO] Found invalid mount: sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw).
192.168.175.138: [INFO] Umount -f sunrpc.
192.168.175.138: [ERROR] Failed to umount sunrpc.
192.168.175.138: [ERROR] Command: dmidecode -s system-product-name : returned VMware Virtual Platform
192.168.175.138: Cell localhost 127.0.0.1
192.168.175.138: _EXIT_ERROR_Cell localhost 127.0.0.1 2015-03-16 18:28:59 +0800: Command: dmidecode -s system-product-name : returned VMware Virtual Platform
2015-03-16 18:29:00 +0800 ++++++++++++++++++ Logs so far end ++++++++++
2015-03-16 18:29:00 +0800 :SUCCESS: DONE: Initialize files, check space and state of cell services.
2015-03-16 18:29:00 +0800 :Working: DO: Copy, extract prerequisite check archive to cells. If required start md11 mismatched partner size correction.
Up to 40 minutes ...
2015-03-16 18:29:00 +0800 ++++++++++++++++++ Logs so far begin ++++++++++
2015-03-16 18:29:00 +0800 ++++++++++++++++++ Logs so far end ++++++++++
2015-03-16 18:29:00 +0800 :SUCCESS: DONE: Copy, extract prerequisite check archive to cells. If required start md11 mismatched partner size correcti
on.
[root@localhost ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
35G 18G 16G 54% /
/dev/sda1 99M 42M 53M 45% /boot
tmpfs 1.3G 0 1.3G 0% /dev/shm
_EXIT_TIMEOUT_ 2015-03-16 19:00:15 +0800 2015-03-16 19:00:15 +0800
2015-03-16 19:00:16 +0800 :FAILED: Details in files <cell_name>.log /root/patch_11.2.3.3.1.140708/patchmgr.stdout, /root/patch_11.2.3.3.1.140708/patchmgr.stderr
2015-03-16 19:00:16 +0800 :FAILED: DONE: Copy, extract prerequisite check archive to cells. If required start md11 mismatched partner size correction.
[ERROR] Patch prerequisite checks failed. Please run cleanup before retrying.
## 检测失败，升级失败。
[root@localhost patch_11.2.3.3.1.140708]# ./patchmgr -cells ../cell_group -patch -ignore_alerts
NOTE Cells will reboot during the patch or rollback process.
NOTE For non-rolling patch or rollback, ensure all ASM instances using
NOTE the cells are shut down for the duration of the patch or rollback.
NOTE For rolling patch or rollback, ensure all ASM instances using
NOTE the cells are up for the duration of the patch or rollback.
WARNING Do not start more than one instance of patchmgr.
WARNING Do not interrupt the patchmgr session.
WARNING Do not alter state of ASM instances during patch or rollback.
WARNING Do not resize the screen. It may disturb the screen layout.
WARNING Do not reboot cells or alter cell services during patch or rollback.
WARNING Do not open log files in editor in write mode or try to alter them.
NOTE All time estimates are approximate. Timestamps on the left are real.
NOTE You may interrupt this patchmgr run in next 60 seconds with control-c.
## 忽略检测，升级依然失败!
[root@localhost patch_11.2.3.3.1.140708]# ./patchmgr -cells ../cell_group -patch -ignore_alerts
NOTE Cells will reboot during the patch or rollback process.
NOTE For non-rolling patch or rollback, ensure all ASM instances using
NOTE the cells are shut down for the duration of the patch or rollback.
NOTE For rolling patch or rollback, ensure all ASM instances using
NOTE the cells are up for the duration of the patch or rollback.
WARNING Do not start more than one instance of patchmgr.
WARNING Do not interrupt the patchmgr session.
WARNING Do not alter state of ASM instances during patch or rollback.
WARNING Do not resize the screen. It may disturb the screen layout.
WARNING Do not reboot cells or alter cell services during patch or rollback.
WARNING Do not open log files in editor in write mode or try to alter them.
NOTE All time estimates are approximate. Timestamps on the left are real.
NOTE You may interrupt this patchmgr run in next 60 seconds with control-c.
./patchmgr: line 1772: /tmp/_EXA_AXE_cell_list_patch_hctap_tsitl_llec_: Is a directory
cat: /tmp/_EXA_AXE_cell_list_patch_hctap_tsitl_llec_: Is a directory
ERROR Cell list file is empty !
/bin/rm: cannot remove `/tmp/_EXA_AXE_cell_list_patch_hctap_tsitl_llec_': Is a directory
## 删除目录升级
[root@localhost patch_11.2.3.3.1.140708]# ./patchmgr -cells ../cell_group -patch -ignore_alerts
NOTE Cells will reboot during the patch or rollback process.
NOTE For non-rolling patch or rollback, ensure all ASM instances using
NOTE the cells are shut down for the duration of the patch or rollback.
NOTE For rolling patch or rollback, ensure all ASM instances using
NOTE the cells are up for the duration of the patch or rollback
WARNING Do not start more than one instance of patchmgr.
WARNING Do not interrupt the patchmgr session.
WARNING Do not alter state of ASM instances during patch or rollback.
WARNING Do not resize the screen. It may disturb the screen layout.
WARNING Do not reboot cells or alter cell services during patch or rollback.
WARNING Do not open log files in editor in write mode or try to alter them.
NOTE All time estimates are approximate. Timestamps on the left are real.
NOTE You may interrupt this patchmgr run in next 60 seconds with control-c.
warning: /root/patch_11.2.3.3.1.140708/linux.db.rpms/perl-XML-Parser-2.34-6.1.2.2.1.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159
2015-03-16 19:09:00 +0800 :Working: DO: Initialize files, check space and state of cell services. Up to 1 minute ...
2015-03-16 19:11:09 +0800 :SUCCESS: DONE: Initialize files, check space and state of cell services.
2015-03-16 19:11:09 +0800 :Working: DO: Copy, extract prerequisite check archive to cells. If required start md11 mismatched partner size correction. Up to 40 minutes ...
2015-03-16 19:11:09 +0800 :SUCCESS: DONE: Copy, extract prerequisite check archive to cells. If required start md11 mismatched partner size correction.
2015-03-16 19:11:21 +0800 Wait correction of degraded md11 due to md partner size mismatch. Up to 30 minutes.
...
cat: /tmp/_EXA_AXE_cell_list_patch_hctap_tsitl_llec_: No such file or directory
cat: /tmp/_EXA_AXE_cell_list_patch_hctap_tsitl_llec_: No such file or directory
grep: /tmp/_EXA_AXE_cell_list_patch_hctap_tsitl_llec_: No such file or directory
grep: /tmp/_EXA_AXE_cell_list_patch_hctap_tsitl_llec_: No such file or directory
TIMEOUT for following cells
_EXIT_TIMEOUT_ 2015-03-16 19:42:22 +0800 2015-03-16 19:42:22 +0800
2015-03-16 19:42:23 +0800 :FAILED: Details in files <cell_name>.log /root/patch_11.2.3.3.1.140708/patchmgr.stdout, /root/patch_11.2.3.3.1.140708/patchmgr.stderr
2015-03-16 19:42:23 +0800 :FAILED: DONE: Copy, extract prerequisite check archive to cells. If required start md11 mismatched partner size correction.
[ERROR] Patch prerequisite checks failed. Please run cleanup before retrying.
今晚虚拟升级失败！