Saturday, October 22, 2022

Extended grep use and example on UNIX and AIX server

 How AIX and UNIX admin use extended grep with example.

----------------------------------------------------------------------------

AIX and UNIX

Lets observe following example where AIX admin wanted to check path of  storage disk.

#lspath |grep -w "hdisk2"

#lspath |grep -w "hdisk3"

#lspath |grep -w "hdisk4"

Instead of typing above single command for getting path details, AIX admin can use following extended grep.


#lspath |grep -E " hdisk2 |hdisk 3 |hdisk4"

above command will display path information for hdisk2 ,hdisk3 and hdisk4.






Thanks !!!!!

Friday, October 14, 2022

Move resource group from one node to other using clRGmove command

Move resource group from one node to other AIX hacmp
-------------------------------------------------------------------------
AIX admin also use command to move RG,like below

clRGmove -g <RG> -n  <node> -m

<RG> --This is resource group name
-n  --This is for node name is HACMP cluster

After RG movement completed successfully use following command to confirm if resource group movement completed successfully.

#clRGinfo
#lssrc -ls clstrmgrES |grep -i state   // To check cluster state

Always Take cluster snapshot before doing any criticle activity, also make sure that admin have all pre-chek and mksysb.

How to move resource group using smitty menu
--------------------------------------------

smitty hacmp

                    HACMP for AIX

Move cursor to desired item and press Enter.

  Initialization and Standard Configuration
  Extended Configuration
  System Management (C-SPOC)
  Problem Determination Tools

Select "System Management"

----------------------------------------------------------------------------------------------------------------

         System Management (C-SPOC)

Move cursor to desired item and press Enter.

  Manage HACMP Services
  HACMP Communication Interface Management
  HACMP Resource Group and Application Management
  
  
  Open a SMIT Session on a Node

Select "HACMP Resource Group and Application Management"

----------------------------------------------------------------------------------------------------------------

          HACMP Resource Group and Application Management

Move cursor to desired item and press Enter.

  Show the Current State of Applications and Resource Groups
  Bring a Resource Group Online
  Bring a Resource Group Offline
  Move a Resource Group to Another Node / Site

  Suspend/Resume Application Monitoring
  Application Availability Analysis

Select "Move a Resource Group to Another Node / Site"

----------------------------------------------------------------------------------------------------------------

           Move a Resource Group to Another Node / Site

Move cursor to desired item and press Enter.

  Move Resource Groups to Another Node
  Move Resource Groups to Another Site

Select "Move Resource Groups to Another Node"

----------------------------------------------------------------------------------------------------------------

		   Select a Resource Group                      
                                                                         
 Move cursor to desired item and press Enter.                             
                                                                          
   #                                                                      
   # Resource Group                State                Node(s) / Site    
   #                                                                      
     app_rg                       ONLINE                node1 /         
     data_rg                      ONLINE                node2 /        
                                                                          
   

Select the resource group to be moved.

----------------------------------------------------------------------------------------------------------------

		   Select a Destination Node                         
                                                                          
  Move cursor to desired item and press Enter.                             
                                                                                                 
    # *Denotes Originally Configured Highest Priority Node                 
      node2   
      

Select a destination node.

----------------------------------------------------------------------------------------------------------------

         Move Resource Group(s) to Another Node

Type or select values in entry fields.
Press Enter AFTER making all desired changes.

                                                        [Entry Fields]
  Resource Group(s) to be Moved                       app_rg
  Destination Node                                    node2

Confirm the entry fields are correct and press Enter

----------------------------------------------------------------------------------------------------------------

  Command: OK            stdout: yes           stderr: no

Before command completion, additional instructions may appear below.

Attempting to move resource group app_rg to node node2.

Waiting for the cluster to process the resource group movement request....

Waiting for the cluster to stabilize........................................

Resource group movement successful.
Resource group app_rg is online on node2.


Cluster Name: node2

Resource Group Name: app_rg
Node                         State
---------------------------- ---------------
node2                       ONLINE
node1                       OFFLINE

Resource Group Name: data_rg
Node                         State
---------------------------- ---------------
node2                       OFFLINE
node1                       ONLINE

----------------------------------------------------------------------------------------------------------------



Thanks !!!!

Shutdown service on GPFS node

 GPFS on AIX

------------------------------------------------------

On GPFS node sometime AIX admin need to stop GPFS on  that specific node.

command for that is:


mmshutdown -N nodename //stop gpfs service on only specific node

mmshutdown -a //it will stop GPFS on all node of cluster

mmgetstate -aLs //show status of GPFS cluster,generally use for GPFS cluster health check

mmstartup -a //It will start GPFS on all cluster node




IOCP in defined state in AIX LPAR

 How to enable/configure  IOCP on AIX LPAR without rebooting AIX LPAR




sometime AIX admin come across situation where oracle/db2/SAP team request to enable defined IOCP port to available.

Also make sure that following fileset are installed on AIX LPAR

#lslpp -l bos.iocp.rte

Fileset Level State Description ---------------------------------------------------------------------------- Path: /usr/lib/objrepos bos.iocp.rte 5.3.9.0 APPLIED I/O Completion Ports API Path: /etc/objrepos bos.iocp.rte 5.3.0.50 COMMITTED I/O Completion Ports API

----------------------------------------------------------- ----------------------------------

  1. use root user id for executing "smitty iocp".
  2. Check IOCP by executting following command 

lsdev-Cc iocp

output:

    • iocp0 Defined  I/O Completion Ports  //using smitty iocp enable
    • iocp0 Available  I/O Completion Ports // No need to enable IOCP
  1.  smitty  iocp
  2. Select Configure Defined I/O Completion Ports.

When command complete, 

output  iocp0 Available.

  1. EXIT from smitty menu.
  2. Execute following command to check status of IOCP using command .

lsdev -Cc iocp

Output should read iocp0 Available  I/O Completion Ports.

IF still iocp0 is in defined state then execute "cfgmgr" command to enable it.

If AIX admin want to enable iocp0 permanantly, AIX admin must choose following option

at smitty menu

"At system restart, change the configured state from Defined to Available"

Thanks !!!!!

 


Trial capacity on Demand for AIX LPAR on POWER system frame -TCOD

 Trial/Temporary Capacity on Demand (CoD) -- AIX



What is Trial capacity on Demand??

Answer:

You can evaluate the use of inactive processors, memory, or both, at no charge using Trial CoD. 

After it is started, the trial period is available for 30 power-on days.


How to enable Temporary TCOD on AIX Frame:

In our environment we tried to enable it for 24hrs only and its temporary

=========================================================================


AIX LPAR   Current PU         Current VP                  Target PU      Target VP

gold_LPAR     2 4 8 10

Silver_LPAR     1 4 8 10

Diamond_LPAR  2         4        8         10

Marble_LPAR      2 4 8 10


Before proceeding for TCOD and DLPAR operation make sure that on the AIX frame enough free CPU processing units are available.

if not then AIX admin need to get those.


Step 1

Login to HMC

step 2

select frame, where AIX admin wants to perform TCOD

step 3

Select COD Functions --->

Under on/off Processor choose ----->manage

Here enter:

1. Number of On/Off COD processor: 25

2.Number of Days:1


How we calculate Number of On/Off COD processor??

Answer:

Total Current processing units: 2+1+2+2=7

Total Target Processing Units=8+8+8+8=32


2 case we need to consider here before adding "Number of On/Off COD processor"

Case 1 where no no free processing units available

If on our AIX Frame there is no free processing units available, then AIX admin need to add total 25 processing units under step3.

--------------------------------------------------------------------------------------------------------------------------------

Case 2

If there is 10 processing units free on AIX frame then AIX admin can add 15 processing units.


Target requirement 25 and free on AIX Frame is 10


Target Processing UNITS- Free Processing units on AIX frame= 15


so need to add only 15 prcessor under step 3 "Nmber of On/Off COD 


Step 4:

Business requirement is for 24 hrs only so we are mentioning 1 day here

Number of Days:1


AIX admin need to deactive/remove CPU resource before specified time expires ,using DLPAR option.

If he forgot to do so will get charged for extra day.


step 5:

Then AIX admin need to make sure that these units are showing as free on AIX frame.

once he sure that,there are 25 processing units are free he can proceed for DLPAR operation of "Entitled Processing units" and "Virtual Processing units"



step 6:


After DLPAR operation performed by AIX Admin , he assigned "Target Processing Units" and "Target Virtual processor", he need to take command line session 

of HMC using hscroot to to run optimizer command using hscroot user


#lsmemopt -m sys -o currscore -r lpar


Above command will show score value ,till we get value 95 we have to run following optimizer command

once you run optimizer command wait for 15-20 minutes and check score using "lsmemopt" command.


Optimize command:


#optmem -m <frame name> -t affinity -o start


Example of command if my frame name is p9117-pmmd-hmc10


 To list score 

----------------

lsmemopt -m p9117-pmmd-hmc10 -o currscore -r lpar


To optimize on specific frame

==============================


optmem -m p9117-pmmd-hmc10 -t affinity -o start


**once AIX admin get score is equal to 95 or greater that 95 then no need to execute optimizer command

====================================================================================================


How AIX admin will deactivate TCOD before time expire:


step 1.


Go to HMC perform DLPAR and assign "processsing units" and Virtual Processor which was set before TCOD operation.


step 2: once "processing units" are free, AIX admin confirm this by checking at frame level.


step 3: Once he sure that "processor are free he needs to follow below sequence:


a. 

Select COD Functions --->

Under on/off Processor choose ----->manage

Here enter :

1. Number of On/Off COD processor: 0

2.Number of Days:0


Then press OK button. AIX admin confirm this by checking free available processing units at frame level.


b.

AIX admin must run following 2 command


To list score 

----------------

lsmemopt -m p9117-pmmd-hmc10 -o currscore -r lpar


To optimize on specific frame

==============================


#optmem -m p9117-pmmd-hmc10 -t affinity -o start


**once AIX admin get score is equal to 95 or greater that 95 then no need to execute optimizer command




Thanks  !!!!


Friday, October 7, 2022

Run full fsck on AIX lpar for superblock corruption

Run full fsck on AIX LPAR for superblock corruption incident
--------------------------------------------------------------------------

One of the file system on AIX was not mounted and when tried to mount it throwing following error:

----------------------------------------------------------------------------
But before running fsck, which things AIX admin need to check:

1. Check with backup team, for latest backup of affected filesystem.
2. if it's any application/DB filesystem then need to take necessary down time and approval before performing fsck to fix superblock dirty issue.
-------------------------------------------------------------------------

----------------$$$$$$$$$$$$$-------------------------------------
Error details:
mount:0506:324 can not mount

Superblock is dirty on /dev/oraclelv .
Run full fsck to fix this.
----------------$$$$$$$$$$$$$-------------------------------------

Solution AIX admin used: 

#fsck -yvv /dev/oraclelv      //Full fsck command to fix superblock dirty issue

After fsck fixed superblock then execute following command to mount file system 

mount /orafs




Thanks !!!