Columns missing in ARSSYS after upgrade to 10.1 from 9.5

[ibmarthin]

How do I fix this?

Problem with table: ARSSYS after upgrade to V10.1.
It seems that 5 Columns are missing in table : ARSSYS
 
When Starting ARSSOCKD Ondemand ends and says:

---- WEDNESDAY, 29 APR 2020 ----                                             
 IEF403I ARSSOCKD - STARTED - TIME=12.41.38                                 
 ARS0013E ARSSOCKD DB Error: æDB2 FOR OS/390åæODBC DRIVERåæDSN12015å
 DSNT408I SQLCODE = -206, ERROR:  KEYSTORE_TYPE IS NOT VALID IN THE         
 CONTEXT                WHERE IT IS USED                                     
                        DSNT418I SQLSTATE   = 42703 SQLSTATE RETURN CODE     
                                 DSNT415I SQLERRP    = DSNXORSO SQL         
 PROCEDURE DETECTING ERROR                     DSNT416I SQLERRD    = -       
 100  0  0  -1  0  0 SQL DIAGNOSTIC INFORMATION            DSNT416I         
 SQLERRD    = X'FFFFFF9C'  X'00000000'  X'00000000'  X'FFFFFFFF'             
          X'00000000'  X'00000000' SQL DIAGNOSTIC INFORMATION               
           ERRLOC=5:10:1 -- SQLSTATE=42S22, SQLCODE=-206, File=arssys.c, Line=3827                                                                   
 ARS0151E ARSMSG Unable to initialize server database system parameters.  Contact your system administrator.                                        
-
I located the SQL in DB2 log: 
SELECT  keystore_type , keystore_location , keystore_mkl ,   
               keystore_mkl_dt , data_ekey 
                           FROM ZSTARSS.ARSSYS FETCH FIRST 1 ROW ONLY 
                         OPTIMIZE FOR 1 ROW FOR FETCH ONLY

All listed columns are missing in ARSSYS table. And ARSSYS has not been updated since 2016.
Before that I ran  the update steps. With nothing related to missing the colums :

/usr/lpp/ars/V10R1M0/bin/arsdb -I ARCHIVE -vu
These comes 9 times:
ARS4121I Altering table ARSSYS                 
[/i]ARS4123I Table ARSSYS has already been updated
And no errors

/usr/lpp/ars/V10R1M0/bin/arsdb -I ARCHIVE -vr      
Only this error is displayed:
ARS4035E Unable to create index ZSTARSS.arsag_name_idx                         

/usr/lpp/ars/V10R1M0/bin/arsdb -I ARCHIVE -vfe       ;
Table arssys is not deleted

/usr/lpp/ars/V10R1M0/bin/arsdb -I ARCHIVE -mv
Updating runstat statistics for table ZSTARSS.arssys   
And no errors
                       

[Ed_Arnold]

> ARS4035E Unable to create index...

Permissions issue?

Ed

[ibmarthin]

The error is not permission :

ARS4034I Creating index ZSTARSS.arsag_name_idx                                   
ARS4054E DB Error: æDB2 FOR OS/390åæODBC DRIVERåæDSN12015å                       
 DSNT408I SQLCODE = -601, ERROR:  THE NAME (VERSION OR VOLUME SERIAL NUMBER) OF 
          THE OBJECT TO BE DEFINED OR THE TARGET OF A RENAME STATEMENT IS       
          IDENTICAL TO THE EXISTING NAME (VERSION OR VOLUME SERIAL NUMBER)       
          ZSTARSS.ARSAG_NAME_IDX OF THE OBJECT TYPE INDEX                       
 DSNT418I SQLSTATE   = 42710 SQLSTATE RETURN CODE                               
 DSNT415I SQLERRP    = DSNXISB1 SQL PROCEDURE DETECTING ERROR                   
 DSNT416I SQLERRD    = 120  0  0  -1  0  0 SQL DIAGNOSTIC INFORMATION           
 DSNT416I SQLERRD    = X'00000078'  X'00000000'  X'00000000'  X'FFFFFFFF'       
          X'00000000'  X'00000000' SQL DIAGNOSTIC INFORMATION                   
  ERRLOC=5:10:1 -- SQLSTATE=42S11, SQLCODE=-601                                 
ARS4035E Unable to create index ZSTARSS.arsag_name_idx                           

And a closer look in the output also shows this:

ARS4054E DB Error: æDB2 FOR OS/390åæODBC DRIVERåæDSN12015å               
 DSNT408I SQLCODE = -205, ERROR:  DOC_UUID IS NOT A COLUMN OF TABLE       
          ZSTARSS.ARSHOLDMAP                                             
 DSNT418I SQLSTATE   = 42703 SQLSTATE RETURN CODE                         
 DSNT415I SQLERRP    = DSNXIIKY SQL PROCEDURE DETECTING ERROR             
 DSNT416I SQLERRD    = 30  0  0  -1  0  0 SQL DIAGNOSTIC INFORMATION     
 DSNT416I SQLERRD    = X'0000001E'  X'00000000'  X'00000000'  X'FFFFFFFF'
          X'00000000'  X'00000000' SQL DIAGNOSTIC INFORMATION             
  ERRLOC=5:10:1 -- SQLSTATE=42S22, SQLCODE=-205                           
ARS4035E Unable to create index ZSTARSS.arsholdmap_idx                    

[ibmarthin]

Will it be safe to run the upgrade sequence once again?

[Ed_Arnold]

Will it be safe to run the upgrade sequence once again?

Should be okay to run the upgrade sequence again.

From the readme:

1. Stop all Content Manager OnDemand activity on databases being upgraded to
V10.1.0.

2. Backup the Content Manager OnDemand database or make sure a current backup is
available.

3. Run the following commands located in the /usr/lpp/ars/V10R1M0/bin directory for
each Content Manager OnDemand server instance being upgraded to Content
Manager OnDemand V10.1.0: (Note that receiving a -551 sqlcode when dropping a
nonexistent index is normal.)
1. Run “arsdb -I <instance_name> -vu” to perform additional table updates.
2. Run “arsdb -I <instance_name> -efv” drop the indexes.
3. Run “arsdb -I <instance_name> -rv” recreate the indexes.
4. Run “arsdb -I <instance_name> -mv” run maintenance and update statistics.

This is not the same order that you indicated above.  Please make sure you do things in the proper order.

Also, ensure that you don't have anything in your dot-profile pointing to old CMOD code.

Ed

[Ed_Arnold]

Now I'm thinking that you're going to have to run the steps to:

EXPORT
DROP
CREATE
IMPORT
 
Run "arsdb <-I instance_name> -vx ARSSYS"

Run "arsdb <-I instance_name> -vd ARSSYS"

Run "arsdb <-I instance_name> -vc ARSSYS"

Run "arsdb <-I instance_name> -vi ARSSYS"

Ed

[ibmarthin]

Thanks Ed

I got Covid19 and back again just now.
I will go on with the suggestions you made.

/ib