Messages

121

MP Server / arslog vs system trace for troubleshooting.

« on: May 24, 2021, 11:27:05 AM »

We encountered a production issue on Friday where ARSSOCKD would randomly crash, on two occasions.

We turned on trace but i have concerns with using that in a production system with heavy loads/retrievals/queries, and the issue possibly not happening again. I noticed in our QA system that we are using the arslog user exit. I have never personally used

I tested bringing down DB2, and i saw all those errors in the syslog.log.

ARS0013E DB Error: [IBM][CLI Driver] CLI0106E  Connection is closed. SQLSTATE=08003 -- SQLSTATE=08003, SQLCODE=-99999, File=arsseg.c, Line=6269 does n
ot exist

ARS0013E DB Error: [IBM][CLI Driver] SQL1224N  The database manager is not able to accept new requests, has terminated all requests in progress, or ha
s terminated the specified request because of an error or a forced interrupt.  SQLSTATE=55032  -- SQLSTATE=40003, SQLCODE=-1224, File=arsid.c, Line=30
78 does not exist

Are there any performance implications as to using the arslog user exit in a production system, primarily on the performance side of things? How would this be compared to using TRACE with ALL=3?

122

MP Server / Re: Unable to start CMOD V10.5 after upgrade from V9.5

« on: April 27, 2021, 05:28:50 PM »

Yeah, it looks like there's some missing fields from your ARSSYS table - specifically ones related to data encryption.

Your commands will export, drop, create, and import the data for that table, so should help.

Please open a Service Request and report it as a bug.

-JD.

I did that per dba suggestion.

We also didn't want to wait. Ha! We re-ran all four steps to "remassage" the 9.5 tables.

It magically worked. Not sure what happened there.. strange

123

MP Server / Unable to start CMOD V10.5 after upgrade from V9.5

« on: April 27, 2021, 01:45:37 PM »

We just upgraded from CMOD V9.5 to V10.5.0.2 Our environment is redhat, with db2 v11.1.4.5, redhat linux

I ran all the upgrade steps-

arsdb -I archive -evf, select yes
arsdb -I archive -uv
arsdb -I archive -rfv
arsdb -I archive -rfv

I updated all the configuration files. Verified everything looks good, and we are seeing this error. I attempt to start arssockd, and it gets to the "initializing phase" and then dies out.

From the trace file-

Code: [Select]

55663:47042139134656 04/27/2021 15:34:21:755929 ERROR arssys.c(3949)ArcDB_SystemGetConfig:Unable to execute sql db hstmt=65538 db sql str=SELECT keystore_type, keystore_location, keystore_mkl, keystore_mkl_dt, data_ekey FROM archive.ARSSYS FETCH FIRST 1 ROW ONLY OPTIMIZE FOR 1 ROW FOR READ ONLY db sql rc=-1,SQL_ERROR
55663:47042139134656 04/27/2021 15:34:21:861056 ERROR arssys.c(3950)ArcDB_SystemGetConfig:Server message msg timestamp=2021-04-27 15:34:21.757220 msg userid=ARSSOCKD msg severity=2 msg num=13 msg text=ARS0013E DB Error: [IBM][CLI Driver][DB2/LINUXX8664] SQL0206N  "KEYSTORE_TYPE" is not valid in the context where it is used.  SQLSTATE=42703  -- SQLSTATE=42S22, SQLCODE=-206, File=arssys.c, Line=3950 msg appl=N msg logid=0
55663:47042139134656 04/27/2021 15:34:21:861061 ERROR arssys.c(3950)ArcDB_SystemGetConfig:ARSLOG message msg num=13
55663:47042139134656 04/27/2021 15:34:21:861318 ERROR arssys.c(3950)ArcDB_SystemGetConfig:CONSOLE message msg num=13
55663:47042139134656 04/27/2021 15:34:21:861586 ERROR arssrvr.c(3168)ArcSERVP_GetSystemInfo:TTY message msg num=151 msg text=ARS0151E Unable to initialize server database system parameters.  Contact your system administrator.
55663:47042139134656 04/27/2021 15:34:21:861631 ERROR arssrvr.c(3168)ArcSERVP_GetSystemInfo:CONSOLE message msg num=151 msg timestamp=2021-04-27 15:34:21.861591 msg userid=ARSMSG msg severity=2 msg text=ARS0151E Unable to initialize server database system parameters.  Contact your system administrator. msg appl=N msg logid=0
55663:47042139134656 04/27/2021 15:34:21:861647 ERROR arssrvr.c(3168)ArcSERVP_GetSystemInfo:ARSLOG message msg num=151
Found an earlier post, mentions this-

Code: [Select]

EXPORT
DROP
CREATE
IMPORT
 
Run "arsdb <-I instance_name> -vx ARSSYS"
Run "arsdb <-I instance_name> -vd ARSSYS"
Run "arsdb <-I instance_name> -vc ARSSYS"
Run "arsdb <-I instance_name> -vi ARSSYS"

Before I do that, just wondering if anyone on here has seen this error message as well.

124

OD/WEK & JAVA API / Re: CMOD/ICN view Line Data report via HTML5 viewer

« on: March 31, 2021, 03:48:57 PM »

Note that this installation is on AIX.

My basic process was to upgrade to the latest ODWEK (10.1.0.7) as the HTML5 viewer is included in the update (I was running with ODWEK 9.5).  As you probably already know, ODWEK is no longer provided separately but is part of the CMOD install tar installation.  The readme.txt file included in the CMOD (untared) installation directory details some additional steps required for the new release (https://cmod.wiki/dox/CMOD-v10.1-README.txt).

Steps taken:

1.   Download and install CMOD 10.1 base code (/opt/IBM/ondemand/V10.1) <=== may not be required if already installed.
2.   Download and install CMOD 10.1.0.7 from FixCentral
3.   Update ICN configuration (configmgr.sh) and change ODWEK installation directory to newly installed release (/opt/IBM/ondemand/V10.1/www) then build and deploy
4.   Included in the CMOD installation readme.txt:
     a.   Copy /opt/IBM/ondemand/V10.1/jars/gson-2.8.1.jar to /opt/IBM/ondemand/V10.1/www/api
     b.   Update WAS configuration and add /opt/IBM/ondemand/V10.1/jars/gson-2.8.1.jar to CLASSPATH
     c.   Update CLASSPATH (LIBPATH) in WAS to /opt/IBM/ondemand/V10.1/www
5.   Install GSKIT8.  Instructions included in ODWEK installation readme.txt.  This was an important step for me as ICN was unable to open the repository without it.
6.   Update ICN Customer Property ODWEK_INSTALL_DIR to new /opt/IBM/ondemand/V10.1 directory

To activate the HTML5 viewer:
1.   Create a directory in the WAS infrastructure to hold the new viewer contained in LineDataHTML5Viewer.zip (e.g. <WAS install>/AppSrv01/installedApps/TEST/navigator.ear/navigator.war/viewers/LineDataViewer)
2.   Unzip the /opt/IBM/ondemand/V10.1/www/viewers/LineDataHTML5Viewer.zip file into the …/navigator.war/viewers/LineDataViewer directory previously created

3.     Finally, update ICN Viewer Map using ICN admin to use Line Data HTML Viewer

I've been able to view line-data reports in both Edge and FireFox (something I was never able to do with the java line data applet  )

Of course, this is a summary of the install/implementation process.  There are many details left out such as WAS cleanup, bounce, etc.

Thank you for these steps. I'm actually in the process of implementing this myself. You gave me a head start haha!

Can confirm that your steps work perfectly

125

MP Server / Re: Issue configuring new environment

« on: March 22, 2021, 08:43:43 AM »

You didn't mention the platform...

If it's AIX, Ed's on the right track - check to make sure you have the XLC libraries.  See here:  https://cmod.wiki/index.php?title=ARS4014E

If it's Linux, check to make sure you have the DB2 links created with db2ln.

-JD.

Whoops, yeah my bad, RHEL

Let me try db2ln. Thanks

126

MP Server / Re: Issue configuring new environment

« on: March 19, 2021, 03:29:58 PM »

No error message anywhere of any kind?

Ed

Nope, Just-

Code: [Select]

[archive@ondemand config]$ arsdb -I archive -gcv
ARS4014E Unable to load >DB2<
I am used to just doing instance named archive and su - to that user and doing the configuration, I've never had any issues doing it that way using the default configs. I am wondering if I am missing a step after creating the instance and adding archive user to - db2iadm1

127

MP Server / Issue configuring new environment

« on: March 19, 2021, 07:12:18 AM »

I'm working on a POC and for some reason I cant get the install to work. I've done plenty of these so I am scratching my head. I have a feeling its simple.

1) Instance is created as "db2inst1"-

Code: [Select]

[db2inst1@ondemand ~]$ db2ilist
db2inst1
[db2inst1@ondemand ~]$ groups
db2iadm1
[db2inst1@ondemand ~]$
2) "archive" user is part of db2iadm1, attempting to run arsdb -gcv -I archive

Code: [Select]

[archive@ondemand config]$ groups
db2iadm1
[archive@ondemand config]$ arsdb -I archive -gcv
ARS4014E Unable to load >DB2<

3) ars.cfg / ars.ini are both basically untouched

Code: [Select]

[archive@ondemand config]$ more ars.ini
[@SRV@_ARCHIVE]
HOST=
PROTOCOL=2
PORT=0
SRVR_INSTANCE=ARCHIVE
SRVR_INSTANCE_OWNER=archive
SRVR_OD_CFG=/opt/ibm/ondemand/V10.1/config/ars.cfg
SRVR_DB_CFG=/opt/ibm/ondemand/V10.1/config/ars.dbfs
SRVR_SM_CFG=/opt/ibm/ondemand/V10.1/config/ars.cache

Code: [Select]

ARS_ORIGINAL_CODEPAGE=0
DB2INSTANCE=db2inst1
ARS_DB2_DATABASE_PATH=/arsdb
ARS_DB2_PRIMARY_LOGPATH=/arsdb_primarylog
ARS_DB2_ARCHIVE_LOGPATH=/arsdb_archivelog
ARS_DB2_LOGFILE_SIZE=1000
ARS_DB2_LOG_NUMBER=40
I verified that all the directories are created, owned by archive:db2iadm1, set to 775

I think it's something with the archive profile, permissions or something like that. Usually I use all the default settings - archive instance/archive db.. But I want the default db2instance name of db2inst1 because I will be installing other products on here and I would like to keep things organized anyone have suggestions? I unfortunately don't have a dba to help me.

128

MP Server / Re: APPLICATION GROUP SETTINGS

« on: March 12, 2021, 05:29:27 PM »

yup. dealing with that now, however--nobody can seem to track down who's monitoring and or why!

129

MP Server / Re: APPLICATION GROUP SETTINGS

« on: March 12, 2021, 03:48:17 PM »

Second retrieval box is your option for 66.

Just as an FYI, I suggest you dont enable database query logging. I forget which box is which..One is 65 msg, one is 226. (IBM has suggested to me in the past to keep them turned on to only debug issues if needed). I've seen high volumes of queries being logged that caused performance issues to the point of bringing down a library server.

130

Other / Re: Suggestion needed to Speed up Retrievals from TSM

« on: March 08, 2021, 11:50:01 AM »

I hate to bump such an old OLD thread.. However I think you're still an active user.

What did you decide on?

131

Report Indexing / Re: Loading large CSV using Generic indexer

« on: March 05, 2021, 03:52:38 PM »

Thanks for the reply!...Not going to bother opening a PMR for this.   Application end is looking to splitting this up in 2 pieces.

Ironic. I'm trying to open up a very large data dump from oracle with excel, it's a .del file with maybe 500k rows? Excel isnt liking it. I got the same error message you got.

Sounds to me like it's probably hitting some kind of resource limit on local PC, memory or cpu..or something

132

Documentation / Re: CMOD / TSM and moving to AWS compatibility

« on: March 05, 2021, 08:24:35 AM »

I think that as long as you're within the compatibility matrix, you're fine -- OS, database, storage, etc.  I haven't seen any special requirements just because you're in the cloud.

-JD.

Was told the same thing, except for moving from OnPrem to Azure. They mentioned that if there's an issue with the underlying IAAS within Azure, they wouldn't or couldn't support it.

Just as a heads up..I built POC environments for both AWS/Azure, they run nicely.

133

Report Indexing / Re: Loading large CSV using Generic indexer

« on: March 05, 2021, 08:22:10 AM »

Agree..changing the max rows made no difference.  After loading file was not able to view all rows in CSV.  We are going back to application to see if they are able to split the file.  If they are resistant, we will have to go to IBM.  As always, appreciate the quick response!!   Take care

Dave

Since you mention that..

I've seen this before, Granted- IT was a very VERY old CMOD system.. Maybe 8.5?

Our business partners were sending CSV files with like, 200-300k rows. They wanted to pickup something on each row of the file. CMOD would get to like the ..10th to last row and just quit. PMR didn't resolvge anything. We just told them to send it as smaller files.

134

Report Indexing / Re: Loading large CSV using Generic indexer

« on: March 04, 2021, 12:54:40 PM »

What version of CMOD?

135

MP Server / Arsdoc get — best optimized way to extract and reload

« on: March 03, 2021, 09:21:30 PM »

So I am working on a migration and I’m just looking at some possible ways to extract and reload my data.

My thought - arsdoc get with -L, read from parameter file with a listing of load ID’s. Do this on an app group by app group basis. We only have like 10, but a good amount of data.

We have a process, a weird one- that extracts from a “short term” application group and loads into a “long term” application group. This was handled by a third party years ago, and since I joined I redid it with a few basic shell scripts. My script generates a list of dates of the month prior, and loops through that + an app group name, and does all the magic. This process is very good. I can’t wrap my head around why they are going from one app group to another. I think it’s for performance at the db level or something

I figure there’s other ways, where I can extract a month of data per file, etc. so I guess my three options I’m trying to weigh

1) retrieve an entire load, reload with arsload
2) retrieve an entire day, reload with arsload
3) retrieve an entire month, reload with arsload.

I’m leaning towards one. I also think that would be easier to recover if there’s some kind of issue.

What’s everyone’s thoughts.