Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.


Topics - jsquizz

Pages: [1] 2 3 4 5 6
1
MP Server / Issue configuring new environment
« on: March 19, 2021, 07:12:18 AM »
I'm working on a POC and for some reason I cant get the install to work. I've done plenty of these so I am scratching my head. I have a feeling its simple.

1) Instance is created as "db2inst1"-

Code: [Select]
[db2inst1@ondemand ~]$ db2ilist
db2inst1
[db2inst1@ondemand ~]$ groups
db2iadm1
[db2inst1@ondemand ~]$

2) "archive" user is part of db2iadm1, attempting to run arsdb -gcv -I archive

Code: [Select]
[archive@ondemand config]$ groups
db2iadm1
[archive@ondemand config]$ arsdb -I archive -gcv
ARS4014E Unable to load >DB2<

3) ars.cfg / ars.ini are both basically untouched

Code: [Select]
[archive@ondemand config]$ more ars.ini
[@SRV@_ARCHIVE]
HOST=
PROTOCOL=2
PORT=0
SRVR_INSTANCE=ARCHIVE
SRVR_INSTANCE_OWNER=archive
SRVR_OD_CFG=/opt/ibm/ondemand/V10.1/config/ars.cfg
SRVR_DB_CFG=/opt/ibm/ondemand/V10.1/config/ars.dbfs
SRVR_SM_CFG=/opt/ibm/ondemand/V10.1/config/ars.cache

Code: [Select]
ARS_ORIGINAL_CODEPAGE=0
DB2INSTANCE=db2inst1
ARS_DB2_DATABASE_PATH=/arsdb
ARS_DB2_PRIMARY_LOGPATH=/arsdb_primarylog
ARS_DB2_ARCHIVE_LOGPATH=/arsdb_archivelog
ARS_DB2_LOGFILE_SIZE=1000
ARS_DB2_LOG_NUMBER=40

I verified that all the directories are created, owned by archive:db2iadm1, set to 775

I think it's something with the archive profile, permissions or something like that. Usually I use all the default settings - archive instance/archive db.. But I want the default db2instance name of db2inst1 because I will be installing other products on here and I would like to keep things organized :) anyone have suggestions? I unfortunately don't have a dba to help me.



2
MP Server / Arsdoc get — best optimized way to extract and reload
« on: March 03, 2021, 09:21:30 PM »
So I am working on a migration and I’m just looking at some possible ways to extract and reload my data.

My thought - arsdoc get with -L, read from parameter file with a listing of load ID’s. Do this on an app group by app group basis. We only have like 10, but a good amount of data.

We have a process, a weird one- that extracts from a “short term” application group and loads into a “long term” application group. This was handled by a third party years ago, and since I joined I redid it with a few basic shell scripts. My script generates a list of dates of the month prior, and loops through that + an app group name, and does all the magic. This process is very good. I can’t wrap my head around why they are going from one app group to another. I think it’s for performance at the db level or something

I figure there’s other ways, where I can extract a month of data per file, etc. so I guess my three options I’m trying to weigh

1) retrieve an entire load, reload with arsload
2) retrieve an entire day, reload with arsload
3) retrieve an entire month, reload with arsload.

I’m leaning towards one. I also think that would be easier to recover if there’s some kind of issue.

What’s everyone’s thoughts.

3
MP Server / determine oldest doc in an app group?
« on: February 24, 2021, 05:24:30 PM »
I have about 2k app groups, need to figure out the oldest record per application group.

I'm looking through the tables -> arsag caught my eye, more specifically 'last_doc_dt'

I ran a simple query, and it's coming back blank.

Code: [Select]
LAST_DOC_DT
--------------------------
-

  1 record(s) selected.

Is there anything on lets say, arsseg I can also try? I was also thinking I could use arsseg table.

Code: [Select]
START_DT TIMESTAMP The minimum (oldest) date of documents stored in this folder, in database-native timestamp format.

4
MP Server / Any easy/fancy ways to gather all loads in one year time frame?
« on: February 23, 2021, 05:20:23 PM »
Business folks are asking for a count of all documents loaded in 2020 for a specific folder. Usually not a big deal, only 6 AG's in that folder..

How I've done it in the past is use the system load / system log folder, and put it into excel..and some simple parsing. But these are large application groups, some have 100k+ loads per month. I've learned obviously that the CMOD client doesn't like copying out more than 30-40k at a time.

My Idea? -- I'm thinking possibly also of just hitting up the SA* tables, of which we have two of. Anyone have any more ingenious ways of doing this?

5
MP Server / Issue with arsdoc query
« on: February 12, 2021, 11:34:14 AM »
CMOD 9.5, DB2 10.1 - Scratching my head on this one, I've done this before but its been a while. I want to just generate a list of 66 messages for a certain time frame. I think this is what i used last time.

arsdoc query -u admin -p stash.file -h archive -f 'System Log' -i "WHERE TIME_STAMP_DT > '2021-02-12-01.00.00.352804' and TIME_STAMP_DT < '2021-02-12-2.43.45.352804' and MSG_NUM='66'"

I want to get all 66 messages, between 2021-02-12-01.00.00.352804 and 2021-02-12-2.43.45.352804

When I run above arsdoc query, I get this.. Notice the dates look funky... Anyone have a thought?

02/11/21 21:30:34,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.003) ObjName(38657GAAA) Off(0) Len(40646) CompOff(0) CompLen(34621) Size(40646) Seg(1) Total Segs(1) Flds(),A,1271258566,
02/11/21 21:30:31,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.009) ObjName(42537GAAA) Off(44384) Len(89182) CompOff(0) CompLen(57683) Size(89182) Seg(1) Total Segs(1) Flds(),A,1271258560,
02/11/21 21:30:30,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.002) ObjName(39760GAAA) Off(0) Len(43120) CompOff(0) CompLen(9725) Size(43120) Seg(1) Total Segs(1) Flds(),A,1271258562,
02/11/21 21:30:29,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.003) ObjName(39813GAAA) Off(0) Len(49624) CompOff(0) CompLen(11097) Size(49624) Seg(1) Total Segs(1) Flds(),A,1271342777,
02/11/21 21:00:21,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.003) ObjName(38657GAAA) Off(0) Len(40646) CompOff(0) CompLen(34621) Size(40646) Seg(1) Total Segs(1) Flds(),A,1271258566,
02/11/21 21:00:19,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.010) ObjName(42537GAAA) Off(44384) Len(89182) CompOff(0) CompLen(57683) Size(89182) Seg(1) Total Segs(1) Flds(),A,1271258560,
02/11/21 21:00:17,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.003) ObjName(39760GAAA) Off(0) Len(43120) CompOff(0) CompLen(9725) Size(43120) Seg(1) Total Segs(1) Flds(),A,1271258562,
02/11/21 21:00:16,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.004) ObjName(39813GAAA) Off(0) Len(49624) CompOff(0) CompLen(11097) Size(49624) Seg(1) Total Segs(1) Flds(),A,1271342777,
02/11/21 20:30:19,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.003) ObjName(38657GAAA) Off(0) Len(40646) CompOff(0) CompLen(34621) Size(40646) Seg(1) Total Segs(1) Flds(),A,1271258566,
02/11/21 20:30:17,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.008) ObjName(42537GAAA) Off(44384) Len(89182) CompOff(0) CompLen(57683) Size(89182) Seg(1) Total Segs(1) Flds(),A,1271258560,
02/11/21 20:30:15,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.003) ObjName(39760GAAA) Off(0) Len(43120) CompOff(0) CompLen(9725) Size(43120) Seg(1) Total Segs(1) Flds(),A,1271258562,
02/11/21 20:30:14,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.004) ObjName(39813GAAA) Off(0) Len(49624) CompOff(0) CompLen(11097) Size(49624) Seg(1) Total Segs(1) Flds(),A,1271342777,
02/11/21 20:00:32,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.003) ObjName(38657GAAA) Off(0) Len(40646) CompOff(0) CompLen(34621) Size(40646) Seg(1) Total Segs(1) Flds(),A,1271258566,
02/11/21 20:00:30,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.006) ObjName(42537GAAA) Off(44384) Len(89182) CompOff(0) CompLen(57683) Size(89182) Seg(1) Total Segs(1) Flds(),A,1271258560,
02/11/21 20:00:28,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.003) ObjName(39760GAAA) Off(0) Len(43120) CompOff(0) CompLen(9725) Size(43120) Seg(1) Total Segs(1) Flds(),A,1271258562,
02/11/21 20:00:26,ADMIN,4,66,Application Group Document Get: Name(APPLICATION_AG_S) Agid(5150) ApplName(APPLICATION_APP_S) Aid(5151) NodeName(-CACHE-) Nid(3) Server(server) Time(0.004) ObjName(39813GAAA) Off(0) Len(49624) CompOff(0) CompLen(11097) Size(49624) Seg(1) Total Segs(1) Flds(),A,1271342777,

6
MP Server / Multiple oracle instances configured on the same box
« on: February 10, 2021, 10:45:49 AM »
We'd like to create a POC where we load to an oracle remote server to measure performance.

Wondering if it's possible to point an existing CMOD/oracle system that is working PERFECTLY to this remote instance. Basically, two CMOD instances, one box.

Assuming we'd just have to modify the ars.ini file to point to a seperate set of ars.** files, create the database with arsdb commands, and fire it up?

7
MP Server / Unable to load to oracle tablespaces
« on: February 04, 2021, 06:33:01 PM »
Hi all,

Fresh oracle DB running 19c (i think..) and CMOD 10.5.

Trying to load using tablespaces,

2021-01-29 02:11:00.050814: ARS1107E An error occurred.  Contact your system administrator and/or consult the System Log.  File=arsload.c, Line=6736

2021-01-29 02:11:00.050851: ARS1158E Failed while attempting to load the database

2021-01-29 02:11:00.311342: ARS1146I Loaded 0 rows into the database

2021-01-29 02:11:00.311378: ARS4311E Loading failed

2021-01-29 02:11:00.311398: ARS4320I Unloading started

Within the system log -

Unable to find SMS tablespace filesystems.  Either the defined SMS filesystems are full or there are no SMS filesystems defined.


these are defined within ars.dbfs-


#‌ Filesystem                        Tablespace Type (SMS)

#‌ --------------------------------------------------------------

‌/u02/oracle/oradata/fs02/archive     SMS

that specified directory exists

/u02/oracle/oradata/fs02/archive: directory

We can manually create a tablespace within above filesystem outside of CMOD, but it wont work for us when we load.

Anyone have suggestions?

8
MP Server / Tuning - Migration to Oracle
« on: January 08, 2021, 10:32:01 AM »
We are currently using CMOD 9.5/DB2 11. Our new system we just stood up is CMOD 10.5/Oracle 19C.


1) We are curious about tuning the database, one of the key things we are looking for is SGA size for the database. Are there any other tuning considerations we need to take into account?

2) We are also looking for information regarding - db reorg/runstats. I believe currently we do all of this through arsdb/arsmaint commands. Is that supported with oracle? Is there a specific way to do it.

9
MP Server / arsdb -rtv fails when creating db (10.5 + oracle)
« on: December 30, 2020, 08:38:22 AM »
We are trying to configure a CMOD 10.5 instance using oracle. We are getting -

[archive@server bin]$ ./arsdb -I u7edp1d1 -rtv
ARS4013E Unable to determine the database engine
[archive@server bin]$

We have tried all troubleshooting methods within the cmod.wiki/documentation with no luck.

CMOD Configs:

archive@server bin]$ more ../config/ars.cfg | grep ORA
# 5622-662 (C) COPYRIGHT IBM CORPORATION 2020
ARS_DB_ENGINE=ORACLE
# ORACLE Parameters (Library Server Only) #
#ARS_ORACLE_HOME=/home/oracle
ARS_ORACLE_HOME=/u01/app/oracle/product/19.7.0
ARS_STORAGE_MANAGER=NO_TSM
[archive@server bin]$

[archive@server bin]$ more ../config/ars.ini
[@SRV@_ARCHIVE]
HOST=server.hostname
PROTOCOL=2
PORT=0
SRVR_INSTANCE=database
SRVR_INSTANCE_OWNER=archive
SRVR_OD_CFG=/opt/ibm/ondemand/V10.5/config/ars.cfg
SRVR_DB_CFG=/opt/ibm/ondemand/V10.5/config/ars.dbfs
SRVR_SM_CFG=/opt/ibm/ondemand/V10.5/config/ars.cache

Environment Variables-

# User specific environment and startup programs
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=/u01/app/oracle/product/19.7.0
DATABASE=u7edp1d1

PATH=$PATH:$HOME/.local/bin:$HOME/bin:$ORACLE_HOME/bin

export PATH
export ORACLE_BASE
export DATABASE

connection strings-

archive@server ~]$ sqlplus archive/welcome123@u7edp1d1

SQL*Plus: Release 19.0.0.0.0 - Production on Tue Dec 29 18:53:36 2020
Version 19.7.0.0.0

Copyright (c) 1982, 2020, Oracle. All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.7.0.0.0

ARCHIVE@server:SQL>




10
MP Server / Escape character in arsdoc query command?
« on: December 22, 2020, 02:14:28 PM »
I'm trying to create a small script that will capture messages from the system log, for lets say the past hour. Looks like some kind of escape characters are being added to the front of my dates in the arsdoc statement..anyone have an idea?

---Output---
archive@server:/home/ondemand/scripts/errorMon> ./test.bash
+ hourAgo
+ now
+ echo 2020-12-22 14:52:29.264607 'Is an hour ago..'
2020-12-22 14:52:29.264607 Is an hour ago..
+ echo 2020-12-22 15:52:29.266762 'Is now..'
2020-12-22 15:52:29.266762 Is now..
+ arsdoc query -h archive -u admin -f 'System Log' -i $'WHERE time_stamp >= \'2020-12-22 14:52:29.264607\' and time_stamp < \'2020-12-22 15:52:29.266762\''

2020-12-22 15:52:29.350117: ARS1609W Specifying passwords on the command line is in-secure due to the text being visible. See the Installation and Configuration Guide for your platform for information about the arsstash command or using Unified Login.

2020-12-22 15:52:30.201722: ARS6007E The server failed during a search operation.  View the System Log for additional messages.

From the system log - DB Error: [IBM][CLI Driver][DB2/LINUXX8664] SQL0420N  Invalid character found in a character string argument of the function "DECFLOAT".  SQLSTATE=22018  -- SQLSTATE=22018, SQLCODE=-420, File=arsdoc.c, Line=3088

---sample script:---

set -x
function hourAgo {
HOURAGO=$(date "+%Y-%m-%d %H:%M:%S.%6N" -d "1 hour ago")
}

function now {
NOW=$(date "+%Y-%m-%d %H:%M:%S.%6N")
}

hourAgo
now

echo $HOURAGO "Is an hour ago.."
echo $NOW "Is now.."

arsdoc query -h archive -u admin -p ondemand -f "System Log" -i "WHERE time_stamp >= '${HOURAGO}' and time_stamp < '${NOW}'"



11
MP Server / ARSSOCKD crash when adding application to app group
« on: November 10, 2020, 07:55:10 AM »
Azure POC environment, 10.1.0.5, RHEL 8.2, DB2 V11, Cache for now..

I am trying to test an extract script. I am using an IBM lab to load a test file with PPD's. I setup the basic application group with 3 fields. Added an application to the AG, made no changes- just to get it setup (Also happens when I add the indexing parameters)

When I click save - "Connection cannot be established for  - 10.0.4.4", and arssockd dies.

I have seen something similar to this years ago but I don't recall the fix. Anyone have thoughts?

12
Report Indexing / arsload not finding ARSACIF
« on: November 08, 2020, 11:06:22 AM »
Never seen this error before - obviously, arsacif exists within /app/ibm/ondemand/V10.1/bin/

running on azure with Redhat 8.2, DB2 11, 10.1.0.5

[archive@cmodpoc bin]$ ./arsload -nvf -u admin -p ondemand -h archive -g test /app/testData/testFile.ARD.txt
ARS1609W Specifying passwords on the command line is not secure due to the text being visible. See the Installation and Configuration Guide for your platform for information about the arsstash command or using Unified Login.
2020-11-08 18:04:23.839594: ARS4315I Processing file >/app/testData/testFile.ARD.txt<
2020-11-08 18:04:23.839669: ARS4334I Load Version <10.1.0.5>  Operating System <Linux> <#1 SMP Mon Jul 20 15:02:29 UTC 2020.4.18.0-193.14.3.el8_2.x86_64>  OS Userid <ADMIN>  Install Location </app/ibm/ondemand/V10.1/> Data(unlimited KB) Stack(8192 KB) Core(unlimited 512-blocks) Cpu(unlimited seconds) File(unlimited 512-blocks) Nofiles(1024) Threads(0) Processes(31112)
2020-11-08 18:04:23.839700: ARS4335I Server Version <10.1.0.5>  Operating System <Linux> <#1 SMP Mon Jul 20 15:02:29 UTC 2020.4.18.0-193.14.3.el8_2.x86_64>  Database <DB2> <11.01.0404>
2020-11-08 18:04:24.094004: ARS4339I Application Group >test<
2020-11-08 18:04:24.094046: ARS4340I Application >test<
2020-11-08 18:04:24.094072: ARS4341I Storage Set >Cache Only - Library Server<
2020-11-08 18:04:24.094093: ARS4342I Storage Node >Cache Only - Library Server<
2020-11-08 18:04:24.094113: ARS4347I Encryption >None<
2020-11-08 18:04:24.094179: ARS4302I Indexing started, 214 bytes to process
                          : sh: /app/ibm/ondemand/V10.1/bin/arsacif: No such file or directory
2020-11-08 18:04:24.097500: ARS4309E Indexing failed
2020-11-08 18:04:24.097574: ARS4318E Processing failed for file >/app/testData/testFile.ARD.txt<
2020-11-08 18:04:24.246726: ARS4327E Processing has stopped.  The remaining files will NOT be processed.


[archive@cmodpoc config]$ echo $PATH
/usr/local/bin:/usr/bin:/app/ibm/ondemand/V10.1/bin
[archive@cmodpoc config]$ arsacif
-bash: /app/ibm/ondemand/V10.1/bin/arsacif: No such file or directory


Fixed this-

[jeff@cmodpoc server]$ sudo yum install libstdc++.so.6


13
Windows Client / POC System - Admin/FAT wont connect
« on: October 29, 2020, 01:09:48 PM »
Hi All,

I am working on a solution based on Azure, I installed DB2/CMOD successfully, ARSSOCKD is up and running. Port 1445 is open which I've seen cause this, actually had a PMR about it a few years back.

For some reason my client will not connect to the server. I'm using the public IP address for the virtual machine, but I think something else on the server is blocking connection. I also saw this when I ran the same installation and configuration steps running on my laptop in a Hyper-V environment, wouldn't connect!

Laptop is just a vanilla windows 10 environment, with all firewalls/anti-virus disabled

Anyone have any ideas?

Thanks

14
MP Server / Verify Login Credentials
« on: October 12, 2020, 12:47:01 PM »
I have a small script that is running an extract process,

Code: [Select]
$ARSDOC get $MyParams
returnCode=$?
if [ $returnCode -ne 0 ]; then
echo "it didnt work!"
else
echo "it worked!"

A colleague was not in the stash file, and it returned "It worked!" instead of  "It didnt work"

Is there a way that I can verify that a login works, I can add it as a function in my script. Other than using ODWEK.

Thanks in advance

15
MP Server / Reconciliation via arsdoc query
« on: August 14, 2020, 09:07:27 AM »
This isn't rocket science or reinventing the wheel, but I have a request to verify that a series of documents are loaded, or are not loaded into CMOD.

I approached this as basic as possible, I have a list like this that I loop through ARSDOC query, when the response is less than 1, I then echo the "missing" metadata to a text file for the business to resend. That part works fine.

12341234,313433
12341333,312343
12343333,331111

My problem is that they have 200,000,000 rows they need to validate. Using arsdoc query + bash, this is extremely slow as I expected. It would take 1month to complete going 24/7

We could go through the database tables directly, which is probably what our DBA will want us to do. Just wondering if anyone else has any good ideas.

Pages: [1] 2 3 4 5 6