Topics

31

MP Server / Encryption failing - Best way to troubleshoot

« on: June 10, 2022, 08:55:32 AM »

Hi All,

In one of our pre-go live systems that I am using to check out files before they are ready for production, encryption is all of a sudden failing. This is just one of our loading servers that we call ARSLOAD on.

2022-06-01 15:54:01.176976: ARS4308I Indexing completed
2022-06-01 15:54:01.177053: ARS4312I Loading started, --UNKNOWN-- bytes to process
2022-06-01 15:54:01.177553: ARS1420E Encryption failed.  File=arsload.c, Line=6085
2022-06-01 15:54:01.177588: ARS4311E Loading failed
2022-06-01 15:54:01.180539: ARS4318E Processing failed for file >FILE.ARD<

2022-05-24 16:37:49.523903, File Loaded
2022-06-01 16:54:01.182788, File Failed

I am guessing that some type of certificate or something possibly failed. All of our other servers - Development, UAT, Production, work fine.

We recently did a migration from AIX-ZOS for our library server.

This is the only troublesome box. Any issues?

32

z/OS Server / Migrating AIX exits to ZOS

« on: May 18, 2022, 09:27:32 AM »

Hi All,

we recently migrated to the ZOS platform from MP. We ran an ARSLOG exit on our AIX library server.

The question is - do we have to move this script/repurpose it on the Z/OS server - or is there some other way we can do it, possibly on one of our load servers that runs arsload scripts.

Thank you!

33

Content Navigator / Message of the day + Content Navigator

« on: May 11, 2022, 03:28:12 PM »

Hi All,

does anyone know if its possible to use the message of the day feature with content navigator?

Obviously it works when a user uses the thick client - We are wondering if its possible when someone uses ICN.

Thanks

34

MP Server / Determine the active segment table being used

« on: December 08, 2021, 02:25:16 PM »

Hi All,

wondering if anyone has a db2 query handy, or any suggestions on writing a query-  that will return the active app group segment table being loaded to.

Thanks!

35

MP Server / Best way to query system log using UTC date?

« on: November 30, 2021, 08:40:33 AM »

Hi Folks,

I am writing a simple script that captures some daily activity from the system log, using arsdoc query.

In dealing with the system log storing the date in UTC format so here's a quick snippet of my plan:

Code: [Select]

YESTERDAY=`something that generates yesterdays date`
2DAYSAGO=`somethinh that generates 2 days ago`
Now, throwing it into arsdoc query, my plan is this, example is - capturing 88 records for 11/29/21 Server Time-

Code: [Select]

"-i "where ODDAT_LOAD_DATE BETWEEN '$2DAYSAGO.16.59.59' and $YESTERDAY.16.59.59'"
Trying that approach and I am getting this error

Code: [Select]

DB Error: [IBM][CLI Driver][DB2/AIX64] SQL0180N  The syntax of the string representation of a datetime value is incorrect.  SQLSTATE=22007  -- SQLSTATE=22007, SQLCODE=-180, File=arsdoc.c, Line=3563
Does anyone have a handy way of getting things from the system log for the previous day, from a monitoring script, report, etc..?

Thanks!

36

MP Server / Error with V10.1 - Loading to HCP

« on: November 11, 2021, 09:48:28 AM »

We are trying to load directly into HCP using the API's included in CMOD V10.1. We saw this error using V10.1.0.7, and IBM suggested updating to version 10.1.0.8, and applying hotfix -

https://ak-delivery04-mul.dhe.ibm.com/sar/CMA/IMA/09q33/0/PH37296.10.1.0.8.readme.txt

From our system log-

Code: [Select]

2021-11-09 19:47:29.672532 ADMIN   350766224 Error Yes     88 Application Group Failed Load: Name(AG) LoadId(--INDEXING ONLY--) File(SERVER.XXXXXX.XXXXX.XXXXX.XXXXXXXXXXX.XXXXX.ARD)
2021-11-09 19:47:28.943470 ADMIN   350766224 Error No    466 Hitachi Storage Error: S3 curl error, Return Code=503, Reason=0, File=arssmsms.cpp, Line=2000  Srvr->serv non-SSL<-
2021-11-09 19:47:28.931814 ADMIN   350766224 Error No     24 Object >335< in Application Group >LEH< not found in node >uat-ond<  Srvr->server non-SSL<-
Within the 88-

Code: [Select]

2021-11-09 18:47:28.655797: ARS4308I Indexing completed
2021-11-09 18:47:28.656260: ARS4312I Loading started, 264070985 bytes to process
2021-11-09 18:47:28.956838: ARS1107E An error occurred.  Contact your system administrator and/or consult the System Log.  File=arsload.c, Line=9262
2021-11-09 18:47:28.956999: ARS1159E Unable to retrieve the object >335<
2021-11-09 18:47:28.957090: ARS4311E Loading failed
2021-11-09 18:47:29.670819: ARS4318E Processing failed for file >svm2271pdv.NRSC0101.NRSN1.RTLSTMTHEN.2021110803313.082310730.ARD<
Anyone have any ideas about this issue?

Thanks!

37

OD/WEK & JAVA API / ODWEK - Flow of returning document

« on: October 13, 2021, 07:48:06 AM »

Have a question about how ODWEK works as far as returning documents from our system.

We are using a distributed system with a library server and object server.

My understanding of the flow, is that the ODWEK client sends the Login Requests/Search request to the library server. The Library server then sends the hit list back to the client.

After that, the client sends the retrieve request to the Library server.

Our question is about the request. The data that comes back - Two scenarios- Which one is true - or is there a third.

1) The object server sends the data to the library server, and then the library server returns it to the ODWEK client.

2) The object server sends the data directly to the ODWEK client, bypassing the library server.

38

MP Server / Issue implementing SSL

« on: October 06, 2021, 09:00:31 AM »

Hi All,

We are in the process of getting SSL Up and running, but it looks like we have an issue connecting from the library server to the object server when SSL is enabled.

When ODWEK Calls are made-

Code: [Select]

124002:47247019583232 10/06/2021 08:41:48:330624 ERROR (null)(0)(null):Server message msg timestamp=2021-10-06 08:41:48.325613 msg userid=ADMIN msg severity=2 msg num=142 msg text=ARS0142E Connection cannot be established for the >zlt12669< server  Srvr->LibServer XXX.XXX.XXX.XXX non-SSL<- msg appl=N msg logid=869449959
124002:47247019583232 10/06/2021 08:41:48:330629 ERROR (null)(0)(null):ARSLOG message msg num=142
124002:47247019583232 10/06/2021 08:41:48:330875 ERROR (null)(0)(null):CONSOLE message msg num=142
124002:47247030097664 10/06/2021 08:41:48:333627 ERROR arssrvr.c(4798)ArcSERVP_ProcessRequest:Sending message to library server msg timestamp=2021-10-06 08:41:48.303407 msg userid=M09530 msg severity=2 msg num=142 msg text=ARS0142E Connection cannot be established for the >LIBSERV< server  Srvr->LIBSERV<- msg appl=N msg logid=869449959
These are from the trace file, when I was trying to load/retrieve from the library server -> object server. The other way around (ARSDOC/ARSLOAD OBJ --FROM/INTO --> LIB) works fine.

Code: [Select]

79057:47879365379840 10/06/2021 10:43:56:122707 ERROR arsgskod.c(2828)ArcGSKOD_Connect:socket_init ssl_rc=420 ssl_str=GSK_ERROR_SOCKET_CLOSED
79057:47879365379840 10/06/2021 10:43:56:203928 ERROR arsgskod.c(2828)ArcGSKOD_Connect:socket_init ssl_rc=420 ssl_str=GSK_ERROR_SOCKET_CLOSED
79057:47879365379840 10/06/2021 10:43:56:290131 ERROR arsgskod.c(2828)ArcGSKOD_Connect:socket_init ssl_rc=420 ssl_str=GSK_ERROR_SOCKET_CLOSED
79057:47879365379840 10/06/2021 10:43:56:406313 ERROR arsgskod.c(2828)ArcGSKOD_Connect:socket_init ssl_rc=420 ssl_str=GSK_ERROR_SOCKET_CLOSED

Anyone have thoughts?

39

MP Server / migrating from DB2 to Oracle

« on: September 23, 2021, 08:23:46 AM »

We are looking at moving from our onprem RHEL boxes that run CMOD 10.5 in a db2 environment, to an Azure environment running oracle.

We don't want to do arsdoc/arsload, because we have so much data. So, I guess our approach will be-

Export the db2 tables to oracle.
Move the mounts to oracle
Make sure all the mounts are "lined up"

I once saw a post on here, that had some high level steps, but I cant seem to find it now. does anyone have advice on doing this? or any tips.

Thanks!

40

MP Server / Error when trying to uninstall PDF Indexer on 9.5

« on: September 20, 2021, 10:53:59 AM »

Was tasked last week with uninstalling PDF Indexer on CMOD 9.5..Redhat environment. Seeing this error when i execute the uninstaller. It worked fine on the corresponding library server that we have the PDF Indexer installed on..anyone seen this?

Code: [Select]

[archive@devobj _uninst950pdf]$ ./uninstallodpdf
Invocation of this Java Application has caused an InvocationTargetException. This application will now exit. (LAX)

Stack Trace:
java.lang.IllegalArgumentException: No product for ID=deb1d888-1f12-11b2-a877-ad2b62eef1e6
        at Flexeraanw.<init>(Unknown Source)
        at Flexeraan4.ai(Unknown Source)
        at Flexeraan4.ab(Unknown Source)
        at Flexeraan5.<init>(Unknown Source)
        at com.zerog.ia.installer.Installer.bp(Unknown Source)
        at com.zerog.ia.installer.Installer.setMetadata(Unknown Source)
        at com.zerog.ia.installer.InstallerMetaData.setInstaller(Unknown Source)
        at com.zerog.ia.installer.LifeCycleManager.a3(Unknown Source)
        at com.zerog.ia.installer.LifeCycleManager.ar(Unknown Source)
        at com.zerog.ia.installer.LifeCycleManager.consoleInstallMain(Unknown Source)
        at com.zerog.ia.installer.LifeCycleManager.executeApplication(Unknown Source)
        at com.zerog.ia.installer.Main.main(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:48)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
        at java.lang.reflect.Method.invoke(Method.java:600)
        at com.zerog.lax.LAX.launch(Unknown Source)
        at com.zerog.lax.LAX.main(Unknown Source)
This Application has Unexpectedly Quit: Invocation of this Java Application has caused an InvocationTargetException. This application will now exit. (LAX)

41

Report Indexing / Indexing PPD's - ARSPDOCI 9.5.0.10 completed code 4

« on: September 10, 2021, 10:54:03 AM »

We are loading a bunch of PDF files, This particular application group comes from iText. Most files load, however- Seeing intermittent failures. Among these intermittent failures, there's tons of successful loads, into other application groups as well, originating from the same 2 load-balanced servers running arsload/pdf indexer.

Code: [Select]

ARS4302I Indexing started, --UNKNOWN-- bytes to process
ARS4901I INDEXSTARTBY=1
ARS4901I RESTYPE=ALL
ARS4901I INDEXMODE=INTERNAL
ARS4901I PARMDD=/opt/app/workload/arsload/pdfFile_arsload.parm
ARS4901I INPUTDD=/opt/app/workload/arsload/pdfFile_arsload
ARS4901I OUTPUTDD=/opt/app/workload/arsload/pdfFile_arsload.out
ARS4901I INDEXDD=/opt/app/workload/arsload/pdfFile_arsload.ind
ARS4901I RESOBJDD=/opt/app/workload/arsload/pdfFile_arsload.res
ARS4922I ARSPDOCI 9.5.0.10 completed code 4
Here's an example of the loads/failures

2021-09-10 13:25:03.781009
2021-09-10 13:21:36.915310
2021-09-10 13:21:07.477156
2021-09-10 13:15:26.686449
2021-09-10 13:07:38.617789
2021-09-10 13:07:09.022827
2021-09-10 13:03:01.136332
2021-09-10 13:00:57.789100
2021-09-10 12:56:07.609028 FAILURE
2021-09-10 12:52:41.922350
2021-09-10 12:52:20.029268
2021-09-10 12:51:08.090807
2021-09-10 12:42:54.922132
2021-09-10 12:41:08.919243
2021-09-10 12:38:55.197800
2021-09-10 12:33:52.316784
2021-09-10 12:28:55.989293
2021-09-10 12:22:21.608910
2021-09-10 12:21:07.770830
2021-09-10 12:19:20.388717
2021-09-10 12:15:11.860829
2021-09-10 12:13:57.437055
2021-09-10 12:07:53.629861
2021-09-10 12:06:16.805737
2021-09-10 12:04:30.884266
2021-09-10 11:57:10.667217 FAILURE

I can't find anything on this error, but my sneaking suspicion is that this script that runs arsload, is running- before the file is finished generating, or something.

Either that, or something is up with these boxes- http://www.odusergroup.org/forums/index.php/topic,3186.0.html

42

MP Server / ARSLOAD Issue - PDF Indexer with PPD loading very slow

« on: September 08, 2021, 08:07:13 AM »

Hi All,

We are loading from a remote CMOD Server (RHEL/DB2 V11/Cache):

Code: [Select]

Load Version <9.5.0.10>  Operating System <Linux> <#1 SMP Mon Feb 22 18:03:13 EST 2021.3.10.0-1160.21.1.el7.x86_64>  OS Userid <CMODADM>  Install Location </opt/workload/ibm/ondemand/V9.5/> Data(unlimited KB) Stack(8192 KB) Core(0 512-blocks) Cpu(unlimited seconds) File(unlimited 512-blocks) Nofiles(16384) Threads(0) Processes(4096)
..Into a fresh CMOD V10.5 install. We are noticing slow load times with a series of application groups. These reports are indexed using PPD's. Client is complaining that these batches of files are taking too long to index and load. Our problem is we have like 50 million docs to load and are only doing 100k/day or something like that. Unfortunately, I can't test this in my dev box..Because there's some kind of issue getting me a sample file. Something with the way they are generated.. Whatever that means.

Some numbers from the system load. from the system load (From the existing production system giving me the "issue") I noticed that index time is taking a lot longer than expected, and also than what i've tested with a sample PPD file from IBM. A much larger file, with much more documents, took less time.

Code: [Select]

       

Elapsed             IDX Time                   Docs                 Pages  Comp                    In                             Out
149.6544         122.1313                 1000                 6945 OD77             39392339             18658650
84.2975          60.9946                 1000                 5975 OD77             38167441             18119565
77.5499          50.2290                  463                 2348 OD77             15994287              4661084
106.8029          85.7542                 1000                 6281 OD77             38336344             18174458

Sample PPD Lab from IBM:

Code: [Select]

Application Group Load: Name(PPD) LoadId(5284-3-0-12FAA-20120123000000-20120123000000-5285) File(file_with_ppd.pdf) InputSize(111236081) OutputSize(50530342) Rows(6444) Time(56.6456) Appl(PPD) InputFileSize(163878229)
What are some considerations that I should look at on this remote server, where the PDF indexer is being used? One of the first things I noticed was the ulimits. I compared them to another CMOD system that uses ACIF, and noticed a difference. Unfortunately we are in the middle of a freeze right now, and I cant touch this..I also can't lay down the 10.5 binaries either.

System presenting the slow loading-

Code: [Select]

Data(unlimited KB) Stack(8192 KB) Core(0 512-blocks) Cpu(unlimited seconds) File(unlimited 512-blocks) Nofiles(16384) Threads(0) Processes(4096)
Existing CMOD System using ACIF, zero issues ever loading.

Code: [Select]

Data(unlimited KB) Stack(unlimited KB) Core(0 512-blocks) Cpu(unlimited seconds) File(unlimited 512-blocks) Nofiles(1000000) Threads(0) Processes(unlimited)
What kind of resources should this remote server be spec'ed out to. Wondering if throwing more memory/CPU at it will speed things up. I also noticed that the load time itself seems long for being such a small file, despite the CMOD boxes/PDF Indexer boxes being in  different data centers. Mentioned "possible" network latency.. But The client didnt like that answer.

43

OD/WEK & JAVA API / Connection between ODWEK and Library Server.

« on: September 01, 2021, 08:36:32 AM »

Apologize for the ignorance with the topic, I am not an ODWEK person, at all.

Our ODWEK folks came to us with a question- they want to know what protocol is used by ODWek to communicate with the CMOD servers, and most importantly, whether that protocol is secure.

It is my understanding that TCP/IP is used, and that the connection is secure because ODWEK and the library server, will use the IBM Global Security kit to secure that connection.

Is that accurate? Or am I in left field.

Thanks!

44

MP Server / quick daemon question

« on: July 19, 2021, 08:04:05 AM »

I have a requirement where I "Think" a daemon might be our best bet to load a bunch of files.

I am trying to fire it up, not so much working. It has actually been about 5-6 years since ive had to do this. Here's what I have.

Code: [Select]

arsload -nvf -u jeff -p jeff.stash -B IGN.APP.AG.IGN.IGN.IGN.EXT -t 60 -h archive &
The file name is-

Code: [Select]

9898541175.TESTAPP.TESTAG.IGNOREHTHIS.20210712.010447405.ARD
I go to fire it up-

Code: [Select]

[1] +  Done(6)                 arsload -nvf -u jeff -p jeff.stash -B IGN.APP.AG.IGN.IGN.IGN.EXT -t 60 -h archive &
I have a feeling this is a very simple issue. OF course, I could easily script this as well, but I want to test something for a daemon.

45

MP Server / recreated extracted PDF File?

« on: July 16, 2021, 12:43:51 PM »

I am working with a file that was loaded using PPD's, trying to figure out some slowness.

Once the file is loaded, is there any way to extract the file as a whole, as it was loaded originally into CMOD? i am having issues getting it from the folks that send the files.

Basically, is it possible to some how recreate the file using the .out and the .res file?

Thanks in advance