Messages

1

MP Server / Re: CMOD MP on AIX - Archive Server Degradation

« on: September 02, 2021, 10:05:04 AM »

For a little additional information here, we're not running any DB2 stats on the archive server - running db2 10.5.

We're running arsmaint -cdemr on the library server.

2

MP Server / CMOD MP on AIX - Archive Server Degradation

« on: September 02, 2021, 08:12:29 AM »

Hey Gang -

Hope everyone is well!

I've run into a problem with significantly-reduced performance retrieving content from my archive server.

I'm running CMOD 9.5 on AIX with DB2 and TSM for the Archive Server.

My archive server is an AIX LPAR running 7.2.

My AIX admins tell me the box isn't even scratching the surface of memory, cpu, or swap space constraints.

My cache hits are just fine, but when routing to a storage pool pointing to my archive server, I've seen results as bad as 40 seconds or even timeouts

I've done some trace routing to make sure something didn't happen with routing, and that's all good.

Any quick places to look?

I'll follow with some numbers of Cache hit performance to compare with Storage Pool performance.

3

MP Server / Command Line arsload process returned "Killed"

« on: January 27, 2021, 01:22:49 PM »

We have encountered an issue where when I try to load a file with PDF statements that my load fails, returns the word "Killed" to my command line prompt and nothing in my System Log   Anybody seen this before?  I'm running on AIX 7.2, and CMOD 9.5.0.4 and DB2 10.5 and TSM 7.2.

4

MP Server / Re: Killing a hung arsload process on MP 9.5 on AIX 7.2

« on: January 14, 2021, 10:26:00 AM »

So I just killed the PID for the hung wrapper script process, and everything stopped just fine. 

My input file was a file of PDF statements that were corrupt and couldn't be read.

Never a good idea to try and load those

5

MP Server / Killing a hung arsload process on MP 9.5 on AIX 7.2

« on: January 14, 2021, 08:25:09 AM »

So I have a file that is not loading via wrapper script (.ksh) that is calling arsload.

My load syntax is "...bin/arsload -vf -c /arstmp -B IGN.IGN.APP.AG.IGN.IGN.EXT /arsacif/acif1/...filename.pdf"

I want to gracefully kill the arsload program's trying to load a file without jacking up the platform.

Should I just execute the Kill PID to kill the wrapper script?

It's a 1.4MB file that has been hung up for 36 hours

6

Content Navigator / Re: Troubleshooting - OnDemand Client or Content Navigator Desktop

« on: December 04, 2020, 08:14:37 AM »

Ed - Thanks for the follow-up.

I can definitely birddog this and do some benchmarking.

Is there a way in Navigator to restrict content by size so that I can restrict viewing content i ONLY want viewed through OnDemand thick client?

I'm guessing the Navigator assumes if you've loaded it to a repository that you should be able to return it?

7

Content Navigator / Troubleshooting - OnDemand Client or Content Navigator Desktop

« on: December 03, 2020, 11:09:28 AM »

I have an issue with many PDF documents I'm storing in CMOD - many have are documents with LOTS of images.

When my internal customers try to return some of these via Navigator, they can compromise my Navigator WebSphere app server on which I'm also running web services for external customer portal access  .

What I've had to do to help my external clients become whole is to stop the Navigator application in WebSphere to let the web services calls stabilize.

After some time passes I restart the Navigator process.

My question is, what if for these customers needing to access the large statements if I installed OnDemand Client on their desktops, would that resolve my problem?

I'm not sure if the problem is Content Navigator's communication with the CMOD Library Server OR if it's the process of converting PDF files and resources on the server to render the statement to the customer.

Also, is there a way to put a governor on the Conent Navigator destop to set a threshold on how large a file a user can retrieve through Navigator?

8

MP Server / Long Running ARSLOAD - How to see progress and kill

« on: December 01, 2020, 10:40:44 AM »

We have some new jobs that we've created and they are running for hours - like 12 hours

Is there any way to see progress on these loads?

If I know how much is loaded, I can determine whether I want to wait for the job to complete or just cancel.

As far as canceling goes, is there a graceful way to cancel this without killing my Unix PID?

Also, I'm thinking if I kill my load job PID that it won't back out the loaded records, right?

I'm running CMOD MP 9.5 on AIX 7.2 with DB2 10.5, and TSM 7.1.4.

Thanks.

9

MP Server / Re: CMOD 9.5 MP Load Fails - No System Log Error Message?

« on: December 01, 2020, 10:32:50 AM »

Thanks Justin and Ed - appreciate you two!!

Also, in this Covid-19 age, we're running lots of things over VPN.

Does the following look how you'd recommend running a command line script:

nohup arsload <options>  >arsload.log 2>&1

10

MP Server / Re: CMOD 9.5 MP Load Fails - No System Log Error Message?

« on: November 30, 2020, 05:54:49 AM »

Correct - running on AIX.

I'm not sure how a korn shell script running arsload commands on the command line would return anything but an arsload error - maybe it's capturing standard output from AIX?

Perhaps I need to capture standard output the next time my teammate attempts to load this particular file.

This is a strange use case that a load file fails with no Msg. 88.

11

MP Server / Re: Redaction in CMOD - What can you do?

« on: November 30, 2020, 05:48:56 AM »

Thanks so much for the GREAT explanation as always Justin!

The ask is to redact on export of the PDF statements themselves and not metadata.

If we end up going down this path, I'll share what/how we did it with the community!

12

MP Server / Redaction in CMOD - What can you do?

« on: November 25, 2020, 11:29:06 AM »

So we haven't done any redaction of the statements that we've loaded to CMOD over the years, but now we have a request to do so.

This request raises 3 questions.

1. Can CMOD redact fields on the documents you load into CMOD?
- For example, let's say I had an account number on a statement and I only wanted to show the last 4 characters in viewer - is there a way to do that?

2. Can I export these same statements out of CMOD using my example above showing ONLY the last 4 of an account number on export/print?

3.  Assuming CMOD can redact BUT that I did NOT redact statements on import, is it possible to redact the statements using the same example on export - again showing only the last 4 of the account number and hiding the leading digits?

My platform specifics are CMOD 9.5 on AIX 7.2, PDF Indexer, TSM 7.1.4, and DB2 10.5.

Thanks.

13

MP Server / Re: CMOD 9.5 MP Load Fails - No System Log Error Message?

« on: November 25, 2020, 10:47:25 AM »

Thanks Ed - I'll try to run that down and see what I find on the DSNAOINI and will also poke my admins on memory - appreciate you!!

14

MP Server / CMOD 9.5 MP Load Fails - No System Log Error Message?

« on: November 23, 2020, 05:27:06 PM »

So we are loading some statement files via PDF Indexer and my loads are failing but presenting no messages in my System Log?!?!?

We're running 9.5.0.4 on AIX 7.2 and DB2 10.5 and TSM 7.1.4.

I AM seeing error message in my custom script log, as follows: return code of 137 received from /path/arsload, but that's it ?!?!?!

I'm asking my Unix Admins where that message is generated from, as I don't see it in any IBM documentation.

My custom load scripts are just korn shell scripts to run arsload commands with format files, which I have run successfully for years. 

And many files have processed successfully but a couple have failed any thoughts on troubleshooting - and they're good size - in excess of 340MB?

It almost makes me think it's a file issue, but with no error message to go on that I can track down, I'm not sure where to go with this   Any thoughts?

15

MP Server / Re: Unified Content and Access integration Layer (UCAIL)

« on: November 20, 2020, 05:01:16 AM »

So there are a few of things going on there, Justin.

First - Check Images - Our primary use case is PDF check statements with lots of images - as I appreciate it, CMOD stores check images separately from text and effectively reassembles them on the ODWK "get".  Because we have some statements with thousands of pages of images, these can completely compromise our performance when these statements are called to reassemble.

Second - Bad Design - We have a variety of statements stored across a variety of AGs and Folders, AND we have the same fields named differently across AGs/Folders (synonyms) that when trying to pull everything for a customer across the whole API is problematic.  In short, this is somewhat our own fault.  We had several cooks in the kitchen at one time before my team took over.   

Third - [ODWEK] API Performance/Expertise - Our developers don't want to have to learn every application's API and instead argue for an abstraction layer.  Also, searching ODWEK across a slew of CMOD Folders/AGs to retrieve ALL of a customers statement types is pretty painful to them, and they argue it doesn't perform near as well as an abstraction model does.

Hopefully this helps a bit.