Topics

1

MP Server / CMOD MP on AIX - Archive Server Degradation

« on: September 02, 2021, 08:12:29 AM »

Hey Gang -

Hope everyone is well!

I've run into a problem with significantly-reduced performance retrieving content from my archive server.

I'm running CMOD 9.5 on AIX with DB2 and TSM for the Archive Server.

My archive server is an AIX LPAR running 7.2.

My AIX admins tell me the box isn't even scratching the surface of memory, cpu, or swap space constraints.

My cache hits are just fine, but when routing to a storage pool pointing to my archive server, I've seen results as bad as 40 seconds or even timeouts

I've done some trace routing to make sure something didn't happen with routing, and that's all good.

Any quick places to look?

I'll follow with some numbers of Cache hit performance to compare with Storage Pool performance.

2

MP Server / Command Line arsload process returned "Killed"

« on: January 27, 2021, 01:22:49 PM »

We have encountered an issue where when I try to load a file with PDF statements that my load fails, returns the word "Killed" to my command line prompt and nothing in my System Log   Anybody seen this before?  I'm running on AIX 7.2, and CMOD 9.5.0.4 and DB2 10.5 and TSM 7.2.

3

MP Server / Killing a hung arsload process on MP 9.5 on AIX 7.2

« on: January 14, 2021, 08:25:09 AM »

So I have a file that is not loading via wrapper script (.ksh) that is calling arsload.

My load syntax is "...bin/arsload -vf -c /arstmp -B IGN.IGN.APP.AG.IGN.IGN.EXT /arsacif/acif1/...filename.pdf"

I want to gracefully kill the arsload program's trying to load a file without jacking up the platform.

Should I just execute the Kill PID to kill the wrapper script?

It's a 1.4MB file that has been hung up for 36 hours

4

Content Navigator / Troubleshooting - OnDemand Client or Content Navigator Desktop

« on: December 03, 2020, 11:09:28 AM »

I have an issue with many PDF documents I'm storing in CMOD - many have are documents with LOTS of images.

When my internal customers try to return some of these via Navigator, they can compromise my Navigator WebSphere app server on which I'm also running web services for external customer portal access  .

What I've had to do to help my external clients become whole is to stop the Navigator application in WebSphere to let the web services calls stabilize.

After some time passes I restart the Navigator process.

My question is, what if for these customers needing to access the large statements if I installed OnDemand Client on their desktops, would that resolve my problem?

I'm not sure if the problem is Content Navigator's communication with the CMOD Library Server OR if it's the process of converting PDF files and resources on the server to render the statement to the customer.

Also, is there a way to put a governor on the Conent Navigator destop to set a threshold on how large a file a user can retrieve through Navigator?

5

MP Server / Long Running ARSLOAD - How to see progress and kill

« on: December 01, 2020, 10:40:44 AM »

We have some new jobs that we've created and they are running for hours - like 12 hours

Is there any way to see progress on these loads?

If I know how much is loaded, I can determine whether I want to wait for the job to complete or just cancel.

As far as canceling goes, is there a graceful way to cancel this without killing my Unix PID?

Also, I'm thinking if I kill my load job PID that it won't back out the loaded records, right?

I'm running CMOD MP 9.5 on AIX 7.2 with DB2 10.5, and TSM 7.1.4.

Thanks.

6

MP Server / Redaction in CMOD - What can you do?

« on: November 25, 2020, 11:29:06 AM »

So we haven't done any redaction of the statements that we've loaded to CMOD over the years, but now we have a request to do so.

This request raises 3 questions.

1. Can CMOD redact fields on the documents you load into CMOD?
- For example, let's say I had an account number on a statement and I only wanted to show the last 4 characters in viewer - is there a way to do that?

2. Can I export these same statements out of CMOD using my example above showing ONLY the last 4 of an account number on export/print?

3.  Assuming CMOD can redact BUT that I did NOT redact statements on import, is it possible to redact the statements using the same example on export - again showing only the last 4 of the account number and hiding the leading digits?

My platform specifics are CMOD 9.5 on AIX 7.2, PDF Indexer, TSM 7.1.4, and DB2 10.5.

Thanks.

7

MP Server / CMOD 9.5 MP Load Fails - No System Log Error Message?

« on: November 23, 2020, 05:27:06 PM »

So we are loading some statement files via PDF Indexer and my loads are failing but presenting no messages in my System Log?!?!?

We're running 9.5.0.4 on AIX 7.2 and DB2 10.5 and TSM 7.1.4.

I AM seeing error message in my custom script log, as follows: return code of 137 received from /path/arsload, but that's it ?!?!?!

I'm asking my Unix Admins where that message is generated from, as I don't see it in any IBM documentation.

My custom load scripts are just korn shell scripts to run arsload commands with format files, which I have run successfully for years. 

And many files have processed successfully but a couple have failed any thoughts on troubleshooting - and they're good size - in excess of 340MB?

It almost makes me think it's a file issue, but with no error message to go on that I can track down, I'm not sure where to go with this   Any thoughts?

8

MP Server / CMOD Load Threshold Metrics - MP 9.5 on AIX with DB2 and PDF Indexer

« on: November 20, 2020, 04:36:52 AM »

Has anyone ever seen when loading PDF files with many contiguous statements where you can cross loading thresholds such that you have to keep file sizes below a certain size to get them to load in a reasonable amount of time?

I have an example where a 200 MB PDF file loads in 4.4 hours but when I try to load one that is 340+MB it takes 11.5 hours to load?  Scratching my head   

I originally thought the dropping unnecessary indexes from the AG was the issue, but the problem is clearly larger than just indexes. 

Note: I have other AGs that can load PDF files that are 500MB in minutes and not hours.

9

MP Server / Unified Content and Access integration Layer (UCAIL)

« on: November 08, 2020, 08:42:36 AM »

So there are vendors in the marketplace that have productized software to create integrated content access and integration layers that abstract your content repositories (FileNet, CMOD, SharePoint, et. al.) metadata properties (including pointers to documents/reports) to an "access and integration layer" typically storing this metadata in NoSQL database.  This can empower web service access to enterprise search and "get" calls at this "access and integration layer" in lieu of writing API interfaces to all the individual back office content stores.  Assume for the sake of conversation that all noted so far is possible, when it comes to CMOD, is there a way to get to a single "Unique ID" for a specific CMOD document or report?  Given that CMOD is all about where something is within an input file, it's much different than a GUID (globally unique ID) that is stored in a content repository like FileNet or SharePoint.  Just wanted to see if anyone had attempted to do this and what they had come up with as their solution. 

10

MP Server / Changing Application Group Field Indexes to Filters

« on: October 20, 2020, 08:33:30 AM »

I have a 9.5.0.4 CMOD OnDemand MP solution running on AIX 7.2 and DB2 10.5, and TSM 7.1 that takes FOREVER (many hours) for me to load a 300MB load file of statements.

As a comparison, I have many other AGs to which I can load the same size files in a fraction (less than an hour) of the time.

What I have found is my AG developer created an inordinate amount of indexes (10), and I think this is the problem with load performance.

All the other AGs that load in a fraction of the time include at most 3 indexes.

Onto my question - Can I just update my AG to change the fields that are Indexes to Filters?

How does DB2 handle this when I drop effectively about 7 indexes?

Thanks so much!!

11

MP Server / Changing AD UPN value - Will this break CMOD 9.5 Users Authenticating to AD?

« on: July 16, 2020, 02:40:15 PM »

We are using CMOD 9.5 MP on AIX and are planning on updating our Active Directory UPN values as part of another initiative.

In AD, as I appreciate it,  there are the following userid attributes:

userPrincipalName (UPN) – Current value = TESTUSER@DOMAINCONTROLLER.pri    New value = TESTUSER@emaildomain.com
sAMAccountName – current value = TESTUSER      no change

We're effectively changing the userPrincipalName from a network domain to an email address.

Does anyone know if CMOD uses UPN values to authenticate users or the sAMAccountName to authenticate users?

Thanks.

12

MP Server / Getting ARS1110E Error when attempting to load PDFs to updated AG

« on: May 11, 2020, 01:03:59 PM »

I'm attempting to copy an existing application group to _old and add a new application group with the previous application group name.

And while I can get all this to work, I can't load the application group without getting the following error: 

ARS1110E The application group >< does not exist or user >ADMIN< does not have permission to access the application group

The interesting part about the error is that when I run the arsload command utility from the command line to load this PDF data that it doesn't seem to recognize my AG - note in message "The Application group >< does not exist..." - and I'm specifying it explicitly in the following load syntax with a format:

/opt/IBM/ondemand/V9.5/bin/arsload -nvf -c /arstmp -b "VALUE" -B IDX.IGN.AG.APP.IGN.IGN /export/home/userid/VALUE.JOBNAME.AGName.Appname.07312016.101518.pdf

Note: if I remove my newly created application group and re-run the load syntax above it loads just fine

13

MP Server / Load Jobs Failing and no System Log Messages??

« on: January 30, 2020, 10:21:18 AM »

Has anyone seen an instance where load jobs that have run for years start failing but that give absolutely zero messages in the system log except for message 81 (AG object query completed)?

While most of our AGs load just fine, all of a sudden we have few starting to fail with this strange phenomenon?!?!

The content is PDF and is going through the PDF Indexer program.

This is occurring on AIX 7.2 running CMOD 9.5.04 MP with DB2 10.5.3 and TSM 7.1.1.

14

MP Server / Library Server Hangs when LARGE PDF statements (> 200 MB) Retrieved

« on: August 07, 2019, 01:29:13 PM »

I posted this thread on the ICN board, but really this is a CMOD MP issue.

Our primary use of our CMOD 9.5 MP platform is for storing PDF statements for internal and external customers.  We've encountered an issue where large PDF statement files > 200 MB will completely hang our platform up if a user attempts to view via Navigator or OnDemand thick client.  While these LARGE statement sizes are few and far between, they do exist, and I've had my platform compromised/completely hung up a couple of times recently by this use case.   

I am using the Standard Daeja ViewONE viewer instead of associating the PDF file to Adobe.  I've tried associating the PDFs with Adobe to help performance, but it only helps minimize the loading up of the PDF into the viewer - still major degradation. 

Unfortunately, I don't have much say in the files that get loaded to the platform - they are what they are - most of the millions of statements are just a couple of pages, but I have instances of the exception all the way up to 5,000+ pages and 500 MB, which just hang my platform.

Perhaps I query the platform for these large files, export them, and remove them from the platform?

Other thoughts?

15

Content Navigator / ICN fronting CMOD Hangs up for LARGE Files - How to Control??

« on: August 07, 2019, 01:04:03 PM »

So I'm using ICN 3.0.3 to front my CMOD 9.5 MP platform.  My primary use of the platform is for storing PDF statements for internal and external customers.  We've encountered an issue where large PDF statement files > 200 MB will completely hang our platform up if a user attempts to view via Navigator.  While these statement sizes are few and far between, I've had my platform compromised/completely hung up a couple of times recently by this use case.   While there is a governor in the Admin panel to limit the size of files returned, this is NOT valid for CMOD, and ICN will try to present the CMOD statement regardless of the size you set there. I updated this previous line as I have found that there is no OOTB governor to restrict the size of files returned by ICN ONLY to limit the size of files converted to PDF. I am using the Standard Daeja ViewONE viewer instead of associating the PDF file to Adobe.  I think I'm going to see if this doesn't help performance.  I don't have much say in the files that get loaded to the platform - they are what they are - most are just a couple of pages, but I have instances of the exception all the way up to 5,000+ pages and 500 MB, which just hang my platform.