Messages

31

MP Server / Re: Library Server Hangs when LARGE PDF statements (> 200 MB) Retrieved

« on: August 09, 2019, 09:39:41 AM »

Justin -

For sure the images are what is killing me.

I'm trying to determine a way to stop these from being loaded on the front side of the equation so that I don't have to reactively address.

Is there some guidance on ways to search and retrieve statement sizes from the DB2 tables that my large statements are stored in to identify potential offenders?

Stephen -
To your question about what's hanging, the CMOD Library Server memory goes to 100% and compromises connections to CMOD via ICN as well as external web services.

32

MP Server / Library Server Hangs when LARGE PDF statements (> 200 MB) Retrieved

« on: August 07, 2019, 01:29:13 PM »

I posted this thread on the ICN board, but really this is a CMOD MP issue.

Our primary use of our CMOD 9.5 MP platform is for storing PDF statements for internal and external customers.  We've encountered an issue where large PDF statement files > 200 MB will completely hang our platform up if a user attempts to view via Navigator or OnDemand thick client.  While these LARGE statement sizes are few and far between, they do exist, and I've had my platform compromised/completely hung up a couple of times recently by this use case.   

I am using the Standard Daeja ViewONE viewer instead of associating the PDF file to Adobe.  I've tried associating the PDFs with Adobe to help performance, but it only helps minimize the loading up of the PDF into the viewer - still major degradation. 

Unfortunately, I don't have much say in the files that get loaded to the platform - they are what they are - most of the millions of statements are just a couple of pages, but I have instances of the exception all the way up to 5,000+ pages and 500 MB, which just hang my platform.

Perhaps I query the platform for these large files, export them, and remove them from the platform?

Other thoughts?

33

Content Navigator / ICN fronting CMOD Hangs up for LARGE Files - How to Control??

« on: August 07, 2019, 01:04:03 PM »

So I'm using ICN 3.0.3 to front my CMOD 9.5 MP platform.  My primary use of the platform is for storing PDF statements for internal and external customers.  We've encountered an issue where large PDF statement files > 200 MB will completely hang our platform up if a user attempts to view via Navigator.  While these statement sizes are few and far between, I've had my platform compromised/completely hung up a couple of times recently by this use case.   While there is a governor in the Admin panel to limit the size of files returned, this is NOT valid for CMOD, and ICN will try to present the CMOD statement regardless of the size you set there. I updated this previous line as I have found that there is no OOTB governor to restrict the size of files returned by ICN ONLY to limit the size of files converted to PDF. I am using the Standard Daeja ViewONE viewer instead of associating the PDF file to Adobe.  I think I'm going to see if this doesn't help performance.  I don't have much say in the files that get loaded to the platform - they are what they are - most are just a couple of pages, but I have instances of the exception all the way up to 5,000+ pages and 500 MB, which just hang my platform.

34

MP Server / Re: Why not FileNet for PDF Statements with IBM

« on: July 11, 2019, 12:11:13 PM »

Ed -

That for sure is a good case for CMOD - thank you for reminding me of that!

This is indeed what I'm looking for - the Pros and Cons of one platform over and against the other for this particular use case.

TJ -

35

MP Server / Why not FileNet for PDF Statements with IBM

« on: July 11, 2019, 11:09:53 AM »

IBM markets CMOD as an ePresentment platform - banking statements are a great example of a use case IBM touts using CMOD for.

Because I have 2 COLD storage platforms, one of which is CMOD MP 9.5, I'm thinking about getting rid of one of the two and cutting some costs and leveraging FileNet instead for the PDF statements use case.

Note: For my question, assume I'm storing PDF statements only and therefore gaining little-to-no compression savings on storage.

What is the "special sauce" that makes CMOD better than FileNet, for example, for storing and retrieving PDF statements via external web portal UI for a customer? 

Thanks in advance for your insight.

36

MP Server / Re: How to delete single statements from a CMOD Load File

« on: December 20, 2018, 09:48:36 AM »

Thanks Justin, and in their defense it's maybe how I phrased my question - asked to unload - and can't do that, BUT you can Arsdoc Delete as you note. 

I posed this question and found the response here, as well for future reference: http://www.odusergroup.org/forums/index.php?topic=2192.0 .

37

MP Server / How to delete single statements from a CMOD Load File

« on: December 20, 2018, 08:28:39 AM »

Happy Holidays to everyone!!

I have an issue where I'm trying to unload one statement (the metadata) from a load file without unloading ALL the statements in the load file.

I know this can be done, but IBM CMOD Support says you can't do it.

I think it's a simple as removing the metadata from the db2 statement table where the criteria exist.

This effectively renders the statement unviewable even though it exists on your platform

I even think there were some articles published about this but I for the life of me cannot find them

38

MP Server / Re: To install FTS server or not?

« on: April 27, 2018, 01:45:00 PM »

Well of course - thick clients - being client side searching 

We're not using any thick clients - only IBM Content Navigator for searching and viewing here - so all our searches will be server side.

And of note, we have both internal and external customers being served up from this same platform

I for sure don't want to kill my external client statement retrievals by adding this new capability

I guess we'll just have to do some load testing and benchmarking and report back here with our results

Any other thoughts?

Any other thoughts?

39

MP Server / Upgrade Approach for CMOD MP 9.5, TSM 7.1, and DB2 10.5 on AIX

« on: April 27, 2018, 01:37:15 PM »

So here's a fun one - a CMOD platform upgrade !!!

What I'm doing:
Moving from 9.5.0.7 to 10.1.0.3 on AIX 7.2 LPARs.

What I'd like to get:
A recommendation for how to best break the change up into maybe 2 releases, test, and release separately to production.

My architecture is as follows:
CMOD Library Server MP 9.5.0.7 on Unix LPAR 1
- Running DB2 10.5 - planning to leave at 10.5 unless recommend other?
- Running TSM Client 7.1.4
-- Will be installing Enhanced Records Management (new)
-- Will be installing FTS Server [on Library Server in DEV] (new)
-- Upgrading PDF Indexer to 10.1
-- Upgrading ODF to 10.1
TSM/Spectrum Server 7.1.1.100 on Unix LPAR 2
- Running DB2 10.5

My very high-level approach:
1. Upgrade TSM 7.1.1.100 to 8.1 (Unless it's possible to NOT have to do this and leave TSM Server at existing level and upgrade after I've put CMOD 10.1 in production?)
2. Install Spectrum 8.1 client on Library Server (Unless it's possible to just upgrade the client to 7.1.8.2 and retain TSM 7.1.1.100 as my TSM Server)
3. Upgrade CMOD from 9.5 to 10.5.0.3.

As I appreciate it from IBM, I could start with the TSM client on the Library Server LPAR - upgrade it to 7.1.8 and then apply fixpack 7.1.8.2 - this fixpack is necessary for arssockd to start for those using this client.  The question is can my 9.5 MP server talk through a 7.1.8.2 client to the 7.1.1.100 TSM Server as a test, and THEN can I upgrade ONLY my CMOD Server to 10.5 in this configuration and talk to TSM Server 7.1.1.100.  And then I could follow that up with a TSM 7.1 to Spectrum 8.1 Upgrade.

Thoughts/ recommendations?

40

MP Server / Re: To install FTS server or not?

« on: April 19, 2018, 08:17:13 PM »

So I did some more research and determined that if users require searching non-indexed fields that I will definitely need FTS Server to search.  80% of the reports I will be ingesting are minus indexes and users are used to wild card searching text strings across a host of folders.

The question is, do I need to place the FTS Server on a separate AIX LPAR (in my example) with its own database or install it on my library server.  And I think your answer is that it depends on whether they’re doing client-side or server-side searching.

When you say server side versus client side, I’m not sure what you mean.  Are you calling a server side search one where I’ve installed FTS on my library server and a client side search one where I’ve installed an FTS server separately on separate hardware?

And when I do this and benchmark it, I will share the results :-)

41

MP Server / To install FTS server or not?

« on: April 18, 2018, 05:50:33 AM »

I am replacing a system that is all about text and line report data with my CMOD platform. 

I have only stored indexed PDF data in CMOD today as statements, and so just capturing this kind of data and report types is new to me.

Further, the way many of their users search their system is to select a list of reports and then do a full text search on a phrase across those reports. Yikes!

In short, I am wanting to understand what text searching I can do without an FTS Server and what is the line I step over that requires an FTS server to be installed.

As I appreciate CMOD there are some built-in full text search capabilities for searching text documents out of the box without FTS Server beyond just index values, But I don’t quite understand those just yet.

And as I understand those capabilities, they may only applicable when you have returned documents using an indexed search in a result list and then want to further search the results by full text in those documents.

How do I determine if I need FTS Server or not?

Thanks in advance!

42

MP Server / Technical Design Advice Needed - Significantly Growing my CMOD Platform

« on: May 19, 2017, 04:27:02 AM »

My CMOD system is swallowing another system that is 3 times its size and that has 9000 reports in it. 

I'm looking for physical design guidance beyond what IBM provides and am looking to scale horizontally with additional object servers.

My System Today
I'm running my Library Server and Object Server on one LPAR and also doing loads on this same LPAR and am archiving to TSM on a separate LPAR.  On my Library/Object server I've allocated 700 GB of 90-days Cache @ 80% utilization and have allocated 4.4 TB of TSM storage at 70% utilization on my TSM LPAR.  I have 180 APPs today across 50 AGs serving up 1200 internal users and up to 250000 external users.  My system today is totally running PDF Indexer based reports.

The System I'm incorporating is currently 10 TB - we think we can get it down to 7TB by eliminating outdated reports.  It has 3000 users and 9000 reports. That said, it's equivalent to my system twice over.  Also, this system is completely mainframe print streams and datasets/text reports.

The Design
I think at a minimum I need to add 2 Object Servers to account for the additional cache and report management and will after report analysis determine how I spread the reports across those two new LPARs.  Any thoughts here?

I'm unsure of what my options around load management?  Today, I load all my APPs on my Library/Object Server LPAR.  Do I set up load jobs on each of the new object servers I'm creating, OR do I set up a 3rd LPAR to manage ALL my loads?

Thanks in advance for any guidance or documents that help vet some of these items out.

43

MP Server / Can I unload one statement from a CMOD Load file?

« on: April 20, 2017, 09:13:21 AM »

I'm just wanting to make sure there is no way to unload a couple of statements out of a load file that has 8500 statements in it already loaded to CMOD. 

I think my ONLY recourse is to unload the whole file of 8500 statements, correct the 2 problem statements, and then reload, right?

44

MP Server / Migrating from Dual-Load to Replicated - Looking for High-Level Steps

« on: March 15, 2017, 03:04:19 PM »

We’re evaluating moving from Multi-site active/standby configuration (using dual-load to simulate mirroring) to a Multi-site primary/secondary with disk replication.

We’re looking to use replication and completely replicate the primary to the secondary.

My current status is that my active (primary) environment is upgraded to CMOD 9.5, and my passive (standby) environment is running 8.5.

My thoughts are that if we move to a replicated environment, I could avoid having to upgrade the passive (standby) environment, but I’m not sure if that’s true or not.

Looking for some high-level steps to migrate from one solution to the other.

45

MP Server / ODF Distribution and SQL Query Text Files

« on: February 21, 2017, 08:49:50 PM »

In one of my ODF distributions, I'm looking for > 300 accounts in my SQL and want to make this as easy as possible for my customer to manage.  Is there a way to have an ODF distribution read a text file of account numbers for example so that the SQL query doesn't have to be as complex in ODF Admin and also provide ease of use.