Messages

166

Report Indexing / Re: Generic Indexing : Batch Vs Single

« on: June 09, 2021, 12:38:40 PM »

The benefits are primarily reducing overhead in process, overhead in the database, and compression performance.

I've dealt with this in the past -- an insurance company was using CMOD as a glorified print server.  Requests would go from the mainframe, be sent to OnDemand and loaded a few at a time, then employees would search CMOD for their document, and print documents locally for customers to sign.  I cut their storage requirements by 80% for that App Group (with better compression), and reduced the size of their DB2 database by half (most of it from the arsload table), and their TSM database by nearly 75% (because they had 1/100th the archived objects to track).

-JD.

167

MP Server / Re: windows arsload service fails to delete files after successful loading

« on: June 02, 2021, 08:02:42 AM »

This is an O/S issue, not a CMOD issue unfortunately.  It would be nicer to know the failure happened from the CMOD side, but the responsibility rests with whatever/whoever is modifying your rights on the windows side.

What method are you using to upload the files?

Also, send me an eMail if you'd like some help with this -- I have a utility that consolidates CMOD segment tables to optimize performance and repair these sorts of scenarios.

-JD.

168

Other / Re: Pipe delimited

« on: June 01, 2021, 01:03:14 PM »

CSV is a format that Excel recognizes natively.  What tool are they intending to use to read these files?

If they're concerned that some of the fields contain commas, you can fix this by quoting them:

Code: [Select]

Derrick,Justin,123-456-7890  # Three fields

Code: [Select]

"Derrick,Justin","123-456-7890" # Two fields
-JD.

169

MP Server / Re: db2 cleanup against system log

« on: May 28, 2021, 01:55:38 PM »

Well, logging absolutely everything is a best practise.

Why?

• It's way easier to diagnose problems when all the logs are at your disposal.
• Having lots of logs can help you determine when a problem started happening, and what changes happened around that time.
• Reporting is way more accurate when you have logs of everything that happens on the server.
• Detecting bad behaviour/breaches is possible when you have logs for everything.
• You may have legal/regulatory requirements to log everything.
• Being able to pass an audit is way easier when you can just give auditors access to the System Log.

... and probably many more that I can't think of. 

Most large sites that I've been at have almost as much database storage allocated to the System Log as they do the rest of their Application Groups.

170

MP Server / Re: db2 cleanup against system log

« on: May 27, 2021, 12:28:25 PM »

Nope, nope, nope...  Adjust your retention settings for the System Log, and use arsmaint. 

-JD.

171

MP Server / Re: Issues with load and unload for the same LOADID, at the same time.

« on: May 26, 2021, 03:38:28 PM »

Someone would have to have been WATCHING the load happening in order to have the load ID before it was written to the logs. 

Why would you even try to delete a file that was still in the process of loading?  You don't drive away from the gas station while the gas is still being pumped into your car! 

So, long story short, ask the customer to resend the file.  If the file can't be re-sent or re-created, then it is lost.

-JD.

172

MP Server / Re: Issues with load and unload for the same LOADID, at the same time.

« on: May 26, 2021, 01:00:34 PM »

I'm surprised that was permitted by IBM CM OnDemand's arsadmin unload command.

My guess would be that everything has been deleted, and the customer must re-send the file to CMOD's arsload utility.

-JD.

173

Other / Anyone loading data from Oracle ERP into CMOD?

« on: May 26, 2021, 11:18:40 AM »

Or alternately, does anyone have any experience with an Oracle ERP to IBM Content Manager OnDemand migration? 

-JD.

174

Announcements & News / ALERT: IBM Content Manager OnDemand - Possible resource data deletion

« on: May 25, 2021, 10:56:34 AM »

IBM sent an Alert notification about the potential for resource deletion:

"In some circumstances, storing a resource to one of the affected storage managers results in the deletion of other similarly named stored resources from the same application group."

Abstract

In some circumstances, storing a resource to one of the affected storage managers results in the deletion of other similarly named stored resources from the same application group.

Who is affected?

If you are using Amazon S3, IBM Cloud Object Storage, or Hitachi Content Platform with one of the affected versions and platforms of Content Manager OnDemand and you are storing documents which contain resources (such as AFP, PDF, or XML), you might be affected.

The following table applies to all Content Manager OnDemand platforms (AIX, Linux, Windows, zLinux, IBM i and z/OS):

Content Manager OnDemand server versions:

10.1.0.6 and earlier    not affected
10.1.0.7, 10.1.0.8    affected
   
10.5.0.0    not affected
10.5.0.1, 10.5.0.2    affected

This issue only affects the Content Manager OnDemand server (both library and object servers). The fix must be applied to both library and object servers if they are running on separate systems. This issue does not affect any of the Content Manager OnDemand clients (such as the OnDemand Windows client, Content Manager OnDemand Web Enablement Kit (ODWEK) APIs, REST Services, or CICS interface).

Link to the full article is below:  https://www.ibm.com/support/pages/node/6454823

There's a table on the wiki with direct links to the CMOD Interim Fixes:  https://cmod.wiki/index.php?title=Main_Page#IBM_CMOD_Fixpacks_.26_Security_Bulletins

175

MP Server / Re: arslog vs system trace for troubleshooting.

« on: May 24, 2021, 01:56:46 PM »

Yup, the only thing to remember is that when there's a huge flood of traffic (users) then you're going to hit a server-side I/O limit if you're trying to write everything into the same file.

-JD.

176

MP Server / Re: arslog vs system trace for troubleshooting.

« on: May 24, 2021, 12:18:24 PM »

So arslog is usually a shell script that contains some really basic things like detecting failed loads or other errors and either writing them to a file, or sending notifications.  There are only performance implications in the largest systems, when you start getting into things like deadlocks in the filesystem because there are too many writes to the same log file.

Your database errors look like you yanked DB2 out from under CMOD.  Make sure your shutdown scripts are doing things in the correct order, and are double-checking their results.  (Don't just ask CMOD to stop -- wait a few seconds, then see if it's actually down.)

-JD.

177

OD/WEK & JAVA API / Re: -206 sql errors in system log

« on: May 24, 2021, 12:13:44 PM »

If you're running some custom line-of-business app on top of this stacj, double check your code to make sure you're not mixing up a field name somewhere, otherwise, I suspect this is a bug somewhere inbetween CMIS / ICN / ODWEK.

You didn't mention versions, which is very important in a situation like this -- can you provide us with the versions of ICN / ODWEK / CMOD / DB2?

This will help us to help you! 

-JD.

178

Report Indexing / Re: Application group question

« on: May 17, 2021, 04:28:19 AM »

The identifier differentiates the Applications from each other in the Application Group definition.  It seems like you're using the field correctly, athough having an index for that field might not be really effective.

As for your date-related issues, I can think of a few ways to detect the issue (check the System Load App Group for disparities between the load date and the start/stop dates...) but the fix would be tricky unless you start digging around inside the database with SQL.  Even if you fixed the database values in the database, I'm not sure how it would affect the migration of data out of the cache and into secondary storage...  There's probably too many configuration variables for me to say for sure.

I have a morbid curiosity about how to fix this...    Please keep us posted on your progress!

-JD.

179

OD/WEK & JAVA API / Re: Use Arsadmin Hash for file validation

« on: May 05, 2021, 02:36:51 PM »

That only works if you already know the hash for the downloaded file.  You're probably better off using a built-in library to calculate the hash.

-JD.

180

General / Re: ARSSOCKD count climb & High CPU on AIX

« on: May 04, 2021, 12:53:54 PM »

For years now I have been experiencing occasional times on AIX where ARSSOCKD start climbing and won't come down along with high ARSSOCKD usage

What is it that's going up but not coming down?  Threads?  Processes?  CPU time?

Do you have any more diagnostic info you can share?

-JD.