Topics

1

MP Server / Horizontal Scalability - Library server

« on: October 03, 2016, 10:13:45 PM »

Hi

The IBM documentation says the following about Horizontal Scalability.
I did not really understand how this would work practically in terms of ingestion and retrieval.

"Even though Content Manager OnDemand allows a single library server for each instance,
this library server can be scaled horizontally. The library server is scaled horizontally by using
one or both of the following methods:
 The database tables (both the system and the application group) can be placed in different
databases (z/OS) or different table spaces (Multiplatforms and z/OS) at the table level.
Therefore, each of these tables can scale to the maximum practical size that is supported
by the database within the operational constraints of maintenance and performance.
Content Manager OnDemand does not impose a limitation.
 The application group data table design facilitates the following actions:
– You can create as many application groups as you need to support the required data to
be archived.
– Each application group can be segmented into multiple tables where the table
segmentation is based on size.
– Each of these application group data tables can be placed in a separate database
(z/OS) or table space (Multiplatforms and z/OS)."


Thanks
Pankaj.

2

MP Server / TSM Vs HDFS

« on: May 31, 2016, 12:11:37 AM »

Hi

Has anyone done a study on the advantages of using HDFS over TSM.
In what situations HDFS is better over TSM?
There are not many papers on the internet that talks about using HDFS with CMOD and what advantages does it pose over TSM with SAN/NAS storage.

Thanks
Pankaj.

3

MP Server / Storing dates earlier than 1st Jan 1970

« on: April 12, 2016, 06:15:40 AM »

Hi

I came across this requirement where the user want to store Date of Birth in CMOD.
Obviously there would be many date that would be older than 1st Jan 1970.
The only option I can think of is to store it as a string and not date.

Any thoughts?

Thanks
Pankaj.

4

MP Server / ARSMAINT on system log

« on: March 14, 2016, 06:26:12 AM »

Hi

I tried to expire the System Log using the following command.

/opt/ibm/ondemand/V9.0/bin/arsmaint -I xxxxxxx -u xxxxx -p xxxxx -n 10 -x 10 -t 2027-12-31 -g "System Log" -d

However after running for some time and completing, when I check the space utilization on the file system, it is unchanged.
Meaning that no expiration happened.
Also the number of rows on the System Log remained unchanged.

Note that I am running the expiration processing using a future date.
Any reason why the space is not clearing.

The retention period on the System Log App Group is 7 years.

Thanks
Pankaj.

5

OD/WEK & JAVA API / Online archival using ODWEK service.

« on: February 25, 2016, 11:44:08 PM »

Hi

I have an application group that has a date field which is mandatory field.
Now if a batch ingestion is done without passing a date, CMOD throws an error.
Whereas if I try to upload the same document using the ODWEK API and do not pass a date, no errors are thrown and the document ingests successfully.
This is a strange scenario.
Is anyone aware of this issue or faced it earlier?

Thanks
Pankaj.

6

MP Server / Trace Logs

« on: February 19, 2016, 01:33:02 AM »

Hi

After having a few server crashes in our SIT environment, I switched on the trace logging by setting the value to the highest levet (INFO, FLOW, WARNING, ERROR, etc). The server did crash again. But on looking into the trace log (after converting it into readable format), I did not see any ERROR information. All I saw was INFO and FLOW messages.

Does anyone have any suggestions to find out what caused the server to Crash?
Note that the System Log also didn't give much information.

Thanks
Pankaj.

7

MP Server / ARS2164I

« on: January 11, 2016, 02:55:02 AM »

I got this message while creating a user on CMOD.
I do not see anything wrong with the file system.

Not sure if anyone else has seen this message?

"The operation could not be completed because required data resides on unavailable archive media. Contact your system administrator to make the data available."

8

MP Server / CMOD not starting

« on: November 12, 2015, 04:47:47 AM »

Tried restarting the cmod server but I see the below since a long time.

xxxx@xxxx>ps -ef | grep arssockd
xxxx 29452     1  0 11:34 pts/3    00:00:00 arssockd-DB2UT005: initializing
xxxx 29680 31149  0 11:39 pts/3    00:00:00 grep arssockd



Here is the dbfs usage.

/dev/mapper/root_vg-db2data1
                       15481840  14678992     16480 100% /apps/IBM/db2/xxxx/data1
/dev/mapper/root_vg-db2data2
                       10321208   8807484    989436  90% /apps/IBM/db2/xxxx/data2
/dev/mapper/root_vg-db2data3
                       10321208   6510916   3286004  67% /apps/IBM/db2/xxxx/data3

Any suggestions?

9

MP Server / Migrate the System log to another system like Terradata.

« on: October 20, 2015, 12:09:26 AM »

We have this requirement to move the System logs to Terradata.
The reason this is being done is because these logs are consuming a lot of space and we do not have the option of moving them to TSM.

So we need to migrate the metadata and documents (message 87 stores a document with the load log).
Any pointers on how we should do the extraction of metadata and documents and then correspondingly link them.

10

MP Server / Issue with search.

« on: September 23, 2015, 11:51:48 PM »

I have this strange situation.
I have 2 pair of Application Group and Application.
Both the pairs are exactly same except for their names and retention periods.

The two application groups are mapped to the same folder.
The Folder to AG mapping is also the same for both application groups.

I then loaded the same document with same dates but with different account numbers.
Note that this is online upload using ODWEK.

When I do individual  search by account number (say account 123 and 456), I get the results from both the AGs in subsequent queries.
When I use the Account number and Date combination (say account 123 and date 20150924) I get the expected result.
When I use the Account number and Date combination (say account 456 and date 20150924) I get no results.
A search by just account number = 456, returns the result. On analyzing the result, I do see the date column populated with 20150924.

I am not able to understand the reason for no results when I use the Account number and date combination for AG1 while the same search combination returns results from AG2!!

Thanks
Pankaj.

11

MP Server / Multiple Technology Systems

« on: September 15, 2015, 04:25:25 AM »

Here is an excerpt from the IBM documentation about scaling a CMOD system.

1. Single technology systems: The Content Manager OnDemand instance
consists of systems that are of the same architecture. For example, all
systems might be AIX systems.

2. Multiple technology systems: The Content Manager OnDemand instance
might consist of systems of different architectures. For example, the library
server and an object server might be on a z/OS system, two other object
servers might be on AIX systems, and another object server might be on a
Windows system.

Specific to 'Multiple Technology systems', I was unable to find any compatibility matrix that would tell me what combination of technology systems can I use. For example, can I use a Linux Library server with an i series Object server.
Do anyone have any pointers?

Cheers
Pankaj.

12

MP Server / Retrieving an AFP that was loaded with RESTYPE=NONE

« on: September 02, 2015, 10:39:45 PM »

Hi

I received an AFP file from the composition team.
This AFP does not have embedded resources in it.
The composition team also provided a resource file separately that will be common across all AFPs.

I could load the AFP with RESTYPE=NONE option.
I am not sure how to configure CMOD to use the resource file provided so that it can be used during retrieval and further for conversion into AFP.

Any suggestions?

Thanks
Pankaj.

13

MP Server / Options to delete documents set to 'Never Expire'

« on: June 16, 2015, 10:03:54 PM »

I have a situation where the Bank is moving out of business in certain geographies.
Now after certain years all the documents that belong to a particular geography has to be purged.
The Storage policy is set to 'Never Expire'.
The simplest option is to just drop the Application Group.

But someone in the bank should remember to delete on a future date.

The other option is to migrate the data to a new application group which has a expiration policy set to a future date.
When the expiration processing runs automatically on the future date, all the documents would be purged.


What other options do I have to delete the documents?

Cheers
Pankaj.

14

MP Server / Weird but true

« on: April 16, 2015, 03:42:01 AM »

Got thie weird message in CMOD.
The file loaded successfully with message code 87.
But the number of rows loaded into the database was 0.

The AFP TLEs look good. Any insights?

ARS1609W Specifying passwords on the command line is insecure due to the text being visible. See                                                             or information about the arsstash command or using Unified Login.
ARS4315I Processing file >DM34152_TEST_16_TLE.AFP<
ARS4334I Load Version <9.0.0.3>  Operating System <Linux> <#1 SMP Fri Apr 11 17:27:00 EDT 2014.2.                                                            ation </opt/ibm/ondemand/V9.0/>
ARS4335I Server Version <9.0.0.3>  Operating System <Linux> <#1 SMP Fri Apr 11 17:27:00 EDT 2014.
ARS4302I 04/16/15 05:52:01 -- Indexing started, 43070112 bytes to process
APK415I CC=YES
APK415I CCTYPE=A
APK415I CONVERT=YES
APK415I CPGID=500
APK415I IMAGEOUT=ASIS
APK415I RESTYPE=ALL
APK415I EXTENSIONS=RESORDER
APK415I INDEXOBJ=ALL
APK415I inputdd=/apps/IBM/cmod-poc/gb/MCA_LETTERS_OB82367_A001/download/afp/DM34
APK415I outputdd=./DM34152_TEST_16_TLE.AFP.out
APK415I indexdd=./DM34152_TEST_16_TLE.AFP.ind
APK415I resobjdd=./DM34152_TEST_16_TLE.AFP.res
APK440I ACIF AT IM43P11 HAS COMPLETED NORMALLY WITH RETURN CODE 0.
ARS4308I 04/16/15 05:52:07 Indexing completed
ARS4312I 04/16/15 05:52:07 -- Loading started, 435562 bytes to process
ARS1142I Resource ./DM34152_TEST_16_TLE.AFP.res will be added as resource >3-1-0
ARS1146I Loaded 0 rows into the database
ARS1175I Document compression type used - OD77Lite.  Bytes Stored = >207< Rows =
ARS4310I 04/16/15 05:52:10 Loading completed
ARS4317I Processing successful for file >DM34152_TEST_16_TLE.AFP<

15

MP Server / Expiration Type - Segment

« on: April 15, 2015, 01:29:42 AM »

Could anyone list a use case where one would prefer to use expiration type as segment as opposed to load?

Cheers
Pankaj.