Successful load message contents explanation required

[sandeepveldi]

Based on some data expiration and other issues, we are planning for an automated growth monitor. I?ve some questions regarding the successful load message in system log. It's an AIX environment with CMOD 8.4.1.3, DB2 9.5.4 & TSM 5.4

1)      Can you please explain what exactly do the highlighted areas (in red) mean? I?m getting confused because totals don?t match when I sum up.

2)      Can we get the DB2 space utilized for this load out of System log message? If not, is there a way to get it?

Here is the entry in System log for a sample successful load

03/03/10 13:13:18 ADMIN     7434294 Info  Yes       87      Application Group Load: Name(TS2Statements) LoadId(1136-8-0-20522FAA-14671-14671) File(/storage/COLD_hold/fdr.stmtafp_od.cyc.02.032010.13.load) InputSize(1621104995) OutputSize(332082427) Rows(50000) Time(386.7570) Appl(TS2Statements)         

Details inside this log entry:

arsload: Processing file >/storage/COLD_hold/fdr.stmtafp_od.cyc.02.032010.13.load<
arsload: 03/03/10 13:06:51 -- Indexing started, 1541225298 bytes to process
0425-415 cc=yes
0425-415 cctype=a
0425-415 cpgid=500
0425-415 convert=yes
0425-415 trc=no
0425-415 dcfpagenames=yes
0425-415 fileformat=record
0425-415 imageout=asis
0425-415 indexobj=all
0425-415 indexstartby=1
0425-415 formdef=F1ONDMD1
0425-415 pagedef=P1V06483
0425-415 mcf2ref=cf
0425-415 userlib=/usr/lpp/ars/resources:/prod/home01/appl/print/psf_resources/exceptions:/prod/home01/appl/print/resources/fdr_resources
0425-415 reslib=/usr/lpp/ars/resources
0425-415 fontlib=/usr/lpp/psf/fontlib
0425-415 pdeflib=/usr/lpp/ars/resources
0425-415 fdeflib=/usr/lpp/ars/resources
0425-415 restype=all
0425-415 inputdd=/storage/COLD_hold/fdr.stmtafp_od.cyc.02.032010.13.load
0425-415 outputdd=/arsacif/acif2/fdr.stmtafp_od.cyc.02.032010.13.load.out
0425-415 indexdd=/arsacif/acif2/fdr.stmtafp_od.cyc.02.032010.13.load.ind
0425-415 resobjdd=/arsacif/acif2/fdr.stmtafp_od.cyc.02.032010.13.load.res
0425-440 ACIF AT PK91927 HAS COMPLETED NORMALLY WITH RETURN CODE 0.
arsload: 03/03/10 13:10:32 Indexing completed
arsload: 03/03/10 13:10:32 -- Loading started, 1619006975 bytes to process
Resource /arsacif/acif2/fdr.stmtafp_od.cyc.02.032010.13.load.res will be added as resource >19668-8-0<.  Compression Type(OD77) Original Size(13870377) Compressed Size(3744874)
OnDemand Load Id = >1136-8-0-20522FAA-14671-14671<
Loaded 50000 rows into the database
Document compression type used - OD77.  Bytes Stored = >332082427< Rows = >50000<
arsload: 03/03/10 13:13:18 Loading completed
arsload: Processing successful for file >/storage/COLD_hold/fdr.stmtafp_od.cyc.02.032010.13.load<


Thanks in advance for your help on this!

Regards,
Sandeep Veldi 

[Alessandro Perucchi]

Hello Sandeep,

Well, I'm a little bit confused myself with these numbers!

It would have been nice to have also the size of the file before doing the archive!

But one thing is clear im System Log you have the following information:

-> OutputSize(332082427)

Which the same in the arsload entry:

-> Document compression type used - OD77.  Bytes Stored = >332082427< Rows = >50000<

And this is the size which will be stored in TSM (On the object server)
The other thing I suppose is that in the System Log -> InputSize(1621104995)  is the real size of your sample file.


Then, in ARSLOAD you have the following line:

Resource /arsacif/acif2/fdr.stmtafp_od.cyc.02.032010.13.load.res will be added as resource >19668-8-0<.  Compression Type(OD77) Original Size(13870377) Compressed Size(3744874)

So here we have the resources, because CMOD removes the resources of AFP in order to save space in the object server.
It means, we have resource with a size of 13870377 bytes, and after compression you have a resource with the size of 3744874.
The resources will be saved in TSM somewhere (somebody correct me if I'm wrong, I'm a newby with resources!!)



But I don't know for the other numbers how they are calculated:

arsload: 03/03/10 13:06:51 -- Indexing started, 1541225298 bytes to process

------>Maybe data without header, resources, ...

arsload: 03/03/10 13:10:32 -- Loading started,  1619006975 bytes to process

-------> No idea at all....

Maybe somebody else could help here.

Cheers,
Alessandro

[Justin Derrick]

I'm not exactly sure why there's a disparity between the input size in the System Log and the ACIF output.  This might need someone with visibility to the CMOD source code in order to explain it.

To answer your question about database growth...  There are some guidelines in the IBM Planning Guide for CMOD about how to calculate the size of databases, but essentially, because database rows for a particular Application Group are all the same size, growth is linear.  Calculating bytes used is a headache, but counting the number of rows is easy, and an accurate relative representation of growth.

-JD.

[sandeepveldi]

Alessandro & JD,
Thanks for your response on this. Attached is the additional details that i got from IBM through a PMR.