An example of a file too big to load

[Ed_Arnold]

Suppose you see message ARS0141E

ARS0141E Ran out of load-id naming conventions. Increase the size of the Application Group Object Size.

Content Manager OnDemand has an architectural limit of 702 load-ids per load.

By increasing the size of the Application Group Object, we will use fewer load-ids.

The maximum Application Group Object Size is 99999K.  This is set via the admin client -> Application Group -> Storage Management -> Advanced.

Suppose he have an input file that is 249255956599 bytes (249,255,956,599) or almost 250 gigabytes in size.

The input file divided by the object size must be less than or equal to 702.                                                                     
                                                                         
249255956599 / 99999 = 2492584.49                                         
                                                                         
2492584.49 / 1000 (because 99999 is in K) = 2492.58                       
                                                                         
2,492 > 702, the maximum limit for load-ids                                           
                                                                         
So the input file is just too big and must be split into smaller chunks to be ingested.

Ed

[nikeshpj]

Hi Ed,
I have also done some testing with the maximum file size.

It also depends on number of documents in one report file and it's compression rate.
If one document creates more than 26 objects(whatever the object size be), then also CMOD issues this message.
Please give a try - Create a very big report file containing just 1 document - Set the Object size to 10,000K. The load would fail with the same error message from CMOD.
Considering 90% compression.
With a 10,000K object size we can store only upto 2.4GB report file.




/Nikesh PJ

[Justin Derrick]

FYI, on multiplatforms, the number of object names is 676.

Here’s an article on the wiki that discusses ARS0141E:  https://cmod.wiki/index.php?title=ARS0141E

-JD.