OnDemand User Group
Support Forums => MP Server => Topic started by: fnb4321 on September 09, 2020, 06:51:16 AM
-
We are going to be receiving some large PPD files to load into OnDemand (version 10.1.0.5)
What is the max file size that could be ingested into CMOD ? I think I read somewhere that it was 50MB but want to confirm.
-
If these are things like customer statements or letters, you should aim to have each individual document be less than 50MB, just for performance reasons.
The 50MB limit is more of a warning than an error, simply because retrieving tens or hundreds of megabytes is a slow process, even today.
I think the limitation of a a single PDF is 2GB (although I suspect newer versions have increased that limitation).
One of the Unicom / IBM folks should probably chime in here and give us the official answer though. :)
-JD.
-
Thanks Justin.
These will be concatenated PPD files with 1099 statements.
So - guess what I need to know is max recommended size of a concatenated file
-
I'd stick with 2GB. And tax forms are usually quite small, so that should hold several thousand forms each.
-JD.
-
I don't have an official answer because I'll admit I don't completely understand what the interplay of resource collection and whether the PDFs use the standard fonts may have.
Is this on z/OS, will this be loading to OAM?
You may run into the OAM MOS (Maximum Object Size) limit which takes an IPL to increase.
Will you be indexing on zLinux?
Ed
-
This is Linux environment and will be PPD files.
-
This is Linux environment and will be PPD files.
Linux on z? There is at least one difference between Linux on z and Linux on other platforms.
Ed
-
Linux Red Hat
-
PPD stands for PostScript Print Definition file.. I have not processed this type of a file so far in CMOD, and that's why, I looked it up from the internet. I am not clear what the data looks like.... AFP or XML like tagged text... or something else. A lot depends on the data and meta indexes for what you can and cannot do.
Question: Is the file going to be stored and retrieved as a single document?
If yes, you are probably out of luck and you will probably hit the 2 GB maximum document limit of CMOD.
If no, assuming that the file contains smaller units of data (documents) delimited by some tags or meta indexes that will allow you to easily index them, and you may be in luck. As long as none of the individually delimited documents in the file exceeds 2 GB, you should be OK. I have processed files larger than 15 GB successfully and because the documents in the file were less than 2 GB, CMOD processing went fine.
-
PPD in this case means Page Piece Dictionary, a way of indexing PDFs in CMOD.
Check out Bud Paton's amazing presentation: http://www.odusergroup.org/forums/index.php?topic=1724.0 (For non-registered visitors or ODUG, you need to register to get access to our webinar replays.)
-JD.