What is the best storage method for large quantities of documents 2,5 M per day

[krcd]

Hello everyone, any idea to build a storage solution that allows to manage in the best way large quantities of daily loads.
According to my calculations, will be stored 2.5 million documents daily, I need to know a good method to manage the disks, as well as a backup recommendation.

The first cache file system contains special directories used by Content Manager OnDemand to locate objects from all cache file systems, is it possible to create more than one arscache that fulfills the function of the primary?

Note: SO AIX 7.1,  OD 9.5, DB2 10.5.

[jsquizz]

Doesnt sound like your requirement is anything too out of the ordinary. I would run some metrics using the system log to see how much space you use. Export the 87 records into excel, and then come up with your daily use, then take a baseline. Times that by 30 for a month.

A common process I guess you could say would be to keep your documents in cache for X days, 10,15,30,60, etc.. For commonly used application groups for performance reasons. Then, after that threshold has been met..Use ARSMAINT to migrate that into TSM, which should be backed up nightly. Several installs I have worked on have had that kind of backup policy.

Also take into consideration your document types and compression when figuring out how much space you use. I am not sure what you are trying to accomplish here--Could you elaborate?

The first cache file system contains special directories used by Content Manager OnDemand to locate objects from all cache file systems, is it possible to create more than one arscache that fulfills the function of the primary?

[Justin Derrick]

You can create multiple cache filesystems, and use them IBM CMOD by updating arscache.cfg.  However, you can never remove the first filesystem.

If you were to upgrade to v10.1, you would be able to use filesystem storage as well.

-JD.

[Michel de Kraker]

Doesnt sound like your requirement is anything too out of the ordinary. I would run some metrics using the system log to see how much space you use. Export the 87 records into excel, and then come up with your daily use, then take a baseline. Times that by 30 for a month.

A common process I guess you could say would be to keep your documents in cache for X days, 10,15,30,60, etc.. For commonly used application groups for performance reasons. Then, after that threshold has been met..Use ARSMAINT to migrate that into TSM, which should be backed up nightly. Several installs I have worked on have had that kind of backup policy.

Also take into consideration your document types and compression when figuring out how much space you use. I am not sure what you are trying to accomplish here--Could you elaborate?

The first cache file system contains special directories used by Content Manager OnDemand to locate objects from all cache file systems, is it possible to create more than one arscache that fulfills the function of the primary?

Hi jsquizz,
You say:
Use ARSMAINT to migrate that into TSM, which should be backed up nightly.

With backup , you mean copy primary pool to copypool or do you mean backup primary with backup software outside TSM? for instance Networker?

regards

michel.

[Justin Derrick]

I'm fairly certain he means the 'backup storagepool' command in TSM.

TSM is an enterprise backup tool -- I can't imagine a world where one would back up one enterprise backup tool with another enterprise backup tool.  What would the restore process look like?!?!? 

[Michel de Kraker]

I'm fairly certain he means the 'backup storagepool' command in TSM.

TSM is an enterprise backup tool -- I can't imagine a world where one would back up one enterprise backup tool with another enterprise backup tool.  What would the restore process look like?!?!? 

I partially agree with you on this. Back 10 years ago , CMOD was sold by IBM as a blackbox. Onetime setup. This product was also placed at customers with no TSM at all. They are using Legato Networker for instance.

I absolutely agree with you that backup of the primary stgpool should by done by TSM , but i think the customers with no TSM knowledge at all would prefer other options . But with these options backup stgpool is no option....

regards,

michel.