OnDemand User Group

Support Forums => MP Server => Topic started by: ronankivr on January 17, 2017, 02:28:13 PM

Title: Find Total compressed Doc size stored in an app group
Post by: ronankivr on January 17, 2017, 02:28:13 PM
Hi All,

Is there any way we can find Total compressed data size stored in an app group. I know we can parse output size in  system log entries and calculate the size programmatically but I guess this output size includes the size of indexes stored in a database. I would like to match total centera utilization by calculating compressed size used by each app group.

I can see DOC_OFF,DOC_LEN and COMP_OFF and COMP_LEN fields in AG table but I am not sure whether they reflects compression size in centera on not.




Thank you!
Title: Re: Find Total compressed Doc size stored in an app group
Post by: Justin Derrick on January 17, 2017, 05:07:23 PM
Using the database to calculate storage utilization is difficult, especially if you have any Applications with Large Object Support turned on.

I've got capacity planning tools for CMOD -- send me a PM for more info if you're interested...

-JD.
Title: Re: Find Total compressed Doc size stored in an app group
Post by: Alessandro Perucchi on January 23, 2017, 09:11:38 AM
Well that's not easy to do, because there are many combination possible. And per load, you could also have different settings for an AG.

But basically, you need to use the following idea for compressed files:

per DOC_NAME, you get the max(comp_off) and to this value add the associated COMP_LEN.

Example:

DOC_NAME: 1FAAA
MAX(COMP_OFF): 21892981
associated COMP_LEN to MAX(COMP_OFF): 29129

Size of 1FAAA in the cache AND in Centera:  21892981 + 29129 = 21922110 bytes

And you do that for every DOC_NAME in your AG, and you got the size you want.

If the files are not compressed, normally, take for your doc_name, the max(doc_off) and add the corresponding doc_len, and you have for that object the size in cache and in Centera.

To know if your doc_name is compressed or not, you need to look at the field comp_type, if I remember correctly, if the value is "N" (none) "D" (disable), then the content is not compressed, otherwise it is compressed.

I let you figure out how to do it in SQL, shell, java, etc... But you have the logic here.

Regards,
Alessandro
Title: Re: Find Total compressed Doc size stored in an app group
Post by: Justin Derrick on January 23, 2017, 07:37:58 PM
Alessandro's on the right track, but there's data missing from the database that will throw your counts off -- resources, metadata, and backups or cached copies.

I've got tools that take all of this into consideration, but they're not free.  ;)  Contact me via a direct message or call/eMail with the contact info below.

-JD.
Title: Re: Find Total compressed Doc size stored in an app group
Post by: ronankivr on January 27, 2017, 12:31:14 PM
Thank You Alessandro.. This is very helpful..
Title: Re: Find Total compressed Doc size stored in an app group
Post by: ronankivr on January 27, 2017, 12:45:30 PM
Thank Junstin for your inputs. Sure we definitely reach you in case our budget allows  ;) . For now ,I would like to build a custom tool to identify totals as per Alessandro  suggestion. As you said there will be some differences but I am trying to match approximate counts.