Author Topic: Find Total compressed Doc size stored in an app group  (Read 3075 times)

ronankivr

  • Guest
Find Total compressed Doc size stored in an app group
« on: January 17, 2017, 02:28:13 PM »
Hi All,

Is there any way we can find Total compressed data size stored in an app group. I know we can parse output size in  system log entries and calculate the size programmatically but I guess this output size includes the size of indexes stored in a database. I would like to match total centera utilization by calculating compressed size used by each app group.

I can see DOC_OFF,DOC_LEN and COMP_OFF and COMP_LEN fields in AG table but I am not sure whether they reflects compression size in centera on not.




Thank you!

Justin Derrick

  • IBM Content Manager OnDemand Consultant
  • Administrator
  • Hero Member
  • *****
  • Posts: 2230
  • CMOD Guru for hire...
    • View Profile
    • Tenacious Consulting
Re: Find Total compressed Doc size stored in an app group
« Reply #1 on: January 17, 2017, 05:07:23 PM »
Using the database to calculate storage utilization is difficult, especially if you have any Applications with Large Object Support turned on.

I've got capacity planning tools for CMOD -- send me a PM for more info if you're interested...

-JD.
IBM CMOD Professional Services: http://TenaciousConsulting.com
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Education & Webinars:  https://CMOD.Training/

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR

Alessandro Perucchi

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1002
    • View Profile
Re: Find Total compressed Doc size stored in an app group
« Reply #2 on: January 23, 2017, 09:11:38 AM »
Well that's not easy to do, because there are many combination possible. And per load, you could also have different settings for an AG.

But basically, you need to use the following idea for compressed files:

per DOC_NAME, you get the max(comp_off) and to this value add the associated COMP_LEN.

Example:

DOC_NAME: 1FAAA
MAX(COMP_OFF): 21892981
associated COMP_LEN to MAX(COMP_OFF): 29129

Size of 1FAAA in the cache AND in Centera:  21892981 + 29129 = 21922110 bytes

And you do that for every DOC_NAME in your AG, and you got the size you want.

If the files are not compressed, normally, take for your doc_name, the max(doc_off) and add the corresponding doc_len, and you have for that object the size in cache and in Centera.

To know if your doc_name is compressed or not, you need to look at the field comp_type, if I remember correctly, if the value is "N" (none) "D" (disable), then the content is not compressed, otherwise it is compressed.

I let you figure out how to do it in SQL, shell, java, etc... But you have the logic here.

Regards,
Alessandro
Alessandro Perucchi

#Install #Migrations #Conversion #Educate #Repair #Upgrade #Migrate #Enhance #Optimize #AIX #Linux #Multiplatforms #DB2 #Windows #Oracle #TSM #Tivoli #Performance #Audits #Customizing #Availability #HA #DR #JavaApi #ContentNavigator #ICN #WEBi #ODWEK #Services #PDF #AFP #XML

Justin Derrick

  • IBM Content Manager OnDemand Consultant
  • Administrator
  • Hero Member
  • *****
  • Posts: 2230
  • CMOD Guru for hire...
    • View Profile
    • Tenacious Consulting
Re: Find Total compressed Doc size stored in an app group
« Reply #3 on: January 23, 2017, 07:37:58 PM »
Alessandro's on the right track, but there's data missing from the database that will throw your counts off -- resources, metadata, and backups or cached copies.

I've got tools that take all of this into consideration, but they're not free.  ;)  Contact me via a direct message or call/eMail with the contact info below.

-JD.
IBM CMOD Professional Services: http://TenaciousConsulting.com
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Education & Webinars:  https://CMOD.Training/

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR

ronankivr

  • Guest
Re: Find Total compressed Doc size stored in an app group
« Reply #4 on: January 27, 2017, 12:31:14 PM »
Thank You Alessandro.. This is very helpful..

ronankivr

  • Guest
Re: Find Total compressed Doc size stored in an app group
« Reply #5 on: January 27, 2017, 12:45:30 PM »
Thank Junstin for your inputs. Sure we definitely reach you in case our budget allows  ;) . For now ,I would like to build a custom tool to identify totals as per Alessandro  suggestion. As you said there will be some differences but I am trying to match approximate counts.