Author Topic: Maximum number of rows per database table.  (Read 4997 times)

pankaj.puranik

  • Sr. Member
  • ****
  • Posts: 374
    • View Profile
Maximum number of rows per database table.
« on: August 21, 2012, 03:05:11 AM »
I came across this little write up in one of IBM case studies. This might be helpful in deciding the maximum number of rows per database table.

The maximum rows value, which determines how many data rows will be
loaded into each database table, is used for segmenting the index data and
deciding when to close a database table and open a new one. The default
Chapter 2. IBM Content Manager OnDemand for Multiplatforms implementation guidelines 33
value of 10,000,000 rows is recommended for balancing the performance of
data loads and queries. However, if the expiration type is segment, use a
maximum rows value such that the data will expire (the table will be deleted)
in a reasonable amount of time. For example, if you load 1 million rows to an
application group in one year, and the data is to be retained for seven years,
the default value of 10 million rows in a data table is too large. The table will
not fill up until the tenth year, and the table will not be deleted until all data in
the table is seven years old, which means the table will exist for 17 years.
When a wildcard search is specified and no index field is used (or segment
date), a full table scan takes place. If the table contained 10 million rows, a
wildcard search would be looking at nine million rows of ?expired? data in the
17th year. A good rule of thumb is that no table should hold more than 10% of
the data that would be loaded during the lifetime of that data when expire by
segment is specified (and thus the lifetime of a table is 110% of that of the
data). 10% of seven years (84 months) is 8.4 months, you can round up to
nine months. Nine months of data would be 750,000 rows, so maximum rows
per table would be 750,000.

Justin Derrick

  • IBM Content Manager OnDemand Consultant
  • Administrator
  • Hero Member
  • *****
  • Posts: 2231
  • CMOD Guru for hire...
    • View Profile
    • Tenacious Consulting
Re: Maximum number of rows per database table.
« Reply #1 on: August 21, 2012, 09:34:02 AM »
I always recommend that a table contains as many documents as are loaded within a month (10%-20% for growth), as long as that number is over 10 million rows.  I've recommended individual table sizes up to 150 million rows per table.  Conversations I've had with DB2 developers imply that this number could be much, much higher, but there are other issues that must be considered (backup and restore windows) before attempting it.

If you're in the position of loading millions of documents per month, segment expiration type is the recommended option, unless you're using things like Enhanced Retention Management or CFS.
IBM CMOD Professional Services: http://TenaciousConsulting.com
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Education & Webinars:  https://CMOD.Training/

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR