Author Topic: 8.3 to 8.4 migration  (Read 8454 times)

wwwalton

  • Guest
8.3 to 8.4 migration
« on: April 05, 2010, 07:50:56 AM »
Any war stories, gotchas, tips for migrating in place from a 8.3 fp4 system to 8.4 OD for MP?
-walt

Justin Derrick

  • IBM Content Manager OnDemand Consultant
  • Administrator
  • Hero Member
  • *****
  • Posts: 2231
  • CMOD Guru for hire...
    • View Profile
    • Tenacious Consulting
Re: 8.3 to 8.4 migration
« Reply #1 on: April 06, 2010, 06:25:41 AM »
Just finished a similar upgrade in March.

In 7.1.2.9 (aka 8.3) there was a change to ACIF that means some of your loads (specifically AFP docs with coverpages) will fail.  Add 'IndexStartBy=2' to your indexer parameters.  If you're migrating from an earlier version (7.1.2.0 - 7.1.2.8) you'll want to keep an eye out for this one.

Also, my customer was bitten by a bug (being unable to query the system log before the date of the upgrade) that was supposed to have been fixed in 8.4.1.4.  When we implemented the fix, the problem remained.  They're currently working with IBM for a solution.

-JD.
IBM CMOD Professional Services: http://TenaciousConsulting.com
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Education & Webinars:  https://CMOD.Training/

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR

Alessandro Perucchi

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1002
    • View Profile
Re: 8.3 to 8.4 migration
« Reply #2 on: April 07, 2010, 12:15:50 AM »
Hello,

So far no bugs encountered... I'm still crossing my fingers not to find one :-)

Cheers,
Alessandro
Alessandro Perucchi

#Install #Migrations #Conversion #Educate #Repair #Upgrade #Migrate #Enhance #Optimize #AIX #Linux #Multiplatforms #DB2 #Windows #Oracle #TSM #Tivoli #Performance #Audits #Customizing #Availability #HA #DR #JavaApi #ContentNavigator #ICN #WEBi #ODWEK #Services #PDF #AFP #XML

nijagunakote

  • Guest
Re: 8.3 to 8.4 migration
« Reply #3 on: July 29, 2010, 11:20:56 AM »
My company wants to migrate index+metadata from 8.3 to 8.4 hosted on different AIX mechines.
are there any documents? manuals to refer?

Thanks for your help.

Alessandro Perucchi

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1002
    • View Profile
Re: 8.3 to 8.4 migration
« Reply #4 on: July 30, 2010, 04:23:21 AM »
My company wants to migrate index+metadata from 8.3 to 8.4 hosted on different AIX mechines.
are there any documents? manuals to refer?

Thanks for your help.

Hello,

If I understand correctly, you have an OnDemand server in a server A, and you want to move it to server B.
Server A is installed with OnDemand 8.3, and the goal is to have server B with 8.4.

Is this what you want?

If yes, then it is quite easy:

- Backup the Library Database on server A
- Backup the cache FS from server A
- Restore Library on server B
- Restore cache FS on server B
- Check that the TSM configuration (if using TSM) is correct, that all ports are OK
- Check that the ars.ini on server B, and all the config files (ars.cfg, ars.cache and ars.dbfs) are correctly setup for server B.
- Run the Upgrade method as describe in this documentation (ex: 8.4.1.5 : ftp://service.software.ibm.com/software/ondemand/fixes/v841/8.4.1.5/readme.txt )
- Start CMOD, and check that everything is running as expected. If not, go back to check the config files, permissions, etc...

At this point, you have 2 Libraries server pointing to the same TSM (if you are using TSM, if cache only, you can discard this part!).
Meaning if you remove a document in server B, the the document won't be accessible in server A anymore, and vice-versa.
If you add a document in server A, it won't be visible in server B and vice-versa.
So, my advice. Don't do any modification until you are sure server B is working as expected. then shut-down server A.

Is that what you want?

I am not sure there are some documentation specifically for that, but that should help you to see what are the basic steps involved.

Cheers.
Alessandro
Alessandro Perucchi

#Install #Migrations #Conversion #Educate #Repair #Upgrade #Migrate #Enhance #Optimize #AIX #Linux #Multiplatforms #DB2 #Windows #Oracle #TSM #Tivoli #Performance #Audits #Customizing #Availability #HA #DR #JavaApi #ContentNavigator #ICN #WEBi #ODWEK #Services #PDF #AFP #XML

nijagunakote

  • Guest
Re: 8.3 to 8.4 migration
« Reply #5 on: July 30, 2010, 07:14:45 AM »
Thank you Alessandro,
Yes, most of what you said is correct.

But the problem is, we have to export partial data to anather CMOD server. Lets say we have 10 million documents and we have to export and ship only 4 million documents.

When I was reading some documentaion, there were two options.
1. Migrate index+ metadata
2. Migrate only metadata.

in our case we want to go with 1st option. also, in the documentation it is mentioned that we have to install migration routines.
http://publib.boulder.ibm.com/infocenter/cmod/v8r4m0/index.jsp?topic=/com.ibm.ondemand.390.doc/ars3g27147.htm

even though we are not migrating from 2.1 to 8.4, I was going thrugh this to understand what is involved.

Do you have any idea on how we can export partial list of documents from one CMOD to other?

Justin Derrick

  • IBM Content Manager OnDemand Consultant
  • Administrator
  • Hero Member
  • *****
  • Posts: 2231
  • CMOD Guru for hire...
    • View Profile
    • Tenacious Consulting
Re: 8.3 to 8.4 migration
« Reply #6 on: July 30, 2010, 09:29:38 AM »
Hi Nijaguna.

It depends almost exclusively what the selection criteria for the documents to be exported are.  If you are selecting by date, it should be very easy.  If it's particular customer numbers, that's difficult.  It will be extremely difficult if the criteria (say, location by zip code) is not stored in the indexes.  Also, are you expected to delete the exported data from your own system afterwards?

You mention the IBM OS390 documentation -- are you on iSeries?  Your post is in the Multiplatforms forum, and the two platforms are very, very different.

-JD.
IBM CMOD Professional Services: http://TenaciousConsulting.com
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Education & Webinars:  https://CMOD.Training/

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR

nijagunakote

  • Guest
Re: 8.3 to 8.4 migration
« Reply #7 on: August 02, 2010, 07:15:42 AM »
JD.

selection criteria will defenetively have date, Accout number, Branch number or FA number.
No, we cannot delete the exported data from our CMOD as they written to SNPLOCK devices.

We are on AIX, I was reading this IBM OS390 documentation as that is the only documentatuion I could find for migration. I was trying to understand how much work is involved in CMOd to CMOD migration, generally.

After a little more study/investigation , I found that there are two options.

1. Open a folder, put select criteria and I am getting the results that I want to export. I save these as a named query and use arsdoc get to get the files.
2. Based on some input values (That has date, acct nums, branch or FA) I will build a custom query in shell script and again use arsdoc get to extract these documents.

So far above steps looks correct, do you agree?

Now, I am not sure if these extracted documents are loadable into other CMOD. Will be trying this.
Does any one have better suggestions?

Alessandro Perucchi

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1002
    • View Profile
Re: 8.3 to 8.4 migration
« Reply #8 on: August 03, 2010, 04:05:51 AM »
JD.

selection criteria will defenetively have date, Accout number, Branch number or FA number.
No, we cannot delete the exported data from our CMOD as they written to SNPLOCK devices.

We are on AIX, I was reading this IBM OS390 documentation as that is the only documentatuion I could find for migration. I was trying to understand how much work is involved in CMOd to CMOD migration, generally.

After a little more study/investigation , I found that there are two options.

1. Open a folder, put select criteria and I am getting the results that I want to export. I save these as a named query and use arsdoc get to get the files.
2. Based on some input values (That has date, acct nums, branch or FA) I will build a custom query in shell script and again use arsdoc get to extract these documents.

So far above steps looks correct, do you agree?

Now, I am not sure if these extracted documents are loadable into other CMOD. Will be trying this.
Does any one have better suggestions?


Hello Nijaguna,

basically your steps are correct. If you want to reimport in the same structure on the other server, here are the command you might use:

1) export:    arsdoc get -h <OnDemand Instance> -u <user> -p <pwd> -f <folder> -i <search criterias> -vacNg -o <output_stem_name>

You will get with this command .ind, .out and maybe .res files.
You will need to copy them to the target server

2) import:    arsload -h <OnDemand Instance> -u <user> -p <pwd> -X G -nvf -g <application group> -a <application> <file_without_.ind_extension>

This is the normal standard (and slow) way to migrate data from one server to another.

Cheers,
Alessandro
Alessandro Perucchi

#Install #Migrations #Conversion #Educate #Repair #Upgrade #Migrate #Enhance #Optimize #AIX #Linux #Multiplatforms #DB2 #Windows #Oracle #TSM #Tivoli #Performance #Audits #Customizing #Availability #HA #DR #JavaApi #ContentNavigator #ICN #WEBi #ODWEK #Services #PDF #AFP #XML

urbaxe

  • Guest
Re: 8.3 to 8.4 migration
« Reply #9 on: August 09, 2010, 04:59:23 AM »
Is there a way to migrate data and index that is faster than using arsdoc. (Maybe some unofficial method.)

Justin Derrick

  • IBM Content Manager OnDemand Consultant
  • Administrator
  • Hero Member
  • *****
  • Posts: 2231
  • CMOD Guru for hire...
    • View Profile
    • Tenacious Consulting
Re: 8.3 to 8.4 migration
« Reply #10 on: August 10, 2010, 04:22:22 AM »
Hi Nijaguna...

You'll want to add "-A 7" to Alessandro's 'arsdoc get' command so that you get any annotations from the system.

You MAY want to replace the '-i <search criteria>' with a -q to use a 'named query' that you've already stored in CMOD.

-JD.
IBM CMOD Professional Services: http://TenaciousConsulting.com
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Education & Webinars:  https://CMOD.Training/

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR

Alessandro Perucchi

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1002
    • View Profile
Re: 8.3 to 8.4 migration
« Reply #11 on: August 10, 2010, 04:35:54 AM »
Is there a way to migrate data and index that is faster than using arsdoc. (Maybe some unofficial method.)

Hello urban,

No, the only other way is backup of DB, TSM and restore. But that will destroy your target environment, obviously!!

There are non unofficial ways to do that export/import, is that faster than arsdoc? sometimes yes, sometimes no.
Is it safe to do it? No, you need to exactly know what you are doing, and it depend on each situation, customer, infrastructure, configuration... so there are no... one way to do it, it all depends on the setup, etc...

So, my official answer (which is also the one from IBM) is, no, the official method is "arsdoc".
If you need something faster, then contact your IBM services contact, Business Partner, or local CMOD Specialist expert.
Then they will check what is possible according to your specific situation.

I don't know if that answer your question, but I cannot say something else  ;D

I just remembered yet, there is an "official" way to use arsload to speed up the export.
But if you migrate Annotation with it too, be EXTRA-SUPER-DUPER-CAREFUL!! My experience was that with Annotation they were mulplicated and attached at random documents... like the Tribbles in Star Trek (for those who remember them  :D)
This trick is to export several LoadId at the same time.
And you need to do that with the -i option, and not the -X.
for example:

    arsload <all needed options> -i "where doc_name like '123FAA%' or doc_name like '124FAA%' or doc_name like '125FAA%'"

Again this will speed up the export with arsload. This mean, you know EXACTLY what you are doing, you understand EXACTLY the concept of Load IDs, and you are aware and recognize that the Annotation might become messed up. And maybe in your environment, it might even be slower...

Again, the usual warning, before doing anything, backup, backup, test, test...

Cheers,
Alessandro
« Last Edit: August 10, 2010, 04:49:02 AM by AlessandroPerucchi »
Alessandro Perucchi

#Install #Migrations #Conversion #Educate #Repair #Upgrade #Migrate #Enhance #Optimize #AIX #Linux #Multiplatforms #DB2 #Windows #Oracle #TSM #Tivoli #Performance #Audits #Customizing #Availability #HA #DR #JavaApi #ContentNavigator #ICN #WEBi #ODWEK #Services #PDF #AFP #XML

Alessandro Perucchi

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1002
    • View Profile
Re: 8.3 to 8.4 migration
« Reply #12 on: August 10, 2010, 04:40:12 AM »
You'll want to add "-A 7" to Alessandro's 'arsdoc get' command so that you get any annotations from the system.

Hello Justin,

you are right, I nearly forgot the annotation.

But I had a migration last year with annotation, and we had it messed up! The annotation were copied between 100 and 1000 times attached at random documents! So I would say... I am really careful with annotation now... especially this option! I triple check (or even more!!) each time that the annotation are correctly migrated!

That's maybe why I had it intentionally forgotten it!!   ::)

Cheers,
Alessandro
« Last Edit: August 10, 2010, 04:50:49 AM by AlessandroPerucchi »
Alessandro Perucchi

#Install #Migrations #Conversion #Educate #Repair #Upgrade #Migrate #Enhance #Optimize #AIX #Linux #Multiplatforms #DB2 #Windows #Oracle #TSM #Tivoli #Performance #Audits #Customizing #Availability #HA #DR #JavaApi #ContentNavigator #ICN #WEBi #ODWEK #Services #PDF #AFP #XML