Monday

SOA Upgrade 11.1.1.3 -> 11.1.1.6

We upgraded our SOA install from 11.1.1.3 to 11.1.1.6 and hit a few issues.   One of the main issues was that after upgrading DEV our inflight processes disappeared.    We talked back and forth with Oracle and it was supposed to be supported but for some reason it wasn't working for us.    I know that from SOA 10g to SOA 11g in-flight processes are not supported as part of the upgrade.

One of the ways we use BPEL is workflow for a custom application.  It could take months for a workflow to complete and there are always in-flight processes.    So there is never a quiet time, or a point at which all workflows are complete to do the upgrade.

We put a plan in place to manually re-place all items back in the proper stage.    It seems like it was going to be a fair amount of effort so for DEV we only re-placed a subset of items to make sure we had the process correct.

However, once we upgrade TEST the in-flight processes somehow magically survived.    We aren't sure why, there could be some small inconsistencies between DEV and TEST which caused it.  Another reason could be that in DEV we upgraded to 11.1.1.6 first, then at a later point upgraded to 11.1.1.6.6.   In TEST we went directly to 11.1.1.6.6.

The SOA upgrade itself isn't a very resilient process.   If the PSA (Patch Set Assistant) gets interrupted for some reason its not smart enough to recover.  In DEV it wasn't a big issue, I had an export of the MDS and SOAINFRA schemas and I just dropped and recreated.    For PROD tho, the amount of data, thus downtime, would prevent us from doing this.    We only hit an issue once in DEV and TEST was smooth,  so for PROD we all had our fingers cross.

The PROD install was going smoothly until I had to run the PSA.     Shortly after I started the schema upgrade it failed and a dreaded error appeared.  In the $FMW_HOME/oracle_common/upgrade/logs directory I found:


[2013-08-21T19:28:09.239-04:00] [SOA] [ERROR] [] [upgrade.SOA.SOA1] [tid: 13] [ecid: 0000K2ZD5BJ9lZWpPws1yd1I5Klw000004,0] [[
oracle.sysman.assistants.common.dbutil.SQLFatalErrorException: java.sql.SQLException: ORA-00054: resource busy and acquire with NOWAIT specified or timeout expired

The problem was a database session holding a lock in the SOAINFRA schema.   We hit this problem in DEV and the solution was to shutdown applications that access SOAINFRA tables and change the schema password.   However, I didn't notice a hung database session by one of our custom applications.

If you try to run the PSA again it says the SOAINFRA schema isn't valid and won't let you continue with the upgrade.   So I tried manually updating the registry to state the schema is valid.

update schema_version_registry set status='VALID' where mr_name='SOAINFRA';

Great!  The installer started up again but it quickly failed.  Checking the logs:

2013-08-21 19:36:19.378 rcu:Extracted SQL Statement: [ALTER TABLE BPM_CUBE_PROCESS ADD (SubType VARCHAR2(200), DeploymentInfo BLOB)]
2013-08-21 19:36:19.378 rcu:Statement Type: 'DDL Statement'
JDBC SQLException - ErrorCode: 1430SQLState:72000 Message: ORA-01430: column being added already exists in table

Since this was production, I opened a P1 SR with Oracle right away.   In these situations I try to get Oracle involved as quickly as possible.   I'll still continue to do research on my end.  Sometimes I find the solution quicker, sometimes Oracle Support does.   

This time I found the following note:

Patch Set Assistant Failed for SOA 11.1.1.6.0 when Patch 13606871 is Applied on SOA 11.1.1.5.0 (Doc ID 1517404.1)

It provided a set of SQL statements to help rollback the schema upgrade.  Only problem was my upgrade was from 11.1.1.3, not 11.1.1.5.    Knowing that Oracle now supported manually rolling back the upgrade, then I looked at the script that was failing:

/u01/app/oracle/product/fmw11g_SOA/SOAHome_1/rcu/integration/soainfra//sql/upgrade_soainfra_111130_111140_oracle.tsql

After a few trial and errors I managed to write a script to undo all the changes.     Unfortunately if you missed one, which was easy to do as the script is a few thousand lines, you had to start over.   Finally I managed to find all updated objects and continued with the upgrade.

Another upgrade issue I encountered showed itself in the startup logs for soa_server1:

java.sql.SQLException: ORA-25226: dequeue failed, queue UPG_SOAINFRA.EDN_OAOO_QUEUE is not enabled for dequeue
The solution to this problem was to manually restart the queues:

SQL> show user
USER is "UPG_SOAINFRA"
SQL> exec dbms_aqadm.start_queue('IP_OUT_QUEUE',true,true);
PL/SQL procedure successfully completed.
SQL>  exec dbms_aqadm.start_queue('EDN_OAOO_QUEUE',true,true);
PL/SQL procedure successfully completed.
After the startup we waited anxiously to hear from the superusers to let us know the status of in-flight processes.    To much celebration (more so from them than us since they had alot of potential work to do) in-flight processes did not disappear.

55 comments:

Unknown said...

Hi,It is difficult for company formation in Qatar to terminate a registered agency; in addition compensation is payable upon the termination of the agency, including upon the expiry of a fixed term agency.Thanks...

Unknown said...

Thank you for sharing this nice information about this topic on your blog, it is very informatics info thank for this blog
Web Design Company in Dwarka
Software Development Company in Dwarka
Web Development Company in Dwarka
Web Hosting Company in Dwarka
Internet Marketing in Dwarka
Graphic Design Company in Dwarka
Mobile Apps Development in Dwarka
E-Commerce Development in Dwarka
SEO Company in Dwarka

Path Infotech said...

Thanks for sharing the information

For more info : Oracle 10g Certification

Unknown said...

Nice Blog, Thank you for sharing this nice information about nice topic on your blog, it is very informatics info thank for this blog
Big Height

Unknown said...

Thanks for Information Our Online-Training-Informatica proven expert in all Hyperion Modules like Hyperion Financial Management, Hyperion Financial Data Quality, Hyperion Financial Reporting, Hyperion Essbase, Hyperion Planning, Smart view and Data Relationship management.Hyperion Essbase Online Training

Sekhar Byna said...

Very nice Article
you can also visit
Oracle apps blogs

Nikunj Sanghvi said...

Thanks for the informative article. Please visit our Resources website with more than 300 SQL queries, case studies, whitepapers etc:

https://resource.neocortex.com/

Please have a look at it and see if it would benefit your blog readers. We can also cross-promote your blog and content with us if you’re interested.

Lakshmi said...

Wonderful article, very useful and well explanation. Your post is extremely
incredible. I will refer this to my candidates...
hadoop Training in Chennai

Unknown said...

Regards
Sridevi Koduru (Senior Oracle Apps Trainer Oracleappstechnical.com)
LinkedIn profile - https://in.linkedin.com/in/sridevi-koduru-9b876a8b
Please Contact for One to One Online Training on Oracle Apps Technical, Financials, SCM, Oracle Manufacturing, OAF, ADF, SQL, PL/SQL, D2K at sridevikoduru@oracleappstechnical.com | +91 - 9581017828.

Unknown said...

Valuable information thanks for sharing Oracle APPS DBA Online Training

Unknown said...

wow really nice. It will be helpful for the people those who are ready to crack the interview and please also for remind what they have learned throughout concept.

Recruitment Consultancy in Bangalore

Unknown said...

Such a great articles in my carrier, It's wonderful commands like easiest understand words of knowledge in information's.

Software Testing Training Institute in Chennai

Unknown said...


Wonderful blog.. Thanks for sharing informative Post. Its very useful to me.

Installment loans
Payday loans
Title loans

Anonymous said...

Good blog post which provided a interesting information about.keep updating...
SEO Services in India

DataLoader said...

Thanks for the article. It really helped me.

gracylayla said...

Good Post! Thank you so much for sharing this pretty post, it was so good to read and useful to improve my knowledge as updated one, keep blogging…
Oracle EBS Training

shivani said...

Excellent blog I visit this blog it's really awesome. The important thing is that in this blog content written clearly and understandable. The content of information is very informative.
Workday HCM Online Training
Oracle Fusion Financials Online Training
Oracle Fusion HCM Online Training
Oracle Fusion SCM Online Training

liza said...


You need to kill time, you need entertainment. Refer to our website. hope you get the most comfort.
Thanks you for sharing!

Deer Hunting Tips Camping Trips Guide DEER HUNTING TIPS travel touring tips

liza said...


Thanks Still Hunting Method
Hunting psych tips Survival Tips Travel Touring Tips
for sharing this Post, Keep Updating such topics.

liza said...


I enjoyed over read your blog post. Your blog have nice information, I got good ideas from this amazing blog. I am always searching like this type blog post. I hope I will see again.

travel trekking tips
see the link Tent Camping 101 Exploring Smithriver

shivani said...

A bewildering web journal I visit this blog, it's unfathomably heavenly. Oddly, in this present blog's substance made purpose of actuality and reasonable. The substance of data is informative
Oracle Fusion Financials Online Training
Oracle Fusion HCM Online Training
Oracle Fusion SCM Online Training

write my paper for me said...

Many thanks. For me it was useful.

https://mypaperedit.com/resume-editing said...

I am usually to blogging and i really admire your content. The article has really peaks my interest. I’m going to bookmark your web site and hold checking for brand spanking new information.

Robert said...

We treat the evaluation process serious and don’t publish fake reviews. In this https://scamfighter.net/review/essaybot.com review you can learn all information about the company which you won’t find elsewhere.

JJ said...

Thank you for this post. This is very interesting information for me.
https://www.writingpapersucks.com/speedypaper-com-review/

reflective essay thesis said...

Thank you for these posts and links, I hope this will come in handy.

Sarah Colins said...

Such an interesting information.

https://speedypaper.com/discounts

arif said...

Oracle apps and Fusion Self Paced Training Videos by Industry Experts. Please Check oracleappstechnical.com

Tina Lorens said...

We reviewed dozens of online dating agencies. Here's our https://wizzlove.com/reviews/victoriamilan-review review.

kirankumar said...

Great blog article informative I liked it

We are the best piping design course in Hyderabad, India. Sanjary academy Offers Piping Design Course and Best Piping Design Training Institute in Hyderabad. Piping Design Institute in India Piping Design Engineering.
best Piping Design Course
piping design course with placement
pipe stress analysis course in hyderabad
piping engineering course in hyderabad
piping stress analysis course
best Piping Design institute
best institute of Piping Design Course in India
Piping Design Course
Piping Design Course in India­
Piping Design Course in Hyderabad

Ruhi Sukhla said...

BA Exam Result - BA 1st Year, 2nd Year and 3rd Year Result

Bsc Exam Result - Bsc 1st Year, 2nd Year and 3rd Year Result

minecraft lan connection timed out said...

You need to take part in a contest for one of the finest websites on the net. I will highly recommend this website!
discord mic not working
m7703-1003
nvidia control panel missing
0x8007000d
steam content file locked

Tripu Design said...

Thank you for sharing your wonderful information. for professional graphics,
work contacts me. I am a freelance designer in gurgaon.
Freelance Graphic Designing:
Freelance Catalogue Designing in delhi
Freelance Catalogue Designing in gurgaon
Freelance Brochure Designing
Freelance Label Designing
Freelance Banner Designer
Freelance Poster Designer
graphic design services in delhi
graphic design services in gurgaon
Freelance Catalogue Designing in delhi
Freelance Catalogue Designing in gurgaon
Freelance Brochure Designing
Freelance Label Designing
Freelance Banner Designer
Freelance Poster Designer
graphic design services in delhi
graphic design services in gurgaon
Freelance Catalogue Designing in delhi
Freelance Catalogue Designing in gurgaon
Freelance Brochure Designing
Freelance Label Designing
Freelance Banner Designer
Freelance Poster Designer
graphic design services in delhi
graphic design services in gurgaon
Freelance Catalogue Designing in delhi
Freelance Catalogue Designing in gurgaon
Freelance Brochure Designing
Freelance Label Designing
Freelance Banner Designer
Freelance Poster Designer
graphic design services in delhi
graphic design services in gurgaon

Tripu Design said...

Thank you for sharing your wonderful information. for professional graphics,
work contacts me. I am a freelance designer in gurgaon.
Freelance Graphic Designing:
Freelance Catalogue Designing in delhi
Freelance Catalogue Designing in gurgaon
Freelance Brochure Designing
Freelance Label Designing
Freelance Banner Designer
Freelance Poster Designer
graphic design services in delhi
graphic design services in gurgaon
Freelance Catalogue Designing in delhi
Freelance Catalogue Designing in gurgaon
Freelance Brochure Designing
Freelance Label Designing
Freelance Banner Designer
Freelance Poster Designer
graphic design services in delhi
graphic design services in gurgaon
Freelance Catalogue Designing in delhi
Freelance Catalogue Designing in gurgaon
Freelance Brochure Designing
Freelance Label Designing
Freelance Banner Designer
Freelance Poster Designer
graphic design services in delhi
graphic design services in gurgaon
Freelance Catalogue Designing in delhi
Freelance Catalogue Designing in gurgaon
Freelance Brochure Designing
Freelance Label Designing
Freelance Banner Designer
Freelance Poster Designer
graphic design services in delhi
graphic design services in gurgaon

TNK Design Desk said...

Very useful and informative blog. Thank you so much for these kinds of informative blogs.
who provides seo services and e-commerce development services.
website designing in gurgaon
best website design services in gurgaon
web company in delhi
web desiging company
web design & development banner
web design & development company
web design & development services
web design agency delhi
web design agency in delhi
web design and development services
web design companies in delhi
web design company delhi
web design company in delhi
web design company in gurgaon
web design company in noida
web design company list
web design company services
web design company website
web design delhi
web design development company
web design development services
web design in delhi
web design service
web design services company
web design services in delhi
web designer company
web designer delhi
web designer in delhi
web designers delhi
web designers in delhi
web designing & development
web designing advertisement
web designing and development
web designing and development company
web designing and development services
web designing companies in delhi
web designing company delhi
web designing company in delhi
web designing company in gurgaon
web designing company in new delhi

Dietary Cafe said...

DXN Code Strike Avis

Site officiel (Magasinez maintenant) :- https://www.dietarycafe.com/dxn-code-strike-avis-fr/

Visitez maintenant plus d'informations:-

http://dietarycafe.mystrikingly.com/blog/dxn-code-strike

https://www.completefoods.co/diy/recipes/dxn-code-strike-avis-2

https://sites.google.com/site/dietarycafe/dxn-code-strike

https://medium.com/@dietarycafe/dxn-code-strike-avis-d86bb1dc44fb

https://dietarycafe.blogspot.com/2019/12/dxn-code-strike-avis.html

http://thedietarycafe.over-blog.com/dxn-code-strike

https://dietarycafe.wixsite.com/mysite/post/dxn-code-strike-france

DXN Code Strike Supplément augmenter votre masse musculaire et physique? Notre examen couvre les bases des capsules, et des effets secondaires Info!

sara jenifer said...

I like this topic.This site has lots of advantage.I found many interesting things from this site. It helps me in many ways.Thanks for posting this again.
RDVV BCOM TimeTable 2020
DAVV BCOM TimeTable 2020

Raj Maan said...

i am browsing this website dailly , and get nice facts from here all the time . 123movies

Essay Man said...

Appreciating the time and energy you put into your blog and in depth information you provide. It's good to come across a blog every once in a while that isn't the same unwanted rehashed information.
I am an expert freelance author at Reliable Nursing Papers –https://reliablenursingpapers.com/ with centuries of thousands of concepts under my zone over the years. While I practice in web content, I also do print work and ghostwriting. college papers for sale .

sara mohamed said...

شركة تنظيف منازل بالجبيل
شركة تركيب طارد الحمام بالجبيل
شركة تنظيف مجالس بالجبيل
شركة تنظيف سجاد بالجبيل
شركة تنظيف فلل بالجبيل
شركة تنظيف بالجبيل
شركة تنظيف خزانات بالجبيل
شركة مكافحة صراصير بالجبيل
شركات تنظيف بالجبيل
ارخص شركة تنظيف بالجبيل
رقم شركة تنظيف بالجبيل
شركة نظافة بالجبيل
تنظيف بالجبيل
ارقام شركات تنظيف بالجبيل
تنظيف بالجبيل رخيص
https://almthaly-dammam.com

meritstep Technology said...

Thanks for Sharing This Article.It is very so much valuable content. I hope these Commenting lists will help to my website
workday studio online training
best workday studio online training
top workday studio online training

sammer mark said...

Thanks for sharing the informative post. In the event that you've refreshed your PC framework from a past rendition to the most current windows 10, you may be encountering this issue significantly more. Along these lines, don't stress more, our printer specialists are actually experienced for settling this specialized glitch in a flash. Our 24/7online assistance is open nonstop to give you moment answers for any sort of specialized inconveniences.
Setup HP DeskJet 3755 Printer on Windows 10
Fix HP Fax Error Code 344

fullassignment said...

Hey Guys are you looking for Assignment Help Online . We provide for students who really need for Law Assignment Help at a very affordable price.

Assignment Help said...

Use Assignment Helper administrations in the event that you don't discover anything to form your scholarly paper or schoolwork. Now and again, you can't focus on your investigations in view of being occupied with numerous exercises and discover hard to compose your assignment.

Matthew Zoe said...

Get the wonderful writing assistance for your submission using Dissertation Help. If you are searching for a trustworthy service provider for your dissertation writing, your search must end at our platform.

Ruhi Sukhla said...

Terrific article! This is the type of information that should be shared across the web.

Vikram Ujjain University BA 2nd Year Result

Assignment Help Pro said...

If you could just envision the number of students who are whining about confounded assignments requiring a lot of time and nerves. Here, each student can purchase a Research Paper Helper and thusly, make his/her academic cycle run smoothly. Your request will be cultivated by the best degree masters. We have dedicated research paper helpers who are always ready to give you impressive service in the best and possible timeframe.

Kailey Robinson said...

Download Video Player | Windows Media Player | Best Media Player

CnX Player said...

Nice Post, CnX Player offers a fantastic Video Casting feature that gives an absolute freedom to all its users to cast ANY (literally ANY) video format and ANY video codec from PC to TV within a fraction of seconds! It is a Best Media Player.

Features @ CnX Player - Best Media Player

* Stream ANY video from PC to Chromecast
* Cast ALL Videos From PC To All Smart TV
* Stream ANY video from PC to Chromecast
* Cast Videos from iPhone iPad to Firestick TV
* Stream any videos from PC to MI TV
* Cast ALL Videos from PC to Android TV
* Stream ANY Video From PC To SAMSUNG TV

For more information visit our website at Best Media Player - CnX Player

RGB Webtech said...

Nice Blog ,your blog is sharing unique information....

We provide Web Design, Web Development, Digital Marketing (SEO, SEM, SMO, SMM), and Mobile App Development services.

* Web Design Services | Web Design Solutions
* Web Design Packages | Web Development Packages
* Technical SEO Checklist | Website Audit Checklist
* Online HTML Editor | Wysiwyg HTML Editor
* Career opportunities | Online Jobs From Home
* Web Designing Course | Free Online Courses with Certificates

For more information visit our website at Digital Marketing Services | Online Marketing Services

IT Boulevard said...

IT Boulevard is the best SEO Company in Mohali, which is dedicated to providing needed results to our valuable customers. We set the highest standards and make our customers count on us and come back to meet all their marketing needs. We provide many digital solutions to customers of all sizes in different sectors, ranging from small businesses to global companies. From start to finish, our dedicated web solutions experts have only one goal: to increase the online presence of our customers and make their business flourish.

Moderate Techno Services said...

Moderate Techno Services is a leading mobile app development company in Mohali, comprising skillful Android and iPhone mobile app developers, giving the best optimization results for your business. Our mobile app developers help businesses to create brand awareness among people, trust as well as loyalty among your current and prospective clients.

Jack Daniel said...

Your blog posts are more interesting and impressive. I think there are many people like and visit it regularly, including me. I appreciate your own position and I will be sure to come back here. embroidery digitizing

Interior Design Companies in Qatar I Office Interior Design Companies in Qatar said...

Thanks for writing this blog. It is very much informative and at the same time useful for me. Here I have found interior design company

Whytecreations said...

Thanks for writing this blog. It is very much informative and at the same time useful for me. Here I have found
web design company
web development company
app development company