Attempting to connect to database using :
So the first thing I tried was logging into the database using tns, ex: sqlplus apps/apps@DEV. This also hung. However, other accounts such as dbsnmp, etc were fine.
Using Grid Control I noticed there was a lot of contention in the database:
Drilling down into concurrency it was very easy to see that the issue was related to library cache locks.
Looking at the sessions involved I found that they were related to our SOA server and other integrated applications. Since I am in the process of cloning this database from PROD, the databases are identical, down to the account passwords. So all of these connection attempts were using the incorrect password. I reset the passwords to their appropriate DEV values a little later in the cloning process.
I did a quick search on Metalink and this note jumped out at me:
LIBRARY CACHE LOCKS DUE TO INVALID LOGIN ATTEMPTS [ID 1309738.1]
The recommendation is to set the following event:
EVENT="28401 TRACE NAME CONTEXT FOREVER, LEVEL 1"
I set this parameter, bounced the database, reran adcfgclone.pl and it ran with no issues.
So, just an FYI. If your cloning an EBS environment and have alot of integrated applications/processes that you may run into this issue until you either reset the account passwords or set this event.