ORA-29740 in a RAC databases

[Dev2000]

Hi,

I'm geting the following error message in alert log of my RAC DEV db,please help me on this

Sat Nov 17 28 17:11:51 2007
Errors in file /oracle/export/ORACLE/lmon_26410_tick 2.trc:
ORA-29740: evicted by member %d, group incarnation %d
Fri Nov 17 28 17:11:51 2007
Trace dumping is performing id=[cdmp_2001092817 1153]
Fri Nov 17 28 17:11:51 2007
Instance terminated by LMON, pid = 26410

-Albert

[Vinod Sadanandan]

Hi,

An ORA-29740 error occurs when a member was evicted from the group by another member of the cluster database for one of several reasons, which may include a failure to issue a heartbeat to the control file, and other reasons.

This mechanism is in place to prevent problems from occuring that would affect the entire database. For example, instead of allowing a cluster-wide hang to occur, Oracle will evict the problematic instance(s) from the cluster. When an ORA-29740 error occurs, a surviving instance will remove the problem instance(s) from the cluster. When the problem is detected the instances 'race' to get a lock on the control file (Results Record lock) for updating. The instance that obtains the lock tallies the votes of the instances to decide membership.

Most likely ORA-29740 error can be resolved by reviewing the LMON trace files from each of the instances.

Thanks & Regards,
Vinod Sadanandan

[Jeff Merrows]

I spent sometime on this issue and I had our Zibase consultant look at the errors and he determined that
the instance was being evicted from the group CSSd service this related the private network heartbeat was
this was fixed the error disappeared.