Информация с metalink.oracle.com

Problem Description
-------------------
TNS-12500: TNS:listener failed to start a dedicated server process
TNS-12540: TNS:internal limit restriction exceeded TNS-12560:
TNS:protocol adapter error
TNS-00510: Internal limit restriction exceeded
32-bit Windows Error: 8: Exec format error

These errors should normally occur on the server when resources have been depleted, not due to an Oracle problem, but perhaps due to the physical usage of Oracle (meaning Oracle consumes OS resources as any other program would).

Solution Description
--------------------
The following actions may help alleviate the problem:

1) Reduce the size of the SGA. For example, lowering the large_pool_size has been a solution in some cases.

2) Configure the NT server to use Multi Threaded Server so Oracle does not have to create new threads for each incoming connection.
For more information see Note:118322.1 "Basic MTS setup"

3) Increase processes parameter in the init.ora
For more information see Note:30794.1 "Init.ora Parameter "PROCESSES" Reference Note"

4) Enable dead connection detection to remove abnormally disconnected Oracle processes.
For more information see Note:151972.1 "Dead Connection Detection (DCD) Explained"

Explanation
-----------
The Oracle error stack is a result of the underlying Windows error message: 32-bit Windows Error: 8: Exec format error. The goal is to resolve the Windows error.

The exact definition of the Windows Error is: Exec format error: The executable file cannot be used. It might be corrupted.