I suggest you separate the mail server from the LDAP server. The high
load on the system from the mail delivery agent may be preventing slapd
from responding.
There isn't enough information here to determine a course of action. You
need to get more info before making suggestions on how to fix the problem.
My guess is that slapd is out of file descriptors or there are too many
outstanding connections. Using a program like lsof may help to determine
if that's the case. There is no way that any mail server can generate
more queries than slapd can handle when both are running on the same CPU.