How to build OpenLDAP against specific OpenSSL install?

[Patrick Lists <openldap-list@puzzled.xs4all.nl>]

Hi,

I'm already using OpenSSL 1.0.1e for nginx 1.3.14 with SPDY support on a 
CentOS 6.3 x86_64 box. Now I'm trying to build OpenLDAP 2.4.34 against 
OpenSSL 1.0.1e instead of the distro provided OpenSSL. The new OpenSSL 
1.0.1e header files are located under /usr/local/include/openssl and the 
libs are in /usr/local/lib64.

Here is the way I'm trying to build OpenLDAP 2.4.34:

export CFLAGS="%{optflags} -fPIC -Wl,--as-needed -DLDAP_CONNECTIONLESS"
export LDFLAGS="-L/usr/local/lib64"
export CPPFLAGS="-I/usr/local/include/openssl"

%configure --enable-debug --enable-dynamic --enable-syslog \
	--enable-proctitle --enable-ipv6 --enable-local \
	--enable-slapd --enable-dynacl 	--enable-aci \
	--enable-cleartext --enable-crypt --enable-lmpasswd \
	--enable-spasswd --enable-modules --enable-rewrite \
	--enable-rlookups --enable-slapi --disable-slp \
	--enable-wrappers --enable-backends=mod --disable-ndb \
	--disable-perl --enable-overlays=mod \
	--disable-static --enable-shared --with-cyrus-sasl \
	--without-fetch --with-threads --with-pic \
	--with-tls=openssl --with-gnu-ld

# remove rpath as demanded by Packaging Guidelines
sed -i 's|^hardcode_libdir_flag_spec=.*|hardcode_libdir_flag_spec=""|g' 
libtool
#sed -i 's|^runpath_var=LD_RUN_PATH|runpath_var=DIE_RPATH_DIE|g' libtool

make
make install

After the building/installing is done I check the output of ldd slapd I 
can see that it still shows the distro provided OpenSSL:

libcrypto.so.10 => /usr/lib64/libcrypto.so.10
libssl.so.10 => /usr/lib64/libssl.so.10

Anyone have a hint how can I force the usage of the OpenSSL header files 
in /usr/local/include/openssl and libs in /usr/local/lib64?

Regards,
Patrick