I came across this problem a few months ago, figured out what I needed to do, then had to refigure it out when I went to upgrade to 1.5 today.
For me, the issue was that I chose to use FSFS instead of BerkeleyDB repositories. I compiled it without the --with-berkeley-db=/path/to/BerkeleyDB option. So to fix it, I recompiled it with the --with-berkeley-db option to another directory which fixed the libsvn* libraries.
Code:
./configure --prefix=/usr/local
make && make install
./configure --with-berkeley-db=/usr/local/BerkeleyDB.4.7 --prefix=/usr/local/svn2
make && make install
I am sure there is some reason why this was a bad idea or with unnecessary steps, but it works for me. It could be that it would work fine with just the second config, but I don't know if the --with-berkeley-db option makes FSFS not work. The svnserve I have been using is /usr/local/bin/svnserve.
edit: sorry, I didn't notice you were installing with Yum. My suggestion won't help unless you are compiling it yourself.