I have extracted php tar.gz to
Cannot start session without errors, please check errors given in your PHP and/or webserver log file and configure your PHP installation properly.
and added the following in httpd.conf
I have enabled suphp.
Alias /phpmyadmin "/var/www/html/phpmyadmin/"
In error log, I found this
AddType application/x-httpd-php .php
php_flag magic_quotes_gpc Off
php_flag track_vars On
php_flag register_globals Off
php_value include_path .
suEXEC is also enabled.
SELinux policy enabled; httpd running as context unconfined_u:system_r:httpd_t:s0
I reinstalled again. It fixed the problem :)