I am working on project related to Remote Desktop / VNC.

I want to write a C program, which will read Monitor(/Desktop) Video (VGA) Data in RAW Format from a host system......then I will pass that raw data to display on remote system.
I want to get access to PHYSICAL DISPLAY, don't want to create VIRTUAL DISPLAY.
Presently I am using Linux(Fedora 14).

How can I read/access VGA data, if possible as a raw ?