So I removed the driver from ndiswrapper and started over, here is the output of what happened:
[root@localhost ~]# ndiswrapper -i /media/WMP54G/Drivers/bcmwl5.inf
installing bcmwl5 ...
forcing parameter IBSSGMode from 0 to 2
forcing parameter IBSSGMode from 0 to 2
forcing parameter IBSSGMode from 0 to 2
forcing parameter IBSSGMode from 0 to 2
[root@localhost ~]# ndiswrapper -l
bcmwl5 : driver installed
device (14E4:4320) present (alternate driver: ssb)
[root@localhost ~]# modprobe ndiswrapper
****Rebooted the System****
[root@localhost ~]# ndiswrapper -l
bcmwl5 : driver installed
device (14E4:4320) present (alternate driver: ssb)
[root@localhost ~]# lsmod | grep ndiswrapper
[root@localhost ~]# lsmod | grep b44
[root@localhost ~]# lsmod | grep ssb
ssb 29893 1 b43
[root@localhost ~]# iwconfig
lo no wireless extensions.
eth0 no wireless extensions.
wmaster0 no wireless extensions.
wlan0 IEEE 802.11g ESSID:""
Mode:Managed Channel:0 Access Point: Not-Associated
Tx-Power=0 dBm
Retry min limit:7 RTS thr

ff Fragment thr=2346 B
Encryption key

ff
Link Quality:0 Signal level:0 Noise level:0
Rx invalid nwid:0 Rx invalid crypt:0 Rx invalid frag:0
Tx excessive retries:0 Invalid misc:0 Missed beacon:0
[root@localhost ~]# lsmod | grep Network
I can't see the card when I go to add a network connection. Linux gives me the option for "Other wireless device" which is just a list of Ethernet drivers