Have you tried typing this in the console:

rm -R [directory]