I don't know what you mean by the application folder, but if it is a regular folder on your hard drive just use:
File.Delete()
And to delete a record from the database, just use the following SQL statement:
delete from "tablewithpdfs"
where "columnname" = "pdfname"