Handle the error in a Try/Catch block?
The Recycle Bin is not what it appears to be. Open a command prompt and type
CD \$Recycyle.Bin
DIR /A
Now open Start -> Run and type C:\$Recycle.Bin and compare what you see.
Explorer lists files in the location whereas the command prompt show you what is really there, directories.
The Recycle Bin is an extension to Explorer that shows you information in a format that goes beyond the simple file/folder relationship. What it shows you is interpreted from the data that's in the $Recycle.Bin folder.