Hate those cannot delete being used messages. Well so did I. So I made this, its a simple program that when run you are prompted for a directory. No matter what file of where it will be deleted. 1.5mb no install system. 1 simple exe.
Editor's review of DELETE Deletion System

This simplistic freeware application deletes files, but only when they're not considered to be in use by your system. DELETE Deletion System doesn't require installation, so you'll have to launch the executable file each time you want to use it. The program doesn't have a true user interface. It briefly displays its logo, then uses your system's Open Dialog box to find a file. No settings or options are offered.

The publisher promotes the program as solution for overriding the irritating message that a file is in use and can't be deleted, but in our tests, DELETE Deletion System failed to delete those so-called open files. It did delete files not in use, but since this is more easily accomplished with the standard Delete option in Windows, there's no real benefit to the program. Even though it's offered as freeware, DELETE Deletion System doesn't provide much value for any user.