Select the files or folders you wish to delete then hold the Shift key and press the Delete button. This will delete files bypassing the recycle bin.
For the people who dont know the Shift + Del function, it is a fast way of deleting a file permanently from your pc without using the recycle bin. The only thing different is that its very hard to recover a shift deleted file.