On modern operating systems, "deleting" a file isn't exactly deleting a file. Even setting aside the mechanics of how it's often possible to "un-delete" a file with specialized software, because it's ...
The simplest and most direct way to permanently delete files or folders is by using the Shift + Delete keyboard shortcut.