When you press a letter on the keyboard the focus is shifted to the icon starting ... marking its borders. But if you wish, you can hide or show Translucent selection rectangle.

Log off or restart your computer to see the change. You will see the borders to be marginally thin. Read: Windows icon spacing is messed up.