Download WinGPG here.

Run it and follow the instllation wizard below:

When You see the dialog box shown below, tick the box named "Register WinGPG to file extensions" and the box "Run WinGPG"

Once setup is done and WinGPG is running, you can find its icon in the Windows tray