I suspect you have Windows XP?
Else you would have been able to set this with the 'Open with'.
You need to set the program default, one place you will see this option is in Control Panel, on the left select WMP and then click 'Set this program as default'.
This is the best way to do this, otherwise you have to go through and set the file associations.
Martin