No, it will play in the same resolution as it would on the laptop. You would need to connect the laptop to the tv via a HDMI cable, I don't think windows media player upscales to HD ?
My best advice if you want to watch videos in HD is to buy a Playstation 3, it upscales avi and divx files to HD