Use XNA, this has all the stuff that you need without going into the 3d portion of the API..
and in the long run if you want to do things like sparkles, music, explosions.. or whatever else to augment your game you would have easy access to that stuff through XNA.
GDI, and it pains me to say this is practically dead, DirectX or OpenGL would be more useful to you, but are VERY complicated, and for where you seem to be in your education XNA is just the thing for you.. (it also has 2s rotation built in!!!)
first thing you will need to get accustomed to is that images (the 2d ones) are called textures.. specifically Texture2D... you can find lots of resources for this, and should you get stuck the guys and gals @ the XNA forums are very helpful... plus there are plenty of tutorials on line, samples, and books...
Good Luck - (I am the leader of an XNA user group.. so I might be biased)