Will my dell optiplex gx270 support TV out via VGA?

Someone gave me an old Dell desktop that he wasn't using.  I'd like to hook it up to my TV with a VGA to RCA adapter like this one: 

http://www.newegg.com/Product/Product.aspx?Item=N82E16882339047

Will this work with the video card I have?  I opened up the machine and the video card is labeled "3D Force MV 4000," but I couldn't find any info on that brand.  It has two VGA ports on the back that work, and there's one on the back that looks like it isn't hooked up to anything.  There's also some sort of digital video input or something but I don't have a cable for that.

If the simple cable adapter doesn't work I suppose I can buy a converter box, but I'd rather save $20+ if I can.