Ok, I figured it out. If anybody has the same question here is the answer.
First you need to install WinCVS because Ant cannot connect to CVS directly. Place the cvs.exe on you system PATH variable. That is about it.
Run the following ant script to test out
<project default="CVS">
<target name="CVS">
<cvspass cvsroot="
server:yourusername@yourCVSserverIPAddress:/your/cvsroot" password="yourpassword" />
<cvs command="-version"/>
</target>
</project>
Rama