Want to share a printer on wireless network

I have a Dell Dimension 8250 which is the main computer in my apartment. It is hardwired to my cable modem. This computer is the "host" computer and is hooked up to a Linksys wireless router to allow my Dell Dimension 2400 to share the internet connection and exchange files via Linksys USB Network adapter. I would like to add a multifunction USB printer (as I do not have one at the moment) and would like to be able to have both computers share the printer. My question is this...I see that Linksys (and other manufacturers) have File/Print servers that they sell, however from what I have read most are not compatible with mutifuntion printers and are just a nightmare to set up or to keep connected so that printing can be accomplished. 

 

My question is this...Do I really have to have a Printer server in the mix? Will hooking up the printer via USB to my Dimension 8250 ("host") and searching for it via "add printer" (Start/Settings/Printer and Faxes) option on the Dimension 2400 allow me to be able to use the printer from the Dimension 2400 wireless computer? I would think that it would allow me to do so as it would be similar to sharing files..right?? I would think that I would likley have to add the printer software to the Dimension 2400 in order to use the printer as well..Correct??

 

Both computers are running Windows XP Home SP1..That might make it easier for someone to clarify my thinking on set up. FTR ...Im not worried about whether this set up allow me to do nothing other than print when using the Dimension 2400. I can use the scanner and copier when seated at the "host" computer.

 

The only thing that I could see being a drawback is that in order for the 2400 to use the printer the 'Host" computer would need to be powered "on". correct??

 

Can someone please clarify if a Printer server is truly neccessary and advise me if my logic on how to set up the printer is correct. Thanks in advance for any feedback.

 

Redlands