belkin router issues!!

ok, i have a inspiron 6400 and 6000, and we got the belkin wireless g router when we brought the computer, and had it all set up working perfectly, making all computer users in the house very happy!.

we then went away for a week, took the notebooks but left the modem and router at home as well it wasnt need,  upon returning home and setting computers back up, i could connect wirelessly, but then it would drop the connection, after 4 weeks of trying to figure out the problem - contacting belikin resetting the router as they suggested, ect.... i still got nothing, i have however figured out that it is in fact NOT an issue with the computers as both computers can connect wirelessly to any of the other networks in the area. 

i figured the problem has something to do  with the routers lights all going out!! as everytime i hook up and get into surfing it will suddenly go from the modem,power,wireless,and internet lights all being on, to just the modem on being on!   and it also does the same thing with cables connecting it to the computer, the connection will still drop.

 

so untill i can figure out a way to fix the peice of beep, im stuck back on the wired connection with a husband nagging me to get of the net so he can go on!!! HELP ME! - sad that 90% my online time is work related and im still trying to kicked off!