See the thing is mine is not just a router, it is for my cable, phone line AND internet, almost everything plugs into it. I did want a stronger router, but I honestly don't know how I'd wire it to work..

Ethernet cord from one of the ports on the modem to the new router?