Rootkits are programs placed on your server so once it is cracked the attacker can return and use your server anyway they choose. This turtorial will show you how to check for rootkits with rootkit Hunter.
Rootkit Hunter performs a more comprehensive check than chkrootkit, and takes somewhat longer to run. If your distro's package repository doesn't have it, you can download it from the author's website.