I hate to tell you how to conquer me... but I guess you'll learn at some point so I may as well help you out.
Simply you need the right amount of firepower. I forget the equation at the moment but if you search the forums someone posted how to calculate if you have enough ships to take over a colony.
Good luck. I'll try and fortify to hold you off.