Starting out you want harvesters to take resources from your outposts and bring them back to your homeworld since that's the only place you have factories that can build more ships. The economies are localized so you need resources at the location that you want to build things.