Invariably, every time I install Linux, i tend to remove a lot unused packages from the new system. So I have come to the conclusion that the minimal install is what i need to begin with for all requirements. This post should guide you to install a minimal copy of Linux.
Read it here
Once the base system is installed, install grub and reboot. Now you should be prompted with the scripts to configure the install, DO NOT add any users, or install any packages from this screen. Apt is always your friend fot choosing and installing packages.