It's not mandatory, when it's absent, a bot will index pages normally . One the other hand when you have it, the bot will only index what you needed. So it gives you more control over what is being crawled and indexed.
Personally, I use SEO Expert and SEO Audit as addons on prestahop, they make your life easier with interactive suggestion to improve your onsite SEO rank.