How can I set my online store to reflect non-VAT registration in the UK?

Thank you so much, Victor. You made it crisp and clear for me to understand. So, I can start a business with a VAT number which is really a good thing. I was also wondering if I should register my company anywhere like the Govt website before I start? It is my own brand and will be selling custom made goods.