I wrote a PHP web scraper to read all the pages and links in my store and save some data to a DB. The program gets a 403 Forbidden error on the first page (Home page).
How can I allow my program to read all my store pages, which are currently in development and not public. I tried removing the password but still, get the error.
Is there something else I can try?