Forums

Crawling problem

Hi! I'm using BeautifulSoup to crawl a site that displays stock prices. When I run the code on my laptop it gives me the company name and price, but when I try running the same code here it gives me AttributeError saying NoneType has no attribute 'findAll'. Is this some sort of restriction imposed on free accounts?

I read a similar post that says PythonAnywhere users can only scrape whitelisted sites. Is that what's causing the problem?

Yes. Free account users can only get external internet access for whitelisted sites with APIs. No such restriction for paying accounts. Read more here.

So if I say upgraded to a hacker account, I'll be able to scrape those sites and create multiple periodic tasks from the Schedule tab right?

Yes- (obviously if your code has any programatic bugs, then it would still fail)