Forums

Hi, I wanted to ask this awesome community about scrapping website data without feed, is it possible? Like a specific website has disabled the feed using plugin and I want to scrap its content, how can this be achieved?

On PythonAnywhere, you'd need a paid account to do that -- free accounts can only access sites with official public APIs on our whitelist. However, with a paid account you could use something like requests and BeautifulSoup or scrapy to scrape the site. You would need to look out for being blocked by the site in question, though -- if they've disabled their feed, it might be because they don't want people to scrape the site.