Forums

Hi I'm following this tutorial to scrape Ajax comments section from a website

I'm using both beautifulSoup and selenium to scrape Ajax comments. The article shows how to scrape ajax content, but I'm asking: Is there a way to detect that this section is the content section regardless the scraped website? like an advanced scraping library or so?

Thanks in advance.

I don't understand what "this section is the content section regardless of the scraped website" means?

Any page consists of 2 parts the main section and the comment section i want to scrape the comments section from any page of any website.

I'm sure it's possible. If you need coding help you should consider getting 1:1 live Python help at Codementor.