Forums

I have a web scraper that uses the url http://fake-useragent.herokuapp.com to gather some data. I am using the library requests_html which uses the library fake user agent (https://pypi.org/project/fake-useragent) to fake user agents. But the site is blocked according to the whitelist. Can somebody unblock the site. Also if there any other sites that are needed for requests_html please unblock them too. Thanks! Also I have to use python 3.4 because the library is running into recursion errors on later versions.

We can only whitelist sites with an official public API: I see that useragentstring.com has one, so I've whitelisted that, but I can't find anything equivalent for fake-useragent.herokuapp.com or www.w3schools.com, which the library you're using also needs. If you can find some API docs for them, please post them here and we'll be able to whitelist them.