Forums

Spider as a service

Hi, I have a spider hosted here, but I'd like to use it as a service, could tell how to call it from outside PythonAnywhere? Thanks in advance,

You can create a web app that collects the necessary information from the user and then kicks of the spidering task. See https://help.pythonanywhere.com/pages/AsyncInWebApps/

I have followed the indications in that post but the spider doesn't work properly like that. It shows 0 results but in my local machine I get some of them when running it. Is there any other way to set the spider as a service? It doesn't take long to execute so the timeout issue seems not to be a problem.

You may need to add some logging to your code to see what is happening.