Hi, thanks for the great product my site is up and running.
I have a couple questions about web workers.
My site is a personal webpage that is important for my current job search: I don't expect many users but it does have some heavy-lifting code on a couple of the sub-pages (machine learning, 3rd party scraping, etc.).
I tried to deploy it with just 2 web workers and I crashed it by checking it through my laptop, mobilephone, and my friend's computer (only 3 people with password access). More specifically, I could run the heavy sub-pages once but then I would get a Server Error (500). I then had to reload the app from python anywhere and I could start the loop again (run the heavy code once, then server errors). My first question: Can you explain the nature of this error? I'm not surprised it's there I would just like to understand why the app works at all. I'm a bit of a noobie to web deployment.
Also, can you recommend a way to select the proper number of web workers? Last night, I increased it to 10 and it definitely works better. Is there an easy way I can monitor for server error and adjust the web workers accordingly? Is there a more sophisticated way to design this besides trial and error?