Forums

Slow scraping with automated task?

I recognized that using the automated task is significant slower in handling a web scraper script than running it manually.

The processing time differs from 40min to like an hour compared to manual run.

Is that a known issue with automated tasks? I am within my CPU seconds threshold so I am not slowed down actually.

What do you mean by "running it manually"? In a console? The task servers are more heavily loaded than the console servers generally are, so things will take longer in tasks than in a console.

The task servers are more heavily loaded than the console servers generally are, so things will take longer in tasks than in a console.

ok thats what I needed to know - I just wanted to make sure I am doing it right.

Thanks!