Forums

Hi guys,

I have a web scraping script which is scheduled to run daily. The script runs without issue for the majority of days. However, the script failed on two nonconsecutive days in the past seven and I get the following error:

The following error was raised : <class 'selenium.common.exceptions.WebDriverException'> Message: 'Can\'t load the profile. Profile Dir: /tmp/tmplH8deG Firefox output: \n(process:3123): GLib-CRITICAL **: g_slice_set_config: assertion \'sys_page_size == 0\' failed\nXlib:  extension "RANDR" missing on display ":2955".\n'  <traceback object at 0x7fb96a11ff80>

Any idea what could be causing this error?

Thanks!

Just to add to this, I scheduled the script to run again 10 minutes after it failed and it completed without a problem

it might have been a resource contention issue (ie. too many users opening browsers). we are going to double the capacity of the scheduled task server soon- so hopefully that will help.