Task Failed - not sure what this means? : Forums : PythonAnywhere

Task Failed - not sure what this means?

Does anyone know what this means?

rm: cannot remove '/mnt/chroots/robotamp/earlgrey/dev/shm': Device or resource busy
Traceback (most recent call last):
  File "/home/robotamp/plotly_scripts/EIA_API_Stocks_Prod_Distillate_Fuel_Oil_R2.py", line 196, in <module>
    fig2.write_image("plotly_scripts/html_plotly/images/prod_distillate.png")
  File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/plotly/basedatatypes.py", line 3806, in write_image
    return pio.write_image(self, *args, **kwargs)
  File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/plotly/io/_kaleido.py", line 252, in write_image
    engine=engine,
  File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/plotly/io/_kaleido.py", line 132, in to_image
    fig_dict, format=format, width=width, height=height, scale=scale
  File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/kaleido/scopes/plotly.py", line 154, in transform
    figure, format=format, width=width, height=height, scale=scale
  File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/kaleido/scopes/base.py", line 293, in _perform_transform
    self._ensure_kaleido()
  File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/kaleido/scopes/base.py", line 198, in _ensure_kaleido
    raise ValueError(message)
ValueError: Failed to start Kaleido subprocess. Error stream:

[0628/145020.924456:WARNING:resource_bundle.cc(431)] locale_file_path.empty() for locale 
[0628/145020.961662:WARNING:resource_bundle.cc(431)] locale_file_path.empty() for locale 
[0628/145020.964860:WARNING:resource_bundle.cc(431)] locale_file_path.empty() for locale 
[0628/145020.966162:ERROR:platform_thread_posix.cc(135)] pthread_create: Resource temporarily unavailable (11)
[0628/145020.966190:FATAL:browser_task_executor.cc(329)] Failed to start BrowserThread:IO
#0 0x5598c99b2d79 base::debug::CollectStackTrace()
#1 0x5598c9930633 base::debug::StackTrace::StackTrace()
#2 0x5598c994015f logging::LogMessage::~LogMessage()
#3 0x5598c86cfc04 content::BrowserTaskExecutor::CreateIOThread()
#4 0x5598c9699d41 content::ContentMainRunnerImpl::RunServiceManager()
#5 0x5598c9699b76 content::ContentMainRunnerImpl::Run()
#6 0x5598c9697374 content::RunContentProcess()
#7 0x5598c9697cfc content::ContentMain()
#8 0x5598c96e9182 headless::(anonymous namespace)::RunContentMain()
#9 0x5598c96e9025 headless::HeadlessBrowserMain()
#10 0x5598c7707fa8 main
#11 0x7f41b7d29830 __libc_start_main
#12 0x5598c77013ea _start

Received signal 6
#0 0x5598c99b2d79 base::debug::CollectStackTrace()
#1 0x5598c9930633 base::debug::StackTrace::StackTrace()
#2 0x5598c99b295b base::debug::(anonymous namespace)::StackDumpSignalHandler()
#3 0x7f41b91e7390 (/lib/x86_64-linux-gnu/libpthread-2.23.so+0x1138f)
#4 0x7f41b7d3e428 gsignal
#5 0x7f41b7d4002a abort
#6 0x5598c99b18f5 base::debug::BreakDebugger()
#7 0x5598c99405b2 logging::LogMessage::~LogMessage()
#8 0x5598c86cfc04 content::BrowserTaskExecutor::CreateIOThread()
#9 0x5598c9699d41 content::ContentMainRunnerImpl::RunServiceManager()
#10 0x5598c9699b76 content::ContentMainRunnerImpl::Run()
#11 0x5598c9697374 content::RunContentProcess()
#12 0x5598c9697cfc content::ContentMain()
#13 0x5598c96e9182 headless::(anonymous namespace)::RunContentMain()
#14 0x5598c96e9025 headless::HeadlessBrowserMain()
#15 0x5598c7707fa8 main
#16 0x7f41b7d29830 __libc_start_main
#17 0x5598c77013ea _start
  r8: 0000000000000000  r9: 0000000000000000 r10: 0000000000000008 r11: 0000000000000206
 r12: 00007ffd84661360 r13: 00007ffd84661bd0 r14: 00007ffd84661be0 r15: 00007ffd84661be8
  di: 0000000000000041  si: 0000000000000041  bp: 00007ffd84660b10  bx: 00007ffd84661be8
  dx: 0000000000000006  ax: 0000000000000000  cx: 00007f41b7d3e428  sp: 00007ffd846609d8
  ip: 00007f41b7d3e428 efl: 0000000000000206 cgf: 002b000000000033 erf: 0000000000000000
 trp: 0000000000000000 msk: 0000000000000000 cr2: 0000000000000000
[end of stack trace]
Calling _exit(1). Core file will not be generated.

[edit by admin: formatting]

robotamp | 23 posts | June 28, 2021, 2:53 p.m. | permalink

The error "Resource temporarily unavailable (11)" normally means that you're trying to start up a large number of processes or threads, and have been blocked from starting up more.

From that message, it looks like this is happening in your scheduled tasks, and I see that you have quite a large number of them. Is it possible that they are not clearing up after themselves and are leaving things running, or that a lot of them are trying to run at the same time? If they are not being cleared up, then you could wind up in a state where after some time you had a lot of processes there, and would not be able to start new ones.

You can see what processes are running from the "Running processes" table at the bottom of the "Tasks" page.

giles | 11800 posts | PythonAnywhere staff | June 28, 2021, 4:35 p.m. | permalink

Awesome - thanks Giles! I just reset many of the processes to space them out a bit - so hopefully that clears it up!

I did also run into this error: Traceback (most recent call last): File "/home/robotamp/plotly_scripts/EIA_API_Stocks_Prod_Kerosene_Jet_R2.py", line 196, in <module> fig2.write_image("plotly_scripts/html_plotly/images/prod_jet.png") File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/plotly/basedatatypes.py", line 3806, in write_image return pio.write_image(self, args, *kwargs) File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/plotly/io/_kaleido.py", line 252, in write_image engine=engine, File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/plotly/io/_kaleido.py", line 132, in to_image fig_dict, format=format, width=width, height=height, scale=scale File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/kaleido/scopes/plotly.py", line 154, in transform figure, format=format, width=width, height=height, scale=scale File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/kaleido/scopes/base.py", line 316, in _perform_transform raise ValueError(message)

---------------------------> is that related or is that a different problem?

Thank you!!

robotamp | 23 posts | June 28, 2021, 4:50 p.m. | permalink

This is the rest of the message: ValueError: Failed to start Kaleido subprocess. Error stream:

/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/kaleido/executable/kaleido: fork: retry: No child processes /home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/kaleido/executable/kaleido: fork: retry: No child processes /home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/kaleido/executable/kaleido: fork: retry: No child processes /home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/kaleido/executable/kaleido: fork: retry: No child processes /home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/kaleido/executable/kaleido: fork: Resource temporarily unavailable /home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/kaleido/executable/kaleido: line 10: ./bin/kaleido: No such file or directory

robotamp | 23 posts | June 28, 2021, 4:51 p.m. | permalink

It looks like it is failing to create a new subprocess, again.

fjl | 4352 posts | PythonAnywhere staff | June 28, 2021, 4:58 p.m. | permalink