Forums

Scheduled Tasks

So - I have a new error that I haven't encountered before:

rm: cannot remove '/mnt/chroots/robotamp/earlgrey/dev/shm': Device or resource busy OpenBLAS blas_thread_init: pthread_create failed for thread 1 of 4: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 128 current, 128 max OpenBLAS blas_thread_init: pthread_create failed for thread 2 of 4: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 128 current, 128 max OpenBLAS blas_thread_init: pthread_create failed for thread 3 of 4: Resource temporarily unavailable OpenBLAS blas_thread_init: RLIMIT_NPROC 128 current, 128 max Traceback (most recent call last): File "/home/robotamp/plotly_scripts/EIA_API_Stocks_CL_Commercial_R2.py", line 11, in <module> import pandas as pd File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/pandas/init.py", line 11, in <module> import(dependency) File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/numpy/init.py", line 145, in <module> from . import core File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/numpy/core/init.py", line 22, in <module> from . import multiarray File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/numpy/core/multiarray.py", line 12, in <module> from . import overrides File "/home/robotamp/.virtualenvs/myvirtualenv/lib/python3.7/site-packages/numpy/core/overrides.py", line 7, in <module> from numpy.core._multiarray_umath import ( KeyboardInterrupt

This task worked fine the day before??? If I have several tasks at the same time does that make a difference?

We limit the number of threads and processes that you can have at the same time. So, if you have a number of tasks that are all starting a bunch of processes or threads, then the later ones will not be able to start.

@glenn I've recently noticed the same error on my scheduled task.

We limit the number of threads and processes that you can have at the same time.

What do you mean? Do always-on tasks count as part of the limit? And what is the limit?

We have to limit the number of concurrent processes that you have, as otherwise people could write fork bombs to take down the servers where your code runs. The limit is 128 processes or threads (from the viewpoint of the Linux kernel, a thread is just a different kind of process), and there are separate limits for scheduled tasks and always-on tasks.