Forums

I'm trying to run a short statistical process. It loads a 500MB dataset that should fit in memory (I read somewhere that 2GB of ram per console?). It is consistently killed while loading the dataset.

Is there anything that I can do to actually get it to complete? The job should take < 30 seconds. Do I need a further upgraded plan?

Thanks!

If it's a 500MB dataset, it's possible that it needs more memory than that to run -- in-memory data formats can be larger for performance purposes, for example.

Is there any way you can split it up into smaller bits for processing?

Thanks, I reworked the problem to use smaller chunks and it seems to be running as desired.