update_job_scheduler_ids_by_task
#TODO do this after the all batches for a single job have been passed
#DEPRACATED job_scheduler_ids_by_array
for job at jobs for batch at batches for task at tasks
assign_scheduler_deps
Jobs should only depend upon all jobs they need - not all jobs from the previous dep
update_scheduler_ids_by_array
Update the scheduler ids by the task/batch
#TODO There must be a better way to do this
index_in_batch
Using job arrays each job is divided into one or batches of size self->max_array_size
max_array_size = 10 001_job.sh --array=1-10 002_job.sh --array=10-11
self->jobs->{a_job}->all_batch_indexes
job001 => [
{batch_index_start => 1, batch_index_end => 10 },
{batch_index_start => 11, batch_index_end => 20}
]
The index argument is zero indexed, and our counters (job_counter, batch_counter) are 1 indexed
scheduler_ids_by_batch
##DEPRACATED