3. How It WorksΒΆ

  • Executor Context: The Executor context manages all cluster configurations and task execution.

  • Submit a Job: The method submit configure a delayed job to the Executor.

  • Start the Job: You can either start the job manually with the start method attached or call the Executor instance to run all jobs. With the last method, you can control concurrency by setting max_jobs to limit the number of tasks running simultaneously. Note that it is possible to only generate the batch file associated to a job using the generate_batch method.

  • Execution Reporting: Once the job completes, the result is retrieved in the Executor instance report property.