Simply saying, a scheduler is a software utility responsible for assigning jobs and tasks to resources according to pre-determined policies and availability of resource. A job can be comprised of one or more tasks along with relevant information on the required resources (number of nodes, GPUs, network bandwidth, application license etc.). Jobs are submitted to a queue for proper batch processing and optimization of resource utilization (for example, using nearest nodes instead of far-connected nodes). There may be one or more queues, each with policies around priorities, permissions etc. There are multiple options for job schedulers – commercial (close source) and open source.



0 responses so far ↓
There are no comments yet...Kick things off by filling out the form below.
You must log in to post a comment.