A Practical Guide to Scalable Job Scheduling for Cloud and Big Data

Machine learning teams often struggle to find the right way to schedule jobs. A scheduler is a service that manages a queue of jobs, submitting them based on predefined criteria. In an ideal world, we would have an API with requests and responses, a NoSQL database to store metadata and status updates, and integrations with downstream services.