What is Azkaban?

Azkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows.

What is Azkaban scheduler?

What happens when I upload a job to Azkaban?

Job names must be unique in a project. Azkaban will validate the contents of the zip to make sure that dependencies are met and that there’s no cyclical dependencies detected. If it finds any invalid flows, the upload will fail. Uploads overwrite all files in the project. Any changes made to jobs will be wiped out after a new zip file is uploaded.

What happens when I upload a zip file to Azkaban?

Azkaban will validate the contents of the zip to make sure that dependencies are met and that there’s no cyclical dependencies detected. If it finds any invalid flows, the upload will fail. Uploads overwrite all files in the project. Any changes made to jobs will be wiped out after a new zip file is uploaded.

Azkaban was a fortress on an island in the middle of the North Sea. It served the magical community of Great Britain as a prison for convicted criminals. Azkaban was built in the 15th century and it had been in use as a detention facility since 1718.

How does Azkaban obtain Name Node token and Job Tracker tokens?

Before executing a job, Azkaban will obtain name node token and job tracker tokens for this job. These tokens will be written to a token file, to be picked up by user job process during its execution.

Is Azkaban unplottable?

Using certain Charms, Azkaban is hidden from the Muggle world, and is Unplottable . As of Eldritch Diggory ‘s visit in the 1730s or 1740s, a graveyard had been established on the island to accommodate those who have died in the prison.