An online algorithm processes the input only piece by piece and doesn't know about the actual input size at the beginning of the algorithm. (So MDP?)
An offline algorithm on the other hand works only with complete input data. All workload must be known before the algorithm starts processing the data.