Ingestion is sequential which means it is blockable #149
Description
Since the ingestion process is sequential, if a message fails to ingest and fails the process the next time the process runs it will attempt to process the same message. This means that the process may go completely stuck because of one wrong/bad message,
We should only retry one message a limited number of times.
We could try and see what we have stored in the process field to determine how many times a message has been attempted. If such info is not available in plain in process we could define a separate field where we store that.