What is the difference between infinite horizon and indefinite horizon problems?
In infinite horizon problems the agent continues performing actions forever. In indefinite horizon problems the agent will eventually stop performing actions (at some unknown time).