Learning to take it as deep as possible