Deep learning based frameworks for patient selection