Scalable Supervision For Safe And Efficient Online Robot Learning