Uncovering The Potential Of Federated Learning: Addressing Algorithmic And Data-Driven Challenges Under Privacy Restrictions