Algorithmic Verification Problems In Automata-Theoretic Settings