Is Q-learning categorized as an on-policy or off-policy reinforcement learning algorithm?

Off-policy

Q-learning is off-policy because it learns the value of the optimal policy independently of the agent's current actions (which might follow an exploratory epsilon-greedy strategy). In contrast, SARSA is an on-policy algorithm.