If anybody else is confused about the Add & Replace/Only Active Keying Set option not showing up underneath the Keying dropdown, I found it underneath the auto keying record icon dropdown in this screenshot
Thought I was going crazy because my Y kept reappearing. Thank you!