So, I'm directly asking for permission to drop it.
Yes, please do. Code golf is too code specific for PSE and belongs on SO, IMO.
Most of my response is in the question I posed on Meta Stack Overflow, but it's so completely out of place here. Our de-facto elevator pitch involves saying Programmers.SE is for all those things about programming that aren't actually programming, and Code Golf is programming (albeit fun programming).