I don't really like kids. I didn't really like kids when I was a kid. And that largely gets worse the older they get, up until they start pushing 30 or so.
You can state that "my attachment to my kid has nothing to do with how I feel about kids in general" but the way you've phrased it makes it generalized and you apply it to the generic you. Talking about "your attachment to your kid" reads very much like lecturing me about how you're telling me I'll feel.