I don't think there is any reason for you to bring the topic up. As long as you are responsible with your gun ownership and use reasonable discretion there is no reason for your gun ownership or interest to be anyone else's business (unless you want it to be). It has never been an issue for me where on my street many kids live. They are completely safe as I am a very responsible gun owner. My interest does not affect the day to day life of my neighbours nor their kids.