Im mad keen on bikes as well mate and just recently sold my 1000RR Blade, used to love going out for a good blast but wife and daughter used to be worried sick everytime i went out
As much as i loved the bike i love my family more and relented and sold the bike
The gulity feeling of how worried they were about me being on it became greater then the feeling of enjoyment so wasn't really a hard decision to make in the end.
Bikes are stupidly fast and addictive but are also quite selfish as its just yourself that gets the enjoyment while others have all the worry.
With a young family member that it looks like you have just got i would say to give it a lot of thought and consider the risks and think how your wife and kid will feel if anything were to go wrong.