Sound like you were just trying to keep yourself interested to me. I doubt playing a few maths games is going to screw your son up. As long as you keep them reasonable even with their peers they should get okay socially. Put all youe effort into making them good human beings and they will want to learn anyway.