step back and further out on the windward rail and tilt the rig back and sheet inthat should mostly do it - In my experience teaching (which was a while ago!) I remember most people had the opposite problem i.e. they couldn't bear away without getting pulled over the front...
I'm not sure about your step further out on the windward rail as this may cause you to bear away on a long board with daggerboard - opposite to a planing board with no daggerboard.
If you look up flare gybe technique you should see that to initiate the turn you put the rig forward (dicey bit!) and sink the windward rail - if you have a daggerboard fully down and some speed this will have an enormous effect to the point where if you're not ready the board will gybe & you will carry on....
let us now how you get on