If you joined the fence up would you "have" to take down the tree. On the pictures it looks like you could just push the branches behind the new fence.
Do you know what I mean?
I hope your neighbour is a little more understanding next time you ask them, after all you shouldn't have to have your baby on a lead while in your own garden
p.s i love the decking on the house behind, we're getting something like that soon