I took him to the vet when it was time to have his vaccinations and the vet said it was a lymph node. It's totally normal and nothing to worry about. He also told me that Ally has them too it's just since he is smaller it's easier to feel it on him.
Thanks everyone for your replies