I don't think they can get rabies just from going potty outside. But they can get decease's from other animal feses and urine such as
Leptospirosis that they should be vaccinated against expectably if you live in areas where wild animal frequent. Still they are never too young to start the potty training process. Outside that is! Don't leave them unattended, just keep watch full eye over them.