I am so sorry for your loss
It sounds like you did all you possibly could do, so please don't feel guilty. A lot of us here have lost a little one, myself included, and know how devastating it is. Only thing that helps is time, really.
Welcome to YT, sorry it's under such sad circumstances.