High infant mortality in those days. Especially when locked in cold dark towers and not fed much, the connection between food and staying alive was not well understood then.
So you think accidental? I think it's possible. They weren't infants so its hard to say it was just because of the times. But then again, Edward of Middleham, Prince of Wales, Richard III's son died suddenly.