See heres my thought,
The hooded women had human parents. So is it possible she had another sibling that we have not seen or heard about? That maybe the hooded women told that sibling to become a hunter. So maybe that sibling had a family, and carried on for generations. And supposedly since zero comes from a great hunter family, it is because of the Hooded Women's family line. And my guess is that its Zeros mother that is from the great hunter family line. Because I happened to watch the anime again and Zero's mother in it looks like the hooded women! (her hair color)
And maybe that's why Zero can control the bloody rose well and that's why he knew about how the bloody rose and kaname "go way back".
Remember this is all a thought. And I just want opinions on this, and if you also think its possible.