Im not sure, it worked for a long time this way. but sofar i remember i did have villagers in all sections. i did a very close checkup and 2 sections are emtpy. There is a change a zombie attacked the villagers in that section and the got despawned. But are there still other way to lose them ?