Im not sure, it worked for a long time this way. but sofar i remember i did have villagers in all sections. i did a very close checkup and 2 sections are emtpy. There is a change a zombie attacked the villagers in that section and the got despawned. But are there still other way to lose them ?
I Recommend Putting Glass over the villagers because they should not be disappearing like that then u can tell if the glass is broken if someone took them
The are surrounded by stone brick , glass and wood. the other ones still exist. Mabey i have removed it in the past myself because it did not do much more then less villagers. and less is still better if it works. The have neough space to, so the don't sufficate.