Im trying to get the popularity contest achievement in fable 3 but it keeps restarting, what am i doing wrong?

i am queen, and i notice that allot of the villagers say their my friends, why doesn't that go toward my achievement