During the period you mention, Egypt was a multicultural entity and would have includeded collections of citizens from several areas. Nubians made up a strong contingent of the Egyptian population who, naturally, lived in Lower Egypt. Coincidentally, this is where the majority of Egyptian temples were and as you say you lived during this period as a priest or temple servant, it fits the pattern.