Followers are people that follow your profile without being in your friends list. In this way, none of your friends can appear both in your friends list and your followers list. If you add one of your followers, this person is still following you, but your amount of followers has indeed been decreased while your friends one increased.