It does not matter how often you travel abroad during the period of validity of your residence permit, it only matters how long you stay abroad in total.

You may stay up to 3 months abroad each year during the validity period of your residence permit, from the issue date of the permit. If you stay abroad for longer periods, this may affect your continuous stay in Iceland and therefore your right to a permanent residence permit.