The defining characteristic of an exceptional point (EP) in the parameter space of a family of operators is that, upon encircling the EP, eigenstates are permuted. When one encircles multiple EPs, the question arises how to properly compose the effects of the individual EPs. This was thought to be ambiguous. We show that one can solve this problem by considering based loops and their deformations. The theory of fundamental groups allows us to generalize this technique to arbitrary degeneracy structures like exceptional lines in a three-dimensional parameter space. As permutations of three or more objects form a non-Abelian group, the next question that arises is whether one can experimentally demonstrate this noncommutative behavior. This requires at least two EPs of a family of operators that have at least three eigenstates. A concrete implementation in a recently proposed PT symmetric waveguide system is suggested as an example of how to experimentally check the composition law and show the non-Abelian nature of non-Hermitian systems with multiple EPs.