No-one else can see which groups you are a member of, except the groups you share with them directly.
Example: Let’s assume that you are a member of Group A and Group B, and Anna is a member of Group B. Anna can see you in Group B as you are both part of it, but there is no way for her to know that you are a member of Group A, or even that Group A exists.