You will need to modify SAML IdP server to send user's group membership details as SAML Attributes to SMA. Note down the SAML Attribute/claim name that carries the user-group list.
For details on how to send User Groups, see Sending User Groups to SMA.