Each User has to pick his or her own delegates. Delegates can only be selected by each individual user. In other words, other users cannot specify your delegates for you. This is a security feature of Tracker. The access controls of the system would be unreliable if other users could specify your delegates on your behalf -- you would never know who has access to your matters or who granted them access.