Question:Can you specify team member to have access to specific clients only?

Answer: Yes, you have to customize via  manage access and  team access 

To check who are the team under your firm, Press gear wheel > team