Microsoft Teams - Turn off announcement for callers joining/leaving

As the meeting organizer, you can turn off the setting to announce when phone participants join and leave the meeting.

In your Teams meeting, go to More (three dots icon) --> Settings --> Meeting options, as shown below:

Then, toggle off the "Announce when callers join or leave" setting.  Scroll down to click Save.