You can refresh the contacts list to get updated signal contacts from your address book. I assume signal only does it by itself on a schedule rather than in real time like telegram. I just refreshed and got a few new contacts in a few seconds. Signal has no privacy option from what I see to hide you from people who have you on their contacts. I could be missing something though.