Filter slicer: Hide "All" option in menu dynamically if RLS provides only one entry

Working with RLS I have constellations where for one user the filter slicer option "All" is meaningful (as multiple entries are available according to his access), but for others not (as only one entry is avaiable due to their access restriction). In that second case (only one entry left) it would be great, if the "All" selection option would disappear in the filter slicer - so that automatically the only remaining value would be shown / be selected (e.g. in the dropdown view).