I got to thinking more about this issue last night - and there may be a solution for you.
Please see the attached file - I was asked to put together a tutorial file on conditionally hiding things (like text) based on user selection, and another file on buttons.
For conditionally hiding things - my solution is generally to use what I call a Mask. This is a shape that uses conditional color, either matching the background or transparent depending on if I want what is under to show or not.
So I decided to combine both tasks, and hide buttons instead of text. But while I was putting together the file, I realized that there might be a solution in this for you. Take a look at the Navigation 2 page on those three tricks - I even managed (using the new Page Navigation action in buttons), to create a button that uses a slicer controlled by RLS (role level security)!
Hopefully, one of these tricks will lead you to a solution for your issue. I’m thinking of redesigning one of my reports to have only a single visible page, and use the Page Navigation to move around instead of the tabs.
Hidden Page Navigation.pbix (57.4 KB)