The issue is how do you reduce the budget effectively. You can fire congressmen and scream for it, but it's not going to happen and you end up going backward instead of forward. The budget was cut under McCarthy which is good considering the President and Senate are under Democrat control, and the House has a very slim majority. The chaos created in Congress isn't going to help bring down the budget, rather there's a chance it actually increases the budget. Would you trade firing McCarthy for a democrat president, house, and senate in 2024?
The chaos it created will turn off Independants and moderate Republicans where some won't vote in 2024. It's going to be a close race for the Presidency, House and Senate and every vote is needed. If a government shutdown occurs the Republicans will be blamed and you'll have Federal workers, military servicemenbers, and businesses with government contracts not getting paid. They'll get backpaid when the shutdown is over, but that military family isn't going to be happy when they don't get a paycheck for a month or two.
The other issue is it takes the focus away from Biden and Democrats bumbles. 100% of the spotlight should be on their mistakes, not the Republicans creating their own chaos. That's one of the reasons why Trump lost and Redwave didn't happen in 2020 and 2022.
A balanced budget takes time to accomplish and there's many difficulties with it. First you need to win the Presidency, Senate, and House by a good margin. To do that, you need the votes from the people. But you lose votes if you make major cuts in spending or increase taxes. Everyone wants lower spending as long as it doesn't affect themselves. The most conservative Republican's will be pissed if you cut their social security check or they lose their job.
Cuts can be made, but it has to be over time or else you lose votes. If you piss off too many people, they'll just vote the other way and reinstate spending again.