If you do it this way with quartering the 5mgs you will have guaranteed success. The problems with the tremors is probably the worst problem with reducing these medications as it can prevent sleep and that is not good. But in little steps like this it will most likely be no problem.
Best to you, you can do it!