You didn't specify what type of primer was used on the cabinets, or if the surface was cleaned and sanded. The best primer is oil, or white shellac (BIN). If you used latex primer, that's likely part of the reason the finish is weak and rubbing off. You're also cleaning the cabinets way too soon after painting them. The paint is soft at first and needs to harden more before you can clean it with water. Paint takes a good thirty days to fully cure. You should wait at least a couple of weeks before wiping down the fresh paint with water. Having worked with this product many times, I suspect the paint rubbing off like that is more than likely a result of exposing the fresh paint to water, or the wrong primer was used. If you didn't sand too, the surface could have been too smooth and glossy, and that could have contributed to the problem.