I’d say the closest drugstore alternative out right now would be NYX’s Brow Gels! They are waterproof, long lasting and more creamy like Anastasia Dip Brow Pomade. NYX’s is more of a gel rather than a cream but you can still get a really similar finish as the Dip Brow!
You could even use water poof gel eyeliner! The only downside to that is you really only have different shades of brown to choose from but using a gel liner will give a similar finish as Dip Brow.