If you think it may have an effect on you, then you should stop drinking it. If you only have it occasionally and count it in your net carb allowance for that day, then maybe it doesn't effect you much. Just see if it triggers cravings the next day, if not, you're probably OK once or twice a week.