The La Porte County Health Department issued a Swim with Caution Advisory for New Stone Lake Beach on Tuesday after water at unsatisfactory levels of bacteria.