'I'm worried', admits Djokovic as French Open build-up suffers new setback