Worry needlessly
• Skate on thin ice
• Take an unnecessary risk
• Take unnecessary risks
• Wake sleeping dogs, so to speak