Patel warns of risks from Brexit, US polls