The Crown's Josh O'Connor and Alison Oliver seen for first time amid romance speculation in NYC

Rumours of their romance began swirling earlier in November when the pair were seen together in Italy