Jo Koy insists his Taylor Swift joke at Golden Globes was a ‘compliment’