Four royal family members have reportedly been invited to Christmas in California