Justice Kavanaugh says unpopular rulings can later become 'fabric of American constitutional law'