Justin Baldoni has opened up about his "lonely" experience directing 'It Ends With Us'