"On clay, it felt like I was stepping into your backyard, and you made me work harder than I ever thought I could just to hold my ground," Roger Federer said