Prime Minister Narendra Modi had first talked about his government's aspiration to host the 2036 Olympics last year