Shivakumar says he too was not silent and that many leaders from the saffron party are in touch with him.