After poll defeat, Vijayakanth to listen to his partymen