If I am not the doer, I am in control of Triguna Sattva, Rajas and Tamas, and these Gunas fashion the work I do, and if whatever I will do in my life is already predefined.
Then why am I accused of my Karmas? Why do I have to pay for the Punyas or Paapas of my Karma, when everything is already decided by Lord, is fashioned by the three Gunas, and when Lord is the doer.