The way i see it is the character need to channel his energy in the summon wich is the main reason why he cannot do shit while the summon is there so basicly he would either be temporarly gone or a sitting duck while the summon is there and im sure everyone would agree on that.