This verse clarifies the condition of his giving up his body. “When he left with his body (sva-tanva)” means according to Sridhara Svami “leaving to Vaikuntha with his body.” He gave up the earth by means of his body. It does not mean “He gave the earth along with his body.” That is a wrong interpretation, because of the rule upapada-vibhakteh karaka-vibhaktir baliyasi: instrumental meaning of inflection is stronger than the meaning “accompanying.”

pradarsyatapta-tapasam avitrpta-drsam nrnam
adayantar adhad yas tu sva-bimbam loka-locanam

The Lord, having shown his form, the center of attraction for all eyes, then took that form and disappeared from the men, who had not performed austerities but had attained the Lord's mercy, and were continually craving a vision of his form. SB 3.2.11

In this verse after showing his form (sva-bimbam) to the eyes of the world, he again withdrew it and disappeared. The verse does not say he gave up a body. The Krsna-sandarbha makes this point. From that moment onwards (tadahah), Kali entered those with sleeping intelligence. Kali did not affect those who had discrimination. The thief steals wealth from a sleeping person, but is afraid to steal from someone awake.