The verse: "Those who invoke not with Allah" applied to polytheists. He said: About them another verse, "Say: O my servants who have transgressed against their souls" was also revealed.
وَنَزَلَ { يَا عِبَادِيَ الَّذِينَ أَسْرَفُوا عَلَى أَنْفُسِهِمْ }