Bush said "You're either with us, or, you're against us". Clearly, he wasn't referring to the US ally, Israel. From Arab States Insist Normalization with Israel Not on the Agenda at Conference:
Arab League Secretary General Amr Moussa said before leaving for Annapolis that the league's decision to send its foreign ministers to the conference does not mean normalizing relations with Israel. Andre Azoulay, senior adviser to King Mohamed VI of Morocco, told Ha'aretz Sunday that the summit's purpose in his view is to signal to all the people in the region that it is possible to revive peace efforts, but that it would be a mistake to expect steps toward normalization immediately after the conference.