Due to faulty reconnaissance Baldwin severely underestimated the size of the Egyptian army, believing it to be no more than a minor expeditionary force, and rode to face an army of several thousand with only two hundred mounted knights and no infantry.

Realizing his error too late and already cut off from escape, Baldwin and his army were charged by the Egyptian forces and many were quickly slaughtered, although Baldwin and a handful of others managed to barricade themselves in Ramla's single tower. Baldwin was left with no other option than to flee and escaped the tower under the cover of night with just his scribe and a single knight, Hugh of Brulis, who is never mentioned in any source afterwards. Baldwin spent the next two days evading Fatimid search parties until he arrived exhausted, starved, and parched in the reasonably safe haven of Arsuf on May 19.