On 2 May a crowd began to gather in front of the Royal Palace in Madrid. Those gathered entered the palace grounds in an attempt to prevent the removal of Francisco de Paula. Marshal Murat sent a battalion of grenadiers from the Imperial Guard to the palace along with artillery detachments. The latter opened fire on the assembled crowd, and the rebellion began to spread to other parts of the city.

What followed was street fighting in different areas of Madrid as the poorly armed population confronted the French troops. Murat had quickly moved the majority of his troops into the city and there was heavy fighting around the Puerta del Sol and the Puerta de Toledo. Marshal Murat imposed martial law in the city and assumed full control of the administration. Little by little the French regained control of the city, and many hundreds of people died in the fighting. The painting by the Spanish artist Goya, The Charge of the Mamelukes, portrays the street fighting that took place. The Mamelukes of the Imperial Guard fighting residents of Madrid in the Puerta del Sol, wearing turbans and using curved scimitars, provoked memories of the Muslim Spain.

There were Spanish troops stationed in the city, but they remained confined to barracks. The only Spanish troops to disobey orders were from the artillery units at the barracks of Monteleón, who joined the uprising. Two officers of these troops, Luis Daoíz de Torres and Pedro Velarde y Santillán are still commemorated as heroes of the rebellion. Both died during the French assault of the barracks, as the rebels were reduced by vastly superior numbers.