Only the second time in their history, Senegal advanced to the World Cup's knockout stages with a nerveless volley by Kalidou Koulibaly in the second half.
All three of the goals were scored by players based in England, with the only exception of the penalty by the Hornets.
It was a point that was needed to progress, but it was also a point that was paid the price for a passive display.
The African champion scored from the spot after being upended by a defender, after being clumsily upended by another player.
Caicedo scored the first goal of the tournament for Ecuador, but it wasn't long before the lead was back for the Africans, who knew only victory would suffice.
They were runners-up in Group A behind the Dutch, who won the tournament with a 2-0 victory over the hosts.
The winner of Group B will face Aliou Cisse's side in the last 16 of the World Cup.
Get the latest results and goal notifications for any team at the Fifa World Cup by downloading the BBC Sport app: Apple - Android - Amazon
You can get a daily dose of the World Cup on the radio.