Chris Silverwood has been appointed as the men's head coach.
Silverwood left his job as head coach of the England men in February after they were beaten in Australia.
He led Essex to their first County Championship title in 25 years.
Silverwood will take charge of the side for the two-Test tour of Bangladesh in May after signing a two-year deal with Sri Lanka.
Silverwood said that he was very excited to be on board.
They have a talented and passionate group of players and I am looking forward to meeting them soon.
Silverwood was the bowling coach for England before he replaced Bayliss.
England struggled in Test cricket during his tenure, including a four-run loss to Australia.
In their recent series against India, Sri Lanka were beaten 2-0.
They have been without a full-time head coach since December.
Chris is an extremely experienced coach and from our discussions with him it is clear he has the required qualities we are looking for to take the team forward.