In their first game of the season, they beat Bournemouth to move to the top of the league table.
The first 10 minutes were dominated by captain Martin Odegaard, who scored two goals.
Gabriel Jesus' goal was ruled out by the VAR for being in an ineligible position.
The last time they won their first three games was in 2004.
There was a rousing feel to this Saturday's teatime kick-off at the smallest ground as Bournemouth won their first home game in the premier league.
It took just five minutes for that feeling to be shattered as Odegaard tapped in after the Bournemouth keeper had stopped Gabriel Martinelli's strike.
The NorwayMidfielder struck again shortly after when he grabbed the ball off Jesus' toes and swept a clinical left-footed finish past the helpless Cherries keeper
The winning goal was scored by the impressive Saliba from the edge of the penalty area.
Jesus was denied a deserved goal by a tight VAR review that ruled that he was not in a good position to score.
The early days of the season are very early and there are many harder tests to come, but the team has laid down a marker with their good start to the season.
For the first time since the 2003-04 season, when they won the league, Arteta had no problem naming the same starting line-up for this game.
From the kick-off it was obvious that confidence is high and the early opener was reward for fine build-up, including a run from Jesus to create the chance for Martinelli.
When he doubled the lead five minutes later, his quiet influence on this side was clear.
Young France centre-back Saliba has won plenty of plaudits already this season and capped another fine performance with a delicious strike into the top corner.
The only thing missing from a perfect away day was a Jesus goal, the Brazil forward having one disallowed before being denied by a fine Travers save.
They have a chance to make their presence known at the top of the table with an appealing run of games.
Ben Pearson, Jefferson Lerma and Kieffer Moore were included in Bournemouth's physical side in order to unsettle their opponents.
They were unable to get out when they were penned in their own half. The changes at the break brought a brief improvement, only for Saliba's strike to squash them again.
After Marcos Senesi was given a rough time by Jesus on his Bournemouth debut, the Cherries are in need of reinforcements.
When Dominic Solanke is fully fit, they will have more mobility, but against this class of opposition, the squad is not up to par.
It's going to get worse before it gets better for the team.