The home-made device that was able to kill was shown in images of the gun that was used to shoot Abe.
The 67-year-old died Friday after being shot in the right side of his neck while giving an election-week campaign speech for his former party.
Abe died a few hours after he was taken to the hospital.
The man was arrested on suspicion of attempted murder and a weapon was seized by police.
NHK broadcasted pictures of the weapon lying on the road near the site of the attack. There are pictures of the gun on Japanese social media.
The gun is made from metal barrels and a wooden board with black tape.
Japan has some of the strictest gun laws in the world. Citizens can only buy air rifles and shotguns if they pass a background check.
The suspect in the shooting said he was not happy with Abe NHK.
Hirokazu Matsuno, Japan's chief cabinet secretary, said in a statement that "Outrageous acts of this kind are intolerable, no matter the reason."
All possible measures will be taken by the Government.