The agreement comes as US and Russian Presidents George W. Bush and Vladimir Putin were set to meet in the Slovakian capital Bratislava for a summit later Thursday.
Russian Foreign Minister Sergei Ivanov and US Secretary of State Condoleezza Rice signed the agreement, which Ivanov said was "a concrete move of cooperation in the war against terrorism."
Ivanov said "Russia and the United States which are the only makers of these weapons will take measures to get their allies to find against the proliferation of shoulder-fired missiles," in comments reported by the Kremlin press office.
"Russia and the United States agree that in light of terrorism, this is a terrifying weapon," Ivanov said.