He said in October that he may have to forego his "massive desire" to go to Rio 2016 in favour of turning professional.
Ogogo's exploits in London dramatically raised his profile and attracted the attention of numerous promoters, including former world champion Oscar De La Hoya's Golden Boy organisation and the Barry Hearn-owned Matchroom Sport.
He opted to join Golden Boy, who say the Briton is likely to make his professional debut in Brooklyn on 9 February against an opponent yet to be decided.
GB's Ogogo beats world number one
"Anthony Ogogo has everything you look for in a boxer," said Golden Boy chief executive Richard Schaefer.
"He can fight, he has style and charisma and he has amazing crossover potential.
"I have no doubt that Anthony has the skills in the ring and the personality outside of it to make him a global boxing star.
"We are proud to have him on our team and this is just the first step in our growing commitment to British boxing."
"It has been very good working with Anthony over the last three years and he did extremely well to win a medal at the 2012 Games," said GB Boxing Performance Director Rob McCracken.
From the football field to the boxing ring
Anthony Ogogo played for Norwich City FC as a junior but has been competing in the boxing ring since the age of 12
"It is disappointing for us that Anthony has decided his future lies away from the GB Boxing squad but he departs with our best regards and we wish him every success in his future career."
Ogogo's honours list also includes a European silver medal (2012), Commonwealth Games silver medal (2010) and Junior Olympics gold medal (2004).
This page is best viewed in an up-to-date web browser with style sheets (CSS) enabled. While you will be able to view the content of this page in your current browser, you will not be able to get the full visual experience. Please consider upgrading your browser software or enabling style sheets (CSS) if you are able to do so.