Horrible rumor. Manny never wanted to fight Bradley in the first place...it was Bob who promised Tim the fight...which was in the spring of 2011, while he was still fighting under Shaw's banner.
Im not sure if the first Bradley fight was his last fight under his contract, but Manny started making complaints about his pay after Floyd's guaranteed $32M purse against Cotto surfaced a month prior. Manny was being resistant when the Bradley fight was brought to the table, and yes, he was threatening to "sit out".
Bob kept him honest by hardly lifting a finger to promote the fight, and ultimately making sure that he came up short on the card. In the event that Manny came up short on the cards, he couldn't ask Bob for more money, because Bob;s response would've simply been, "Hey kid, there's not enough money out there and you just lost your last fight".
Mind you, all of this was going on shortly after Visionquest was booted out of the picture. Manny's gonna end up on 30 for 30 in the next few years.