Those toms may have already been whupped on by a dominant tom. In that case they'll likely be a little skittish around another gobbler. They don't have it in'em to pick a fight.
Somebody (Primos?) makes an undersized full bodies gobbler decoy. The smaller size is supposedly less intimidating and more likly to entice a bigger gobbler to come in.
I have a decoy set of a tom, a jake and a hen. I've put them out in all combinations. The best placment I've found for my tom & jake decoys is in my closet. I've only had luck when the hen was placed alone.
Maybe it's me, maybe it's the decoys, maybe it's the turkeys.