What brand are the cam bearings?
If that front bearing ends up being removed, then mic the cam hole in the block without the bearing and insure the hole is within specification. If you’re having trouble with all the cam bearings in regard to fit, then check all the hole sizes. Undersized holes will make for a tight clearance when a standard sized cam bearing is being used. Scraping the bearings seems to be the normal fix but in the extreme cases, remachining the outside diameter of the bearing is the more prudent fix.
On a more complicated level is the cam bore alignment in the block. This would appear to show up more frequently on the 312 blocks but it's rare to see this on the 272/292 blocks. If this is found during the initial engine assembly, then the bearings can be offset ground on their O.D.’s and clocked appropriately in the block to fix this particular problem. The other option is re-boring the cam holes to a larger size to insure straightness throughout and custom making a new set of cam bearings.

Lorena, Texas (South of Waco)