Madison said that it was impossible to confine a government to the exercise of expressed powers.
But that’s not the same as saying he supported Marshall’s broad construction of that clause. I suggest checking out his letter to Spencer Roane about McCullough v. Maryland or his attack of the Bank Bill. Dr. Gutzman’s Madison book goes through this and is worth buying.