In his Grundgesetze, Frege hints that prior to his theory that cardinal numbers are objects (courses-of-values) he had an “almost completed” manuscript on cardinals. Taking this early theory to have been an account of cardinals as second-level functions, this paper works out the significance of the fact that Frege’s cardinal numbers (as objects) is a theory of concept-correlates. Frege held that, where n>2, there is a one–one correlation between each n-level function and an n-1 level function, and a one–one correlation between each first-level function and an object (a course-of-values of the function). Applied to cardinals, the correlation offers new answers to some perplexing features of Frege’s philosophy. It is shown that within Frege’s concept-script, a generalized form of Hume’s Principle is equivalent to Russell’s Principle of Abstraction – a principle Russell employed to demonstrate the inadequacy of definition by abstraction. Accordingly, Frege’s rejection of definition of cardinal number by Hume’s Principle parallels Russell’s objection to definition by abstraction. Frege’s correlation thesis reveals that he has a way of meeting the structuralist challenge (later revived by Benacerraf, 1965) that it is arithmetic, and not a privileged progression of objects, that matters to the finite cardinals.