To be a Negro in this country and to be relatively conscious is to be in a rage almost all the time.

He served as the head football coach the University of Rhode Island the University of Maine Duke University Lehigh University and Wake Forest University compiling a career college football record of 41–32–14. This ranks him 13th at Lehigh in terms of total wins and eighth at Lehigh in terms of winning percentage. He also served as the head coach of Duke's basketball program in 1922 compiling a 6–12 record.

He served as the head football coach the University of Rhode Island the University of Maine Duke University Lehigh University and Wake Forest University compiling a career college football record of 41–32–14. Baldwin was also the head basketball coach at the same five schools amassing a career college basketball mark of 85–66. "Jim" Baldwin (May 26 1886 – August 2 1964) was an American football player track athlete coach of football basketball and baseball and college athletics administrator in the United States.