The comments came up during a panel discussion on how Americans' varying perceptions of immigrants, immigration, and the necessity of a border wall.
Brokaw began by saying that Americans "on the Republican side" view Hispanic immigrants as people "who will come here and all be Democrats."
He continued: "I hear when I push people a little harder, 'I don't know whether I want brown grand-babies.' I mean, that's also a part of it. It's the inter-marriage that is going on and the cultures that are conflicting with each other. I mean, that's also a part of it. It's the inter-marriage that is going on and the cultures that are conflicting with each other."
Brokaw they offered up his own opinion on Hispanic immigrants, arguing that they should take responsibility for integrating themselves and their children into their communities.
"I also happen to believe that the Hispanics should work harder at assimilation.