No, you can’t assume that. Besides the native Brazilians, there are descents of Germans, Italians, Polishes, Portugueses, French, Japanese, Ukrainians, Russians, Spanish, Argentinians, Uruguayans (among another contrives from South America), Africans and so go on. I’d say that most people in Brazil are descendants from Portugueses.
Fact: the Brazilian passport in the Black Market can be one of the most expensive because, literally, anyone can be Brazilian.