Welcome to YT!!
Is there an odor to the brown stuff? If so, for sure go to the vet. Also, if he is scratching at the inside of his ears.
You might just need to use some ear wash. This is the brand I use - my holistic vet carries it
Zymox Ear Cleanser (4 oz)