Good question. No, you won't be dinged for talking to people.

It's more that you are in a section of Medium readers that isn't paying as much as it used to and/or that the engagement you got back is now paying much less. Writing that breaks out of this section of readers/engagement is paying what it used to. That's what the guy you talked to is experiencing (along with his contacts).