This is often controlled from templates in the header of talk pages using the __NOINDEX__ keyword. Since the content of discussions is however moving to Topic namespace, there will have to be the ability to control this per topic. (possibly inherited from a discussion page? possibly individually ?).

See also:

• T28118: Shouldn't let any Thread to be indexed when __NOINDEX__ is added to the introduction (header) of a page