Aphasia is most common in adults who have had a stroke. Brain tumors, infections, injuries and dementia can also cause it. The type of problem you have and how bad it is depends on which part of your brain is damaged. It also depends on how much damage there is.