Recent work has suggested that anxiety restricts working memory capacity, which may underlie a wide range of cognitive symptoms in anxiety. However, previous literature on the anxiety-visual working memory association yielded mixed results, with some studies demonstrating an anxiety-related increase in visual working memory capacity. In an attempt to gain a more thorough understanding of the relationship between anxiety and visual working memory maintenance function, the current study examined the influence of trait anxiety on visual working memory capacity and resolution for negative, positive, and neutral faces in a large unselected sample, by conducting two different experiments. Experiment 1 used a change-detection task to estimate visual working memory capacity, while Experiment 2 used a modified time-delay estimation task to measure memory precision. Hierarchical linear modeling was used to analyze the relationship between trait anxiety, emotional valence, and visual working memory. Results showed that trait anxiety was associated with decreased visual working memory capacity for faces in a valence-independent manner, whereas anxiety-related change in visual working memory resolution was not significant. This pattern of results was discussed in light of the theories of anxiety and visual working memory.