The study of microbial communities in river sediments contaminated by thallium (Tl) is necessary to achieve the information for in-situ microbially mediated bioremediation. However, little is known about the microbial community in Tl-contaminated river sediments. In the present study, we characterized the microbial community and their responses to Tl pollution in river sediments from the Tl-mineralized Lanmuchang area, Southwest Guizhou, China. Illumina sequencing of 16S rRNA amplicons revealed that over 40 phyla belong to the domain bacteria. In all samples, Proteobacteria, Cyanobacteria, and Actinobacteria were the most dominant phyla. Based on the UPGMA (Unweighted Pair Group Method with Arithmetic Mean) tree and PCoA (Principal Coordinates Analysis) analysis, microbial composition of each segment was distinct, indicating in-situ geochemical parameters (including Tl, sulfate, TOC, Eh, and pH) had influenced on the microbial communities. Moreover, canonical correspondence analysis (CCA) was employed to further elucidate the impact of geochemical parameters on the distribution of microbial communities in local river sediments. The results indicated that a number of microbial communities including Cyanobacteria, Spirochaete, Hydrogenophaga, and Acinetobacter were positively correlated with total Tl, suggesting potential roles of these microbes to Tl tolerance or to biogeochemical cycling of Tl. Our results suggested a reliable location for the microbial community’s diversity in the presence of high concentrations of Tl and might have a potential association for in-situ bioremediation strategies of Tl-contaminated river. Overall, in situ microbial community could provide a useful tool for monitoring and assessing geo-environmental stressors in Tl-polluted river sediments.