In this study, genome-wide association analysis was performed on the growth traits (body height, body length, chest circumference, chest depth, chest width, tube circumference, and body weight) of Inner Mongolian cashmere goats (Erlangshan type) based on resequencing data. The population genetic parameters were estimated, haplotypes were constructed for the significant sites, and association analysis was conducted between the haplotypes and phenotypes. A total of two hundred and eighty-four SNPs and eight candidate genes were identified by genome-wide association analysis, gene annotation, and enrichment analysis. The phenotypes of 16 haplotype combinations were significantly different by haplotype analysis. Combined with the above results, the TGFB2, BAG3, ZEB2, KCNJ12, MIF, MAP2K3, HACD3, and MEGF11 functional candidate genes and the haplotype combinations A2A2, C2C2, E2E2, F2F2, I2I2, J2J2, K2K2, N2N2, O2O2, P2P2, R1R1, T1T1, W1W1, X1X1, Y1Y1, and Z1Z1 affected the growth traits of the cashmere goats and could be used as molecular markers to improve the accuracy of early selection and the economic benefits of breeding.