Traditional Chinese medicine polysaccharides have numerous biological activities with broad applications in the biomedical industries. However, a clear understanding of the pharmacological activities of compound polysaccharides with multi-component structures remain challenging. This study aimed to investigate the immune boosting effect of compound polysaccharides on the influenza vaccine and assess the preliminary structure-activity relationship. The compound polysaccharide (CP) was isolated from the combined Chinese herbs lentinan, pachymaran and tremellan, and purified by gradient ethanol precipitation to obtain its subcomponents of CP-20, CP-40, CP-60, and CP-80 with decreasing molecular weights. These polysaccharides were mainly composed of glucans with different linkage patterns, including α-(1 → 3)-glucan, α-(1 → 4)-glucan and β-(1 → 6)-glucan. A significant improvement was observed in the survival of mice vaccinated with inactivated (IAV) vaccine and the isolated polysaccharides as adjuvants. A reduction in the pulmonary virus titer and weight loss were also observed. Moreover, CP-40 and CP-60, as well as the original CP, significantly enhanced the serum anti-IAV antibody titers and interleukin IL-2, IL-5, and IL-6 concentrations. These preliminary results indicate the immune boosting effect of the compound polysaccharides is highly relevant to the specific structural properties of the subcomponent, and CP-40 is worthy of further exploration as a glycan adjuvant for the IAV vaccine.