The treatment of Klebsiella pneumoniae is faced with challenges demanding the development of a vaccination strategy. However, no approved and globally available vaccine exists yet. This study aimed to systematically review all published data on K. pneumoniae vaccines in animal models. Without time restrictions, electronic databases were searched using appropriate keywords. The retrieved studies were screened and the data of those that matched our inclusion criteria were collected and analyzed. In total, 2027 records were retrieved; of which 35 studies were included for systematic review. The most frequently used animal model was BALB/c mice. Proteins, polysaccharides, and their combinations (conjugates) were the most common vaccine candidates used. The amount of antigen, the route used for immunization, and the challenge strategy was varying in the studies and were chosen based on several factors such as the animal model, the type of antigen, and the schedule of immunization. Almost all studies claimed that their vaccine was effective/protective, indicated by increasing survival rate, reducing organ bacterial load, and eliciting protective antibody and/or cytokine responses. Altogether, the information presented here will assist researchers to have a better look at the K. pneumoniae vaccine candidates and to take more effective steps in the future.