Dysregulated cell division, which leads to aberrant cell proliferation, is one of the key hallmarks of cancer. Therefore, therapeutic targets that block cell division would be effective for cancer treatment. Cell division is mainly controlled by a complex composed of cyclin and cyclin dependent kinases (CDKs). To date, the CDK inhibitors (CDKIs), specifically the ones that block the enzyme activity of CDK4 and CDK6 (CDK4/6), have been approved by FDA for the treatment of metastatic hormone receptor positive breast cancer. However, due to the non-selectivity and significant toxicity, most of the first generation CDK inhibitors (so called pan-CDK inhibitors that target several CDKs), have not been approved for clinical application. Despite this, great efforts and progress have been made to enable pan-CDK inhibitors application in the clinical setting. Notably, the development of combination therapy strategies in recent years has made it possible to reduce the toxicity and side effects of pan-CDK inhibitors. Thus, as a combination therapy approach, pan-CDK inhibitors regain great potential in clinical application. In this review, we introduced the CDK family members and discussed their major functions in cell cycle controlling. Then, we summarized the research progress regarding CDK inhibitors, especially those other than CDK4/6 inhibitors. We reviewed first-generation pan-CDKIs Flavopiridol and Roscovitine, and second-generation CDKIs Dinaciclib, P276-00, AT7519, TG02, Roniciclib, RGB-286638 by focusing on their developing stages, clinical trials and targeting cancers. The specific CDKIs, which targets to increase specificity and decrease the side effects, were also discussed. These CDKIs include CDK4/6, CDK7, CDK9, and CDK12/13 inhibitors. Finally, the efficacy and discrepancy of combination therapy with CDK inhibitors and PD1/PDL1 antibodies were analyzed, which might give insights into the development of promising strategy for cancer treatment.