BRD4 serving as an attractive target for the treatment of renal fibrosis has recently received considerable attention. However, to date, the BRD4 inhibitors developed for renal fibrosis treatment were relatively few. Herein, we report the discovery of novel BRD4 inhibitors from virtual screening hit compound 1 with moderate inhibitory activity (IC50 = 7.5 ± 2.9 μM). Through the medicinal chemistry optimization program, leading to the discovery of three potent BRD4 inhibitors, 10, 19 and 31 with IC50 values of 20.0 ± 7.1, 17.5 ± 6.4 and 13.5 ± 4.9 nM, respectively. Among them, 31 showed an acceptable liver microsomal stability and displayed a desired pharmacokinetic profile. Further, we confirmed the therapeutic efficacy of 31 in alleviating renal fibrosis on both UUO and folic acid (FA)-induced renal fibrosis mouse models. Collectively, our results indicated that compound 31 might be a promising candidate for renal fibrosis treatment and deserves further investigations.