This paper identifies the determinants of energy productivity based on a basic economic growth model. Using panel data including 29 provinces from 1995 to 2007, we find that energy productivity is negatively associated with the industry sector share in GDP and the state-owned sector share in GDP, and is positively associated with the electricity share in energy consumption. In addition, we find that there exists a big gap of energy efficiency among eastern, middle and western region in China. Our results suggest that we should induce the industry development structure from the industrial sector to service sector, prompt the reform of state-owned enterprises, as well as improve the energy consumption structure dominated by coal to diversified cleaning energy.