Power system operators are actively seeking solutions to increase electric grid power flexibility and inertia, to accommodate deeper renewable integration. Buildings account for 75% of the total electricity use in the US and have great potential for grid reliability support at various time and spatial scales. Due to the limited bidding power of individual buildings, grid services are often provided by a fleet of small buildings managed by tailored coordination strategies. This dissertation presents two families of control methods for building cluster energy management based on the control time frequency and inter-building coordination mode: (1) dictatorial load modulating control strategies formulated under a specific context of distribution voltage regulation, and (2) market-based load shifting control achieved through a game-theoretic control framework. Load modulating represents the ability to balance power supply and demand within seconds in response to the grid signal. Therefore, the load modulating can enable distribution voltage support by controlling flexible loads in the building clusters to let their power use follow volatile solar photovoltaic output, as a means to mitigate fluctuations in the net demand and maintain a stable voltage. Load shifting represents the ability to change the timing of electricity use. In load shifting the typical time duration is 1 to 4 hours, and response time is less than 1 hour. The game-theoretic control strategies allow coordinative load shifting in which individual entities determine their control actions in their own interests while coordination is achieved indirectly through a market mechanism, with the goal of flattening the total load curve of the building cluster.