The mission is to augment every surgery. Compared to a pilot flying a plane or even a regular google-map user on his way to work/home, surgeons today have their instruments clustered behind them hanging in the wall. The Google Maps user or the pilot gets constant real-time updates regarding where they are, what to do next, and other vital data that helps them make split seconds decisions. They don't have to memorize every turn and detail of every landmark along the way. On the other hand, surgeons today must do rigorous surgical planning, memorize the specifics of each unique case, and all the necessary steps to ensure the safest possible surgery. Then they engage in complex procedures for several hours, with no targeting or homing devices or head-mounted displays to assist them. They must feel their way to their objective and hope everything goes as they planned. Through our research, we aim to change this practice. We are making the "google-maps" for surgery. Intraoperative Virtual Surgical Planning (IntraOpVSP) is one of the essential pillars of this vision. It is made for visualizing and interacting with Virtual Surgical Planning (VSP) intraoperatively. IntraOpVSP perfectly aligns VSP data with the patient’s body and through holographic display, allows the surgeons to look directly inside a patient’s body to inspect various anatomical structures. Through our research, we have identified essential functionalities that allow surgeons to align, interact with, and visualize the patient CT scan data as intuitively as possible. Since the development of IntraOpVSP, it has been used in over 35 surgeries at the University of Oklahoma, Medicine and is now in routine use. This thesis report focuses on how IntraOpVSP was created and how it was iteratively refined to become as pragmatic as possible.