In cloud computing, because all the tasks are submitted and requested by the users, it is the key to improve the quality of service whether all tasks are scheduled to every host to achieve the shortest completion time for all tasks. In this paper, the basic ant colony algorithm is modified appropriately to enable task scheduling and load balancing. The simulation results show that the ant colony algorithm can effectively obtain the global optimal solution and realize the shortest task completion time.