A machine-learning (ML)-based approach that can be used for cloud mask and phase detection is developed. An all-day model that uses infrared (IR) observations and a daytime model that uses shortwave and IR observations from a passive instrument are trained separately for different surface types. The training datasets are selected by using reference pixel types from collocated space lidar. The ML approach is validated carefully and the overall performance is better than traditional methods.