In the ID3 decision tree algorithm, which metric (calculated using entropy) is used to select the attribute that best separates the training examples?
Show answer
Information Gain
Information Gain measures the reduction in entropy achieved by partitioning a dataset based on a specific attribute. The algorithm greedily selects the attribute with the highest gain at each node to create the most efficient tree.
Also asked as:
- What entropy-based metric does the ID3 algorithm use to determine the best attribute for partitioning a dataset?