Gradient Descent

An optimization algorithm that finds the best solution by iteratively moving in the direction of steepest descent, like rolling a ball down a hill to find the bottom. In machine learning, it's how models learn - they adjust their parameters bit by bit to minimize errors. Think of it as a systematic way of getting better at something by always moving toward improvement.