In the paper discrete adaptive systems of control over deterministic objects are studied. The problems of designing both optimal control algorithms and optimal structures of control systems are discussed. The paper presents a comprehensive review of different algorithms available in the literature. The authors attempt to give a unified presentation.