Home > Published Issues > 2024 > Volume 15, No. 3, 2024 >
JAIT 2024 Vol.15(3): 322-329
doi: 10.12720/jait.15.3.322-329

Deep Learning-Based Lane-Keeping Assist System for Self-Driving Cars Using Transfer Learning and Fine Tuning

Phuc Phan Hong, Huy Hua Khanh, Nghi Nguyen Vinh, Nguyen Nguyen Trung, Anh Nguyen Quoc, and Hoang Tran Ngoc *
Software Engineering Department, FPT University, Can Tho 94000, Vietnam
Email: PhucPHCE171166@fpt.edu.vn (P.P.H.); Huyhkce171778@fpt.edu.vn (H.H.K); Nghinvce182108@fpt.edu.vn (N.N.V); Nguyenntce182351@fpt.edu.vn (N.N.T);
AnhNQCE170483@fpt.edu.vn (A.N.Q.); Hoang2531992@gmail.com (H.T.N.)
*Corresponding author

Manuscript received September 15, 2023; revised October 11, 2023; accepted October 25, 2023; published March 8, 2024.

Abstract—This paper presents an advanced lane-keeping assistance system specifically designed for self-driving cars. The proposed model combines the powerful Xception network with transfer learning and fine-tuning techniques to accurately predict the steering angle. By analyzing camera-captured images, the model effectively learns from human driving knowledge and provides precise estimations of the steering angle necessary for safe lane-keeping. The transfer learning technique allows the model to leverage the extensive knowledge acquired from the ImageNet dataset, while the fine-tuning technique is utilized to tailor the pre-trained model to the specific task of steering angle prediction based on input images, enabling optimal performance. Fine-tuning was initiated by initially freezing the pre-trained model and training only the Fully Connected (FC) layer for the first 10 epochs. Subsequently, the entire model, encompassing both the backbone and the FC layer, was unfrozen for further training. To evaluate the system’s effectiveness, a comprehensive comparative analysis is conducted against popular existing models, including Nvidia, MobilenetV2, VGG19, and InceptionV3. The evaluation includes an assessment of the operational accuracy based on the loss function, specifically utilizing the Mean Squared Error (MSE) equation. The proposed model achieves the lowest loss function values for both training and validation, demonstrating its superior predictive performance. Additionally, the model’s performance is further evaluated through extensive real-world testing on pre-designed trajectories and maps, resulting in the minimal deviation of the steering angle from the desired trajectory over time. This practical evaluation provides valuable insights into the mode’s reliability and its potential to effectively assist in lane-keeping tasks.
 
Keywords—lane-keeping assistance, autonomous vehicles, Xception, transfer learning, fine-tuning, steering angle prediction

Cite: Phuc Phan Hong, Huy Hua Khanh, Nghi Nguyen Vinh, Nguyen Nguyen Trung, Anh Nguyen Quoc, and Hoang Tran Ngoc, "Deep Learning-Based Lane-Keeping Assist System for Self-Driving Cars Using Transfer Learning and Fine Tuning," Journal of Advances in Information Technology, Vol. 15, No. 3, pp. 322-329, 2024.

Copyright © 2024 by the authors. This is an open access article distributed under the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits use, distribution and reproduction in any medium, provided that the article is properly cited, the use is non-commercial and no modifications or adaptations are made.