|
1 | | -## AutoSteer |
2 | | -AutoSteer is a neural network which aims to predict the steering angle of a vehicle in order to follow the overall shape of the road the vehicle is travelling along. This is a type of road-curvature estimation, and can be used to help autonomous vehicles navigate highly curved roads and roads with high bank angles, where traditional road curvature estimation methods fail. |
3 | | - |
4 | | -AutoSteer takes as input the lane mask output from the EgoLanes network for the current and previous image. It outputs a probability vector which encodes fixed steering angles, and the argmax of this probability vector informs us of the steering angle predicted by the model. In practice, we add a moving average filter to the model output to ensure that the predicted steering values are smooth over time. |
5 | | - |
6 | | -## Watch the explainer video |
7 | | -Please click the video link to play - [***Video link***](https://drive.google.com/file/d/1hYJss-xWskAktQg0qU722b8YyQSokq_d/view?usp=drive_link) |
8 | | - |
9 | | - |
10 | | -## AutoSteer model weights |
11 | | -### [Link to Download Pytorch Model Weights *.pth](https://drive.google.com/file/d/17yu0H81sFE6ZHuviT7SXH3iMjMmyyS0t/view?usp=sharing) |
12 | | -### [Link to Download ONNX FP32 Weights *.onnx](https://drive.google.com/file/d/1gxH6EM4HJ0rfnqt90cT1w7hgizW49jQe/view?usp=sharing) |
13 | | - |
14 | | - |
15 | 1 | ## AutoSteer 2.0 - ego-path line prediction |
16 | 2 |
|
17 | | -Accurate estimation of the steering angle is essential for autonomous driving and cruise control applications, as it ensures reliable tracking of the road geometry. Road curvature is directly related to the steering angle, and accurate curvature estimation plays a critical role in vehicle control. The proposed AutoSpeed DNN enhances performance in challenging scenarios, such as highly curved roads and roads with significant bank angles, where traditional curvature estimation methods often fail. |
18 | | - |
19 | | -The AutoSteer 2.0 architecture builds upon components of the YOLO11 framework, incorporating a specially designed head, and predicts the ego-path line directly from the input image. This ego-path representation captures the underlying road geometry and curvature, enabling more robust and accurate steering estimation. |
| 3 | +AutoSteer 2.0 is a neural network which processes camera image frames and outputs future waypoints which define the driving path of the ego-car to 'follow the road'. The network does not perform explicit lane detection and processes the entire image frame to perform end-to-end spatial path prediction. The network is designed for in-lane driving and predicts the future waypoints to continue in the ego-cars existing driving corridor. |
20 | 4 |
|
21 | 5 | ### Demo Video |
22 | 6 |
|
23 | | -[]() |
| 7 | +[](https://drive.google.com/file/d/13suX8urFenOyQhYpIbiEvl5POuoP7cTq/preview) |
24 | 8 |
|
25 | 9 | ## Get Started |
26 | 10 | To easily try out the model on your own images and videos, please follow the steps in the [tutorial](tutorial.ipynb). For the best results, please ensure that your input video matches the aspect ratio of the model. |
27 | 11 |
|
28 | 12 | ### Performance Results |
29 | 13 |
|
30 | | -AutoSteer 2.0 network is trained on combined dataset from three distinct datasets [TUSimple](https://www.kaggle.com/datasets/manideep1108/tusimple), [OpenLane](https://github.com/OpenDriveLab/OpenLane) and [CurveLanes](https://github.com/SoulmateB/CurveLanes). Dataset is prepared with 90:10 ratio for train:val split, and we achieve a mAP@50 score of 0.9691 and a mAP score of 0.9546 on validation data. |
| 14 | +AutoSteer 2.0 network is trained on combined dataset from three distinct datasets [TUSimple](https://www.kaggle.com/datasets/manideep1108/tusimple), [OpenLane](https://github.com/OpenDriveLab/OpenLane) and [CurveLanes](https://github.com/SoulmateB/CurveLanes). The ataset is prepared with 90:10 ratio for train:val split, and we achieve a mAP@50 score of 0.9691 and a mAP score of 0.9546 on validation data. |
31 | 15 |
|
32 | 16 | ## Model variants |
33 | 17 |
|
34 | | -AutoSteer takes as input the lane mask output from the EgoLanes network for the current and previous image. It outputs a probability vector which encodes fixed steering angles, and the argmax of this probability vector informs us of the steering angle predicted by the model. In practice, we add a moving average filter to the model output to ensure that the predicted steering values are smooth over time. |
| 18 | +AutoSteer 2.0 processess camera frames in a 2:1 aspect ratio with size 1024px by 512px and predicts ego-path line in camera coordinate system. The original AutoSteer model takes as input the lane mask output from the EgoLanes network for the current and previous image. It outputs a probability vector which encodes fixed steering angles, and the argmax of this probability vector informs us of the steering angle predicted by the model. In practice, we add a moving average filter to the model output to ensure that the predicted steering values are smooth over time. |
35 | 19 |
|
36 | | -AutoSteer 2.0 processess camera frames in a 2:1 aspect ratio with size 1024px by 512px and predicts ego-path line in camera coordinate system. |
| 20 | +**AutoSteer 2.0 model weights - 2:1 aspect ratio, 1024px by 512px input image** |
37 | 21 |
|
38 | | -AutoSteer 2.0 model weights - 2:1 aspect ratio, 1024px by 512px input image |
| 22 | +### [Link to Download Pytorch Model Weights *.pth](https://drive.google.com/file/d/1-wfPyu7HId7YDSh_T_DkB3Ma1zPc7Fu_/view?usp=drive_link) |
| 23 | +### [Link to Download ONNX FP32 Weights *.onnx](https://drive.google.com/file/d/1Rb05CScAfvl0OPRJz8S83Q4BWRG1pEKH/view?usp=drive_link) |
39 | 24 |
|
40 | | -### [Link to Download Pytorch Model Weights *.pth]() |
41 | | -### [Link to Download ONNX FP32 Weights *.onnx]() |
42 | 25 |
|
43 | | -AutoSteer model weights |
| 26 | +**AutoSteer model weights - 2:1 aspect ratio, 640px by 320px input image** |
44 | 27 |
|
45 | 28 | ### [Link to Download Pytorch Model Weights *.pth](https://drive.google.com/file/d/17yu0H81sFE6ZHuviT7SXH3iMjMmyyS0t/view?usp=sharing) |
46 | 29 | ### [Link to Download ONNX FP32 Weights *.onnx](https://drive.google.com/file/d/1gxH6EM4HJ0rfnqt90cT1w7hgizW49jQe/view?usp=sharing) |
0 commit comments