Difference between revisions of "JetRacer Pro AI Kit"
(23 intermediate revisions by 3 users not shown) | |||
Line 1: | Line 1: | ||
− | <div class=" | + | <div class="wiki-pages jet-green-color"> |
− | |||
{{infobox item | {{infobox item | ||
− | |img=[[File:JetRacer-Pro-AI-Kit-1.jpg|300px|alt=JetRacer AI Kit|link=https://www.waveshare.com/jetracer-ai-kit.htm|JetRacer AI Kit]] | + | |img=[[File:JetRacer-Pro-AI-Kit-1.jpg|300px|alt=JetRacer AI Kit|{{Amazon_nolink|default={{#ifeq: {{#urlget:amazon|0}}|{{#urlget:Amazon|0}}| default|}}|url=link=https://www.waveshare.com/jetracer-ai-kit.htm}}|JetRacer AI Kit]] |
− | |caption= AI Racing Robot Kit | + | |caption= AI Racing Robot Kit based on Jetson Nano Developer Kit |
|website_cn= | |website_cn= | ||
|website_en=https://www.waveshare.com/jetracer-ai-kit.htm | |website_en=https://www.waveshare.com/jetracer-ai-kit.htm | ||
Line 12: | Line 11: | ||
{{Product List|Robotics/AI/Kits}} | {{Product List|Robotics/AI/Kits}} | ||
}} | }} | ||
− | + | =Introduction= | |
− | This is an AI Racing Robot kit based on Jetson Nano Developer Kit. Supports deep learning, auto line following, autonomous driving, and so on. | + | This is an AI Racing Robot kit based on the Jetson Nano Developer Kit. Supports deep learning, auto line following, autonomous driving, and so on. |
− | + | =Notice= | |
− | |||
The Jetson Nano Developer Kit is not included in the Acce Kit, you need to buy it separately. | The Jetson Nano Developer Kit is not included in the Acce Kit, you need to buy it separately. | ||
− | We do not provide batteries in the AI Kit or the Acce Package because of shipping policy, you need to buy batteries in local market. | + | We do not provide batteries in the AI Kit or the Acce Package because of the shipping policy, you need to buy batteries in the local market. |
− | + | =Features= | |
− | < | + | *Support four 18650 batteries <font color="#FF0000">(not included)</font>, 10400mAh large capacity, two parallel and two series output current is larger, the motor power is stronger. |
− | + | *Onboard HY2120 + AOD514 lithium battery protection circuit, with anti-overcharge, anti-over-discharge, anti-over-current and short circuit protection functions. | |
− | + | *The onboard FP5139 automatic buck-boost voltage regulator circuit can provide a stable 5V voltage to the Jetson Nano. | |
− | + | *Onboard 0.91-inch 128×32 resolution OLED, real-time display of car IP address, memory, power, etc. | |
− | * | + | *The onboard AINA219 acquisition chip is convenient for real-time monitoring of battery voltage and charging current. |
− | ===2. Software setup | + | =User Guides= |
− | 【Note】 The software part of this guide mostly based on [https://github.com/NVIDIA-AI-IOT/jetracer NVIDIA JetRacer wiki ] | + | ==1. Hardware setup== |
+ | *[https://files.waveshare.com/upload/f/fa/Jetracer_pro_Assembly_EN.pdf Jetracer Pro Assembly Manual] | ||
+ | ==2. Software setup== | ||
+ | 【Note】 The software part of this guide is mostly based on [https://github.com/NVIDIA-AI-IOT/jetracer NVIDIA JetRacer wiki ] | ||
+ | ===Install Image=== | ||
; Step 1. Write JetRacer image to SD card | ; Step 1. Write JetRacer image to SD card | ||
*You need to prepare an SD card which should be at least 64G | *You need to prepare an SD card which should be at least 64G | ||
*Download the JetRacer image and unzip it. | *Download the JetRacer image and unzip it. | ||
− | **[https://drive.google.com/file/d/ | + | **[https://drive.google.com/file/d/1ZBdqrwhW2n1uN8rughF7Puw98o76kUcH/view?usp=sharing Pre-Built image based on Jetpack4.5] |
− | *Connect the SD card to PC via a card reader | + | *Connect the SD card to the PC via a card reader |
− | *User Etcher software to write the image (unzip above) to SD card.[https://www.balena.io/etcher/ Click here to download Etcher software] | + | *User Etcher software to write the image (unzip above) to the SD card.[https://www.balena.io/etcher/ Click here to download Etcher software] |
:[[File:JetBot_AI_Kit_Manual_1.jpg|400px]] | :[[File:JetBot_AI_Kit_Manual_1.jpg|400px]] | ||
*After writing, eject the SD card | *After writing, eject the SD card | ||
; Step 2. Startup Jetson Nano Developer Kit | ; Step 2. Startup Jetson Nano Developer Kit | ||
− | *Insert SD card to SD card slot of Jetson | + | *Insert SD card to SD card slot of Jetson Nano (slot is under Jetson Nano board) |
*Power on JetRacer AI Kit, and connect the micro USB interface of Jetson Nano Developer Kit to your PC | *Power on JetRacer AI Kit, and connect the micro USB interface of Jetson Nano Developer Kit to your PC | ||
<font color=red>【Note】You had better test the Jetson Nano Developer Kit before you assemble JetRacer</font> | <font color=red>【Note】You had better test the Jetson Nano Developer Kit before you assemble JetRacer</font> | ||
+ | *Turn on the power switch to start the Jetson Nano. After the system starts, the computer will recognize the USB network card. If the network card does not automatically obtain an IP, you need to manually set the IP address to 192.168.55.1. | ||
+ | *Open a browser and navigate to 192.168.55.1:8888 and log into Jupyter Lab with the default password jetson. | ||
; Step 3. Connect JeRacer to WIFI | ; Step 3. Connect JeRacer to WIFI | ||
− | All the examples use WIFI, we need to connect JetRacer to WIFI | + | All the examples use WIFI, we need to connect JetRacer to WIFI first. |
− | *Open a browser (we recommend you | + | *Open a browser (we recommend you use Chrome) and navigate to <font style="background-color:#EEEEEE; color:red">192.168.55.1:8888 </font> |
*Sign in with default password <font style="background-color:#EEEEEE; color:red">jetson</font> | *Sign in with default password <font style="background-color:#EEEEEE; color:red">jetson</font> | ||
*Open a terminal in Jupyter Lab by click '''File''' -> '''New''' -> '''Terminal''' | *Open a terminal in Jupyter Lab by click '''File''' -> '''New''' -> '''Terminal''' | ||
− | *In the terminal, type the following command to list available WiFi networks, and find the '''ssid_name''' of your network. You can also skip this step if you | + | *In the terminal, type the following command to list available WiFi networks, and find the '''ssid_name''' of your network. You can also skip this step if you know the available network. |
<pre>sudo nmcli device wifi list</pre> | <pre>sudo nmcli device wifi list</pre> | ||
*Connect to the selected WIFI network. Please replace the <ssid_name> and <password> to the actual name and password. | *Connect to the selected WIFI network. Please replace the <ssid_name> and <password> to the actual name and password. | ||
Line 55: | Line 59: | ||
*Close the previous Jupyter Lab Browser tab | *Close the previous Jupyter Lab Browser tab | ||
*Open a new browser tab and navigate to <font style="background-color:#EEEEEE" color=red><nowiki>http://<jetracer_ip_address>:8888</nowiki></font> | *Open a new browser tab and navigate to <font style="background-color:#EEEEEE" color=red><nowiki>http://<jetracer_ip_address>:8888</nowiki></font> | ||
− | < | + | *Enter http://<jetson_ip_address>:8888 in the browser address bar to connect to the car, where jetson_ip_address is the actual IP displayed on the OLED, for example: 192.168.32.10:8888. |
− | ; Step 5. Install the | + | *Login to Jupyter Lab with the password jetson. |
+ | [[File:JetBot 2GB AI Ki-step4.jpg]] | ||
+ | |||
+ | |||
+ | ; Step 5. Install the Python package | ||
*Access JetRacer by going to <font style="background-color:#EEEEEE" color=#red><nowiki>http://<jetracer_ip_address>:8888</nowiki></font> | *Access JetRacer by going to <font style="background-color:#EEEEEE" color=#red><nowiki>http://<jetracer_ip_address>:8888</nowiki></font> | ||
− | *Launch a new terminal. | + | *Launch a new terminal. The default user name and password are both '''jetson''' |
− | *Get and install the latest JetRacer Pro repository from GitHub. | + | *Get and install the latest JetRacer Pro repository from GitHub.Some of the Python packages provided here are modified by Waveshare for Waveshare JetRacer Pro AI Kit. |
− | *Update | + | *Update Jetracer package |
<pre> | <pre> | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
cd jetracer | cd jetracer | ||
+ | git checkout ws/pro | ||
sudo python3 setup.py install | sudo python3 setup.py install | ||
</pre> | </pre> | ||
+ | |||
; Step 6. Configure power mode | ; Step 6. Configure power mode | ||
To ensure that the Jetson Nano doesn't draw more current than the battery pack can supply, place the Jetson Nano in 5W mode by calling the following command | To ensure that the Jetson Nano doesn't draw more current than the battery pack can supply, place the Jetson Nano in 5W mode by calling the following command | ||
− | *You need to launch a new Terminal and enter following commands to select 5W power mode | + | *You need to launch a new Terminal and enter the following commands to select 5W power mode |
sudo nvpmodel -m1 | sudo nvpmodel -m1 | ||
*Check if mode is correct | *Check if mode is correct | ||
sudo nvpmodel -q | sudo nvpmodel -q | ||
− | + | *At the same time, OLED will display: | |
− | --> | + | MODE: MAXN |
+ | |||
+ | ==3. Examples== | ||
+ | ====Basic motion==== | ||
+ | *Enter <font style="background-color:#EEEEEE" color=#B94A48><nowiki>http://<jetbot_ip_address>:8888</nowiki></font> in the browser address bar to connect to the car, open /jetracer/notebooks/ on the left side. Open the basic_motion.ipynb file. | ||
+ | *Files with lpynb suffix are lpython Notebook files, including comment text and python programs. You can run a single-segment program by clicking Run->Run Select Cells or clicking the Run shortcut icon ▶.<br/> | ||
+ | [Note] There are detailed program notes in the text. Read the notes carefully to understand the program functions.<br/> | ||
+ | :[[File:JetRacer AI Kit Manual 3-1.jpg.png|600px]]<br/> | ||
+ | *When running the statement car.steering = 0, the car steering will turn. 0 means forward, 1 means the wheel goes to the far left, -1 means the wheel goes to the far right. Change the wheel to different directions to different values, the value range is [-1,1]<br/> | ||
+ | :[[File:JetRacer AI Kit Manual 3-2.png|600px]]<br/> | ||
+ | *After running this program, the steering gain car.steering_gain and the steering initial displacement car.steering_offset will be output.<br/> | ||
+ | *The steering gain car.steering_gain can represent the maximum angle the wheel can turn. | ||
+ | *The initial steering displacement car.steering_offset can represent the initial offset of the wheels. When car.steering = 0, when the car does not run in a straight line, you can adjust the length of the steering rod or modify the value of the initial steering displacement to make the car go straight. | ||
+ | :[[File:JetRacer AI Kit Manual 3-3.png|600px]] | ||
+ | *car.throttle is the throttle size, the range is [-1,1], 0 means stop, 1 means forward at maximum speed, -1 means backward at maximum speed, after modifying the secondary value and running the program, the rear wheel will turn. | ||
+ | *car.throttle_gain is the throttle gain, which can indicate the maximum speed at which the car can move. When car.throttle_gain = 1 and car.throttle = 1, the car can run to the maximum speed. | ||
+ | *Summary: This section mainly introduces how to control the movement of the car. The car is divided into two parts to control, one part is steering steering to control the car turning, and the other part is the throttle to control the speed of the rear wheels. | ||
+ | *The steering gain car.steering_gain controls the maximum rotation range of the wheel, and the initial steering displacement car.steering_offset can compensate for the steering error caused by mechanical assembly. | ||
+ | *The throttle gain car.throttle_gain controls the maximum speed range of the rear wheels. | ||
+ | ====Teleoperations==== | ||
+ | *Enter <font style="background-color:#EEEEEE" color=#B94A48><nowiki>http://<jetbot_ip_address>:8888</nowiki></font> in the browser address bar to connect to the car, open /jetracer/notebooks/ at the left side. Open the teleoperation.ipynb file. | ||
+ | *Plug the gamepad receiver into the USB port of the computer. [Note] The receiver should be connected to the computer instead of the jetson nano. The gamepad needs to be connected to the device that opens the JupyterLab webpage. | ||
+ | *Open the https://html5gamepad.com/ webpage to see if the remote controller is detected. Write down the INDEX value of the corresponding device. | ||
+ | *The value corresponding to pressing the remote controller button will change. Press the name of the corresponding key a few times. (The handle needs to press the home button so that the two lights of the remote control handle are on). | ||
+ | :[[File:JetBot_AI_Kit_Manual_7.jpg|600px]] | ||
+ | *After running this code, the window will output the buttons corresponding to the gamepad. Note that the index in the program needs to be modified to the value corresponding to the actual remote control handle, and the corresponding INDEX can be seen on the web page that just opened. The button icon corresponding to the button pressed will indicate that the button has been pressed. | ||
+ | :[[File:JetBot_AI_Kit_Manual_8.jpg|600px]] | ||
+ | *The maximum speed of the throttle is set to 0.2 here, to collect data later to limit the speed. | ||
+ | *Set the steering offset to 0.18, this value is adjusted according to the actual situation, until the car can drive in a straight line without steering. | ||
+ | [[File:JetRacer AI Kit Manual 4-1.png|600px]] | ||
+ | *Modify the axes value to correspond to different buttons, here is set to axes[0], and axes[5] for the convenience of remote control. | ||
+ | :[[File:JetRacer AI Kit Manual 4-2.png|600px]] | ||
+ | *After running the program, you can control the car through the remote control handle. Asex[0] controls the front wheel steering, and Asex[1] controls the rear wheel speed. | ||
+ | *The left joystick controls the steering of the front wheel of the car in the left and right directions, and the right joystick controls the speed of the rear wheels in the up and down direction. | ||
+ | :[[File:JetRacer AI Kit Manual 4-3.png|600px]] | ||
+ | ====interactive-regression==== | ||
+ | In this chapter, we also need to collect the data, patrol, and run autonomously to realize the function of autonomous patrolling. | ||
+ | *Enter <font style="background-color:#EEEEEE" color=#B94A48><nowiki>http://<jetson_ip_address>:8888</nowiki></font> in the browser address bar to connect to the car, find / jetracer/notebooks/. Open the interactive-regression.ipynb file. | ||
+ | |||
+ | :[[File:JetRacer AI Kit Manual 5-1.png]] | ||
+ | *In this section, the camera is turned on, and the image resolution is set to 224*224. | ||
+ | *Note: Re-opening after program exit may prompt an error. You need to run this statement to restart the camera. | ||
+ | <pre> | ||
+ | sudo systemctl restart nvargus-daemon | ||
+ | </pre> | ||
+ | *Run all program units directly, the last program will display the following interface. | ||
+ | [[File:JetRacer AI Kit Manual 5-2.png|600px]] | ||
+ | *At this time, you can put the car on the track, and open the teleoperation.ipynb program in the previous section to run, so that the remote control handle can control the movement of the car. | ||
+ | *Control the car to run along the track, every time you move a small position, use the mouse to move to the ideal running path of the car in the picture and click to save the picture and control the car to shoot 10 laps along the track. | ||
+ | *After collecting the data, select the value of epochs as 10, and then click train to train for 10 rounds. | ||
+ | *After training the data, you can click evaluate to evaluate the training model. If there is no problem with the collected data, you can see the ideal direction of the current car position in the leftmost image. | ||
+ | *Note that the collected data needs to move the trolley to different positions, offsets, and directions along the track, and select the farthest point along the ideal path to save it to ensure that the trolley will not leave the track or collide with objects. | ||
− | === | + | ====Road-following==== |
− | + | In this chapter, we use the trained model to implement autonomous driving. | |
− | * | + | *Enter <font style="background-color:#EEEEEE" color=#B94A48><nowiki>http://<jetson_ip_address>:8888</nowiki></font> in the browser address bar to connect to the car and find jetracer /noteboot/. Open the road_following.ipynb file. |
− | + | :[[File:JetRacer AI Kit Manual 6-1.png|600px]] | |
− | * | + | *After the program runs to this section, the model file road_following_model_trt.pth converted and optimized using touch2trt will be produced in the directory. This optimization process may take several minutes to complete. |
− | + | :[[File:JetRacer AI Kit Manual 6-2.png|600px]] | |
− | + | *Create a car and a camera. If the camera prompts an error, run the following command to restart the camera and run it again. | |
− | |||
<pre> | <pre> | ||
− | sudo | + | sudo systemctl restart nvargus-daemon |
− | |||
− | |||
</pre> | </pre> | ||
− | + | ||
− | + | :[[File:JetRacer AI Kit Manual 6-3.png|600px]] | |
− | + | *This program is to run the output of image processing through the PD control trolley. | |
− | + | The *car.steering_offset parameter is to correct the initial state offset of the car caused by the mechanical error of the car. This parameter needs to be changed to the actual value of the car. | |
− | * | + | *car.throttle sets the maximum speed for the car to run. If the second value is set too high, the car will easily run off the track. |
− | + | *Kp, and Kd are PID parameters, and PD adjustment is used here. This parameter can be debugged according to the actual running effect of the car. | |
− | * | ||
− | |||
− | |||
− | |||
− | * | ||
− | |||
− | * | ||
==Guide of DonkeyCar== | ==Guide of DonkeyCar== | ||
Line 142: | Line 161: | ||
*[[DonkeyCar for Jetson Nano-Train Data|Train Data]] | *[[DonkeyCar for Jetson Nano-Train Data|Train Data]] | ||
*[[DonkeyCar for Jetson Nano-Auto-Driving|Auto-Driving]] | *[[DonkeyCar for Jetson Nano-Auto-Driving|Auto-Driving]] | ||
− | + | =Resources= | |
− | |||
− | |||
*[https://drive.google.com/file/d/1bgCAUJ9m16g5FGuYgKy3WmGI-pGjPXN0/view?usp=sharing Pre-built Image (JP45)] | *[https://drive.google.com/file/d/1bgCAUJ9m16g5FGuYgKy3WmGI-pGjPXN0/view?usp=sharing Pre-built Image (JP45)] | ||
− | + | ==3D Drawing== | |
− | *[https:// | + | *[https://files.waveshare.com/upload/6/6c/Jetracer_Pro_Kit_3D_drawing.zip JetRacer Pro AI Kit 3D Drawing] |
− | + | ==Datasheet== | |
− | *[ | + | *[https://files.waveshare.com/upload/1/10/Ina219.pdf INA219] |
− | *[ | + | *[https://files.waveshare.com/upload/6/68/PCA96_datasheet.pdf PCA9685] |
− | *[ | + | *[https://files.waveshare.com/upload/1/13/S-8254AA.PDF S-8254AA] |
− | *[ | + | *[https://files.waveshare.com/upload/1/1e/Ads1115.pdf ADS1115] |
− | *[ | + | *[https://files.waveshare.com/upload/6/62/TB6612FNG_datasheet_en.pdf TB6612NG] |
− | |||
− | |||
= FAQ = | = FAQ = | ||
+ | {{FAQ|What are the system account passwords? | ||
+ | | | ||
+ | The account password of the JetRacer system is jetson. | ||
+ | }} | ||
+ | {{FAQ|You are prompted to enter a password, but you cannot enter the password, or an error is reported? | ||
+ | | | ||
+ | The Linux system does not print the input content when entering the password, that is, touch typing is required. Type "jetson" directly on the keyboard and press Enter. | ||
+ | }} | ||
+ | {{FAQ|After running the program, no error is reported, and the car does not move? | ||
+ | | | ||
+ | Confirm whether the ESC switch on the chassis of the lower trolley is turned on, and toggle it to re-test. | ||
+ | [[File:Jetracer pro ai kit.png]] | ||
+ | }} | ||
+ | {{FAQ|After flashing the image of Jetson Nano, the TF card cannot be recognized on a Windows computer? | ||
+ | | | ||
+ | Due to the partition problem, the TF card with the image of the Jetson Nano programmed cannot recognize the drive letter normally on the Windows computer. If you need to reformat it, search for Disk Management in the search bar of Windows and open the Disk Management interface. Find the mobile disk where the TF card is located (be careful not to mistake it for another disk), right-click and select Delete Volume, then create a new volume and format it by default. After the default format, the drive letter of TF will be recognized again. At this time, the space and memory of the TF card are incorrect. Note that you need to use the formatting software to quickly format the new drive letter again. After formatting, if the memory space of the TF card is normal, the new image can be re-programmed normally. | ||
+ | }} | ||
+ | |||
{{FAQ|How to fix the problem '''"AttributeError: module 'torch' has no attribute reciprocal_'"''' while running the road_following script? | {{FAQ|How to fix the problem '''"AttributeError: module 'torch' has no attribute reciprocal_'"''' while running the road_following script? | ||
− | |Please open the terminal and run the following command to install torch-1.2.0 | + | | |
+ | Please open the terminal and run the following command to install torch-1.2.0 | ||
<pre> | <pre> | ||
wget https://nvidia.app.box.com/public/static/06vlvedmqpqstu1dym49fo7aapgfyyu9.whl -O torch-1.2.0a0+8554416-cp36-cp36m-linux_aarch64.whl | wget https://nvidia.app.box.com/public/static/06vlvedmqpqstu1dym49fo7aapgfyyu9.whl -O torch-1.2.0a0+8554416-cp36-cp36m-linux_aarch64.whl | ||
Line 170: | Line 204: | ||
|||}} | |||}} | ||
{{FAQ|What batteries does JetRacer AI Kit use? | {{FAQ|What batteries does JetRacer AI Kit use? | ||
− | | | + | | |
− | BTW, Power of JetRacer is down when the voltage of the whole system is similar to 9V (it is not accurate), we recommend you | + | Support four 18650 batteries '''(not included)''' are used and the voltage of every battery is 3.7V. Generally, the voltage per battery is 4.2V when fully charged. Please use batteries without a protective plate. |
− | We recommend you | + | BTW, the Power of JetRacer is down when the voltage of the whole system is similar to 9V (it is not accurate), we recommend you charge batteries if the voltage displayed is lower than 10V.<br /> |
+ | We recommend you use high-quality batteries like Sanyo or Panasonic.<br /> | ||
[[File:batteries _18650_en.jpg|500px]] | [[File:batteries _18650_en.jpg|500px]] | ||
|}} | |}} | ||
{{FAQ|What is the power adapter used to do? | {{FAQ|What is the power adapter used to do? | ||
− | |The 8.4V power adapter is used to charge the batteries. '''DO NOT''' directly connect it to Jetson Nano Developer board. | + | | |
+ | The 8.4V power adapter is used to charge the batteries. '''DO NOT''' directly connect it to the Jetson Nano Developer board. | ||
|||}} | |||}} | ||
{{FAQ|Why doesn't the motor work after setting up? | {{FAQ|Why doesn't the motor work after setting up? | ||
− | |Please make sure that you have installed the codes of Waveshare instead of NVIDIA's. The drive codes of the motor are different between Waveshare's and NVIDIA's. If you have updated the one from NVIDIA | + | | |
+ | Please make sure that you have installed the codes of Waveshare instead of NVIDIA's. The drive codes of the motor are different between Waveshare's and NVIDIA's. If you have updated the one from NVIDIA, please remove the Jetracer folder and download ours by following step 5. | ||
|||}} | |||}} | ||
− | + | ||
− | + | =Support= | |
− | + | {{Servicebox1}} | |
− | {{ | ||
</div> | </div> |
Latest revision as of 08:06, 8 April 2024
| ||
Introduction
This is an AI Racing Robot kit based on the Jetson Nano Developer Kit. Supports deep learning, auto line following, autonomous driving, and so on.
Notice
The Jetson Nano Developer Kit is not included in the Acce Kit, you need to buy it separately.
We do not provide batteries in the AI Kit or the Acce Package because of the shipping policy, you need to buy batteries in the local market.
Features
- Support four 18650 batteries (not included), 10400mAh large capacity, two parallel and two series output current is larger, the motor power is stronger.
- Onboard HY2120 + AOD514 lithium battery protection circuit, with anti-overcharge, anti-over-discharge, anti-over-current and short circuit protection functions.
- The onboard FP5139 automatic buck-boost voltage regulator circuit can provide a stable 5V voltage to the Jetson Nano.
- Onboard 0.91-inch 128×32 resolution OLED, real-time display of car IP address, memory, power, etc.
- The onboard AINA219 acquisition chip is convenient for real-time monitoring of battery voltage and charging current.
User Guides
1. Hardware setup
2. Software setup
【Note】 The software part of this guide is mostly based on NVIDIA JetRacer wiki
Install Image
- Step 1. Write JetRacer image to SD card
- You need to prepare an SD card which should be at least 64G
- Download the JetRacer image and unzip it.
- Connect the SD card to the PC via a card reader
- User Etcher software to write the image (unzip above) to the SD card.Click here to download Etcher software
- After writing, eject the SD card
- Step 2. Startup Jetson Nano Developer Kit
- Insert SD card to SD card slot of Jetson Nano (slot is under Jetson Nano board)
- Power on JetRacer AI Kit, and connect the micro USB interface of Jetson Nano Developer Kit to your PC
【Note】You had better test the Jetson Nano Developer Kit before you assemble JetRacer
- Turn on the power switch to start the Jetson Nano. After the system starts, the computer will recognize the USB network card. If the network card does not automatically obtain an IP, you need to manually set the IP address to 192.168.55.1.
- Open a browser and navigate to 192.168.55.1:8888 and log into Jupyter Lab with the default password jetson.
- Step 3. Connect JeRacer to WIFI
All the examples use WIFI, we need to connect JetRacer to WIFI first.
- Open a browser (we recommend you use Chrome) and navigate to 192.168.55.1:8888
- Sign in with default password jetson
- Open a terminal in Jupyter Lab by click File -> New -> Terminal
- In the terminal, type the following command to list available WiFi networks, and find the ssid_name of your network. You can also skip this step if you know the available network.
sudo nmcli device wifi list
- Connect to the selected WIFI network. Please replace the <ssid_name> and <password> to the actual name and password.
sudo nmcli device wifi connect <ssid_name> password <password>
- After getting the successfully information, please check the ip_addtess of Wlan0 interface by the following command
ifconfig
- Step 4. Connect to JetRacer over WIFI
- Unplug the USB cable from Jetson Nano
- Close the previous Jupyter Lab Browser tab
- Open a new browser tab and navigate to http://<jetracer_ip_address>:8888
- Enter http://<jetson_ip_address>:8888 in the browser address bar to connect to the car, where jetson_ip_address is the actual IP displayed on the OLED, for example: 192.168.32.10:8888.
- Login to Jupyter Lab with the password jetson.
- Step 5. Install the Python package
- Access JetRacer by going to http://<jetracer_ip_address>:8888
- Launch a new terminal. The default user name and password are both jetson
- Get and install the latest JetRacer Pro repository from GitHub.Some of the Python packages provided here are modified by Waveshare for Waveshare JetRacer Pro AI Kit.
- Update Jetracer package
cd jetracer git checkout ws/pro sudo python3 setup.py install
- Step 6. Configure power mode
To ensure that the Jetson Nano doesn't draw more current than the battery pack can supply, place the Jetson Nano in 5W mode by calling the following command
- You need to launch a new Terminal and enter the following commands to select 5W power mode
sudo nvpmodel -m1
- Check if mode is correct
sudo nvpmodel -q
- At the same time, OLED will display:
MODE: MAXN
3. Examples
Basic motion
- Enter http://<jetbot_ip_address>:8888 in the browser address bar to connect to the car, open /jetracer/notebooks/ on the left side. Open the basic_motion.ipynb file.
- Files with lpynb suffix are lpython Notebook files, including comment text and python programs. You can run a single-segment program by clicking Run->Run Select Cells or clicking the Run shortcut icon ▶.
[Note] There are detailed program notes in the text. Read the notes carefully to understand the program functions.
- When running the statement car.steering = 0, the car steering will turn. 0 means forward, 1 means the wheel goes to the far left, -1 means the wheel goes to the far right. Change the wheel to different directions to different values, the value range is [-1,1]
- After running this program, the steering gain car.steering_gain and the steering initial displacement car.steering_offset will be output.
- The steering gain car.steering_gain can represent the maximum angle the wheel can turn.
- The initial steering displacement car.steering_offset can represent the initial offset of the wheels. When car.steering = 0, when the car does not run in a straight line, you can adjust the length of the steering rod or modify the value of the initial steering displacement to make the car go straight.
- car.throttle is the throttle size, the range is [-1,1], 0 means stop, 1 means forward at maximum speed, -1 means backward at maximum speed, after modifying the secondary value and running the program, the rear wheel will turn.
- car.throttle_gain is the throttle gain, which can indicate the maximum speed at which the car can move. When car.throttle_gain = 1 and car.throttle = 1, the car can run to the maximum speed.
- Summary: This section mainly introduces how to control the movement of the car. The car is divided into two parts to control, one part is steering steering to control the car turning, and the other part is the throttle to control the speed of the rear wheels.
- The steering gain car.steering_gain controls the maximum rotation range of the wheel, and the initial steering displacement car.steering_offset can compensate for the steering error caused by mechanical assembly.
- The throttle gain car.throttle_gain controls the maximum speed range of the rear wheels.
Teleoperations
- Enter http://<jetbot_ip_address>:8888 in the browser address bar to connect to the car, open /jetracer/notebooks/ at the left side. Open the teleoperation.ipynb file.
- Plug the gamepad receiver into the USB port of the computer. [Note] The receiver should be connected to the computer instead of the jetson nano. The gamepad needs to be connected to the device that opens the JupyterLab webpage.
- Open the https://html5gamepad.com/ webpage to see if the remote controller is detected. Write down the INDEX value of the corresponding device.
- The value corresponding to pressing the remote controller button will change. Press the name of the corresponding key a few times. (The handle needs to press the home button so that the two lights of the remote control handle are on).
- After running this code, the window will output the buttons corresponding to the gamepad. Note that the index in the program needs to be modified to the value corresponding to the actual remote control handle, and the corresponding INDEX can be seen on the web page that just opened. The button icon corresponding to the button pressed will indicate that the button has been pressed.
- The maximum speed of the throttle is set to 0.2 here, to collect data later to limit the speed.
- Set the steering offset to 0.18, this value is adjusted according to the actual situation, until the car can drive in a straight line without steering.
- Modify the axes value to correspond to different buttons, here is set to axes[0], and axes[5] for the convenience of remote control.
- After running the program, you can control the car through the remote control handle. Asex[0] controls the front wheel steering, and Asex[1] controls the rear wheel speed.
- The left joystick controls the steering of the front wheel of the car in the left and right directions, and the right joystick controls the speed of the rear wheels in the up and down direction.
interactive-regression
In this chapter, we also need to collect the data, patrol, and run autonomously to realize the function of autonomous patrolling.
- Enter http://<jetson_ip_address>:8888 in the browser address bar to connect to the car, find / jetracer/notebooks/. Open the interactive-regression.ipynb file.
- In this section, the camera is turned on, and the image resolution is set to 224*224.
- Note: Re-opening after program exit may prompt an error. You need to run this statement to restart the camera.
sudo systemctl restart nvargus-daemon
- Run all program units directly, the last program will display the following interface.
- At this time, you can put the car on the track, and open the teleoperation.ipynb program in the previous section to run, so that the remote control handle can control the movement of the car.
- Control the car to run along the track, every time you move a small position, use the mouse to move to the ideal running path of the car in the picture and click to save the picture and control the car to shoot 10 laps along the track.
- After collecting the data, select the value of epochs as 10, and then click train to train for 10 rounds.
- After training the data, you can click evaluate to evaluate the training model. If there is no problem with the collected data, you can see the ideal direction of the current car position in the leftmost image.
- Note that the collected data needs to move the trolley to different positions, offsets, and directions along the track, and select the farthest point along the ideal path to save it to ensure that the trolley will not leave the track or collide with objects.
Road-following
In this chapter, we use the trained model to implement autonomous driving.
- Enter http://<jetson_ip_address>:8888 in the browser address bar to connect to the car and find jetracer /noteboot/. Open the road_following.ipynb file.
- After the program runs to this section, the model file road_following_model_trt.pth converted and optimized using touch2trt will be produced in the directory. This optimization process may take several minutes to complete.
- Create a car and a camera. If the camera prompts an error, run the following command to restart the camera and run it again.
sudo systemctl restart nvargus-daemon
- This program is to run the output of image processing through the PD control trolley.
The *car.steering_offset parameter is to correct the initial state offset of the car caused by the mechanical error of the car. This parameter needs to be changed to the actual value of the car.
- car.throttle sets the maximum speed for the car to run. If the second value is set too high, the car will easily run off the track.
- Kp, and Kd are PID parameters, and PD adjustment is used here. This parameter can be debugged according to the actual running effect of the car.
Guide of DonkeyCar
- Setup Jetson Nano
- Setup Linux PC
- WEB Control
- Calibrate DonkeyCar
- Teleoperation
- Data Collection
- Train Data
- Auto-Driving
Resources
3D Drawing
Datasheet
FAQ
The account password of the JetRacer system is jetson.
{{{5}}}
The Linux system does not print the input content when entering the password, that is, touch typing is required. Type "jetson" directly on the keyboard and press Enter.
{{{5}}}
Due to the partition problem, the TF card with the image of the Jetson Nano programmed cannot recognize the drive letter normally on the Windows computer. If you need to reformat it, search for Disk Management in the search bar of Windows and open the Disk Management interface. Find the mobile disk where the TF card is located (be careful not to mistake it for another disk), right-click and select Delete Volume, then create a new volume and format it by default. After the default format, the drive letter of TF will be recognized again. At this time, the space and memory of the TF card are incorrect. Note that you need to use the formatting software to quickly format the new drive letter again. After formatting, if the memory space of the TF card is normal, the new image can be re-programmed normally.
{{{5}}}
Please open the terminal and run the following command to install torch-1.2.0
wget https://nvidia.app.box.com/public/static/06vlvedmqpqstu1dym49fo7aapgfyyu9.whl -O torch-1.2.0a0+8554416-cp36-cp36m-linux_aarch64.whl sudo apt-get install python3-pip libopenblas-base libopenmpi-dev pip3 install Cython pip3 install numpy torch-1.2.0a0+8554416-cp36-cp36m-linux_aarch64.whl --user sudo reboot
Do not forget to reboot at the end.
Support four 18650 batteries (not included) are used and the voltage of every battery is 3.7V. Generally, the voltage per battery is 4.2V when fully charged. Please use batteries without a protective plate.
BTW, the Power of JetRacer is down when the voltage of the whole system is similar to 9V (it is not accurate), we recommend you charge batteries if the voltage displayed is lower than 10V.
We recommend you use high-quality batteries like Sanyo or Panasonic.
{{{5}}}
The 8.4V power adapter is used to charge the batteries. DO NOT directly connect it to the Jetson Nano Developer board.
Please make sure that you have installed the codes of Waveshare instead of NVIDIA's. The drive codes of the motor are different between Waveshare's and NVIDIA's. If you have updated the one from NVIDIA, please remove the Jetracer folder and download ours by following step 5.
Support
Technical Support
If you need technical support or have any feedback/review, please click the Submit Now button to submit a ticket, Our support team will check and reply to you within 1 to 2 working days. Please be patient as we make every effort to help you to resolve the issue.
Working Time: 9 AM - 6 AM GMT+8 (Monday to Friday)