Massive investment on agrochemicals from the farmers’ end on crops for protection against crop health issues, diseases, and pest attacks, leading to high chemical residue content in the final product, thus reducing the quality of the produce, productivity, and polluting the farm environment. Also large use of water into crops leading to unwanted wastage of water.
For the farmers cultivating crops, an OAK-D enabled quadruped robot with robotic arm to effectively spray water/pesticides/insecticides on the crops by identifying the crop or the pests, thus saving farmers investment on agrochemicals and water, utilizing the depth capability to detect the pest and analyze the pest infection in the process.
We followed the GitHub repo by Mike4192 for this version. Go to this link to learn more. The default implementation is on Raspberry Pi 3 Model B and ROS kinetic, since we used Nvidia Jetson Nano we invested some time on migrating to ROS melodic. After installing ROS melodic on Nvidia Jetson Nano, run,
git clone https://github.com/kishorkuttan/AI-Quadruped-Robot-For-Agriculture.git
source /opt/ros/kinetic/setup.bash
mkdir -p ~/catkin_temp
cp -a /path/to/AI-Quadruped-Robot-For-Agriculture/src/ ~/catkin_temp/
catkin build
source devel/setup.bash
If you find errors during catkin build install necessary libraries or directly copy the libraries to /src/ folder and re run catkin_build
Go to this link for spot micro 3D print files. We made slight modification due to stability and structural issues in the default print.
The files are under the folder /Arm 3D print stl files/
Connect as per the diagram and control the Raspberry Pi Zero W through VNC and run,
python arm_and_spray.py
In this script it calculates angles for servo motors using IK and also starts the DC motor pump after getting the x,y,z location data from OAK-D.
connect the OAK-D to the host
python spatial_mobilenet.py
main.mp4
prot1.mp4
walking_grass.mp4
python spatial_mobilenet_custom.py
Pest detection TensorFlow 1.x pipeline
pest_detection.mp4
Run
python gyro visualization