Tag Archives: Raspberry Pi Camera

AI on the Jetson Nano LESSON 52: Improving Picture Quality of the Raspberry Pi Camera with Gstreamer

In this lesson we want to pause and work on improving the image quality of the video stream coming from the Raspberry Pi camera. Right now, we are using a boilerplate Gstreamer string to launch the Raspberry Pi camera. In the video above we show how image quality can be drastically improved by tweaking the Gstreamer launch string.

Based on the Video above, we develop a greatly improved image quality by adjusting the Gstreamer launch string. Below, for you enjoyment is the code that will optimize picture quality.

First, this is the key line that results in excellent video quality:

And here is the overall code for running and displaying from the camera with the enhanced quality:

 

Now, once we have optimized the Gstreamer launch stream, we need to consider what path to move forward. In lesson #50 we saw that we could either control the camera using the NVIDIA Jetson Utilities, or we could control the camera normally from OpenCV. The advantage of our old OpenCV method is that it gives us more control of the camera. The advantage of the Jetson Utility method is that it appears to run faster, and for the rPi camera, have less latency. Below are two code examples for the two methods above. In the video lesson above, we will figure out the best strategy by tweaking the parameters in these two programas.

OPTION #1: Launch the cameras using OpenCV

OPTION # 2: Control Camera with NVIDIA Jetson Utilities Library

 

Jetson Xavier NX Lesson 8: Controlling Dual Pan/Tilt Raspberry Pi Cameras


In this lesson we show how to independently control two Raspberry Pi Cameras using servo controlled pan/tilt brackets. This work will serve as the foundation for allowing us to create cameras that scan a room and locate objects of interest.

In this lesson, I am using two pan/tilt camera mounts. You can get the gear I am using on amazon HERE. I suggest purchasing two units.

Then, we also need two Version two raspberry pi cameras. I like the following ones, because they include a neat little acrylic case, and the long cable, which makes it work much better on the pan/tilt bracket. You can get the cameras HERE.

If you do not have a Jetson Xavier NX yet, you can pick up the gear I am using below:

  1. First, you will need the Jetson Xavier NX, which you can get HERE:
  2. You will want a quality, large SD card, I have very good luck with this one HERE:
  3. You will need a camera. I have found that the Jetson Xavier NX works very well with most Logitech Webcams, but these cameras are a little hard to find right now. I suggest the best option if you do not have a logitech webcam is to get the Raspberry Pi Version 2 camera, which works very well. You can pick the camera up HERE.
  4. It is optional, but I have found that it is nice to have an extra, longer cable for the Raspberry Pi camera, which is available HERE. Also, a small case/stand for the camera is nice and you can get the one I use HERE.
  5. The Jetson Nano has a slot for a SSD drive. I really like having the SSD drive attached, and makes it much easier to keep your work backed up. The projects in these lessons will work fine with just the SD card, but if you like, the SSD drive makes life easier (note even with SSD drive, you will still need the SD card above). You can get the SSD drive I am using HERE.
  6. You can use USB keyboard and mouse, but I like to preserve my USB slots for other things, so like using a wireless keyboard and mouse. This is optional, but I have found these work well on the Jetson Xavier NX, and you can get what I am using HERE.
  7. You will need an HDMI cable and monitor, which you probably already have.

 

Jetson Xavier NX Lesson 7: Connecting and Controlling Servos

In this lesson we show you how to control a pan/tilt camera bracket with the NVIDIA Jetson Xavier NX. We go through the physical build of the bracket, how to connect the circuit, and then how to program the servos. We use the Adafruit circuitpython library, and show how to download and use the library. If you want to play along at home, you can pick the pan/tilt bracket and servos up HERE, and you can grab a couple of Raspberry Pi cameras HERE.

Below is the simple code for moving the servo using the Jetson Xavier NX:

 

Jetson Xavier NX Lesson 5: Improving Raspberry Pi Camera Image Quality in Gstreamer

In this video we show you the keys to radically improving the image quality from the Raspberry Pi Camera. We show how to set Gstreamer caps and props in OpenCV to get stunning image ‘pop’ from this inexpensive camera. If you follow this lesson you will be able to get better image quality from your Raspberry Pi cameras.

The code below has the improved camSet string we developed in this lesson. I have noticed that there can be variation between different Raspberry Pi cameras. Hence, you can adjust the parameters to get the best quality image from your particular camera. Also, results will depend on lighting conditions. You can adjust the wbmode to match your lighting situation, and you can tweak the contrast, brightness and saturation to dial in the perfect picture quality.

 

Jetson Xavier NX Lesson 3: Using a WEB cam or Raspberry Pi camera in OpenCV with Gstreamer

In this video lesson we learn how to launch the Raspberry Pi Camera or a simple WEB cam on the Jetson Xavier NX using openCV and a Gstreamer command. This simple code shows you how to set up the camera, and then how to grab a frame and show a frame to create live video from the cameras.