Support for rtmp broadcast

[abhitronix]

Support for rtmp broadcast

[TerehinAV]

Thanks!
I'll try what you advised and look forward to the new release of Vidgear

[abhiTronix]

I know how to implement original command, but I don't know how to add cv2 processing in it.
In common example cv2 processing is in "while True" loop, and execute_ffmpeg_cmd is calling after writer's close method is called.
And I'm looking for a way to process frames and stream it "on the go" like NetGear's send method.

@TerehinAV To implement this, You need an live RTSP pipeline over FFmpeg. This can be the next enhancement to vidgear but currently, I don't have enough time to make this implementation. I'll add this feature in the next release. For now, kindly use NetGear API for network streaming with vidgear and also for live WebRTC streaming with opencv see this library: https://github.com/aiortc/aiortc

[abhiTronix]

@TerehinAV See http://trac.ffmpeg.org/wiki/ffserver. The support for FFserver has been removed, with a warning stating that:

Warning: ffserver has been removed on 2018-01-06. If you still need it checkout commit 2ca65fc or use the 3.4 release branch. The original documentation has been archived and can be downloaded as ​HTML or ​PDF while the sample ffserver configuration file can be found below. We can provide no support for ffserver.

Therefore I don't think we can work on this feature anymore.

[abhiTronix]

Now, I need an rtmp publisher using your library or opencv.

@locdoan12121997 You don't need a separate API for doing this but you can simply use VidGear's powerful CamGear API for this purpose. Just feed the URL of the device/app you want to stream to the source parameter of CamGear API to implement an RTMP publisher as follows:

from vidgear.gears import CamGear
import cv2

stream = CamGear(source='rtmp://127.0.0.1:1935').start() # feed your correct rtmp URL here

# infinite loop
while True:
	
	frame = stream.read()
	# read frames

	# check if frame is None
	if frame is None:
		#if True break the infinite loop
		break
	
	# do something with frame here
	
	cv2.imshow("Output Frame", frame)
	# Show output window

	key = cv2.waitKey(1) & 0xFF
	# check for 'q' key-press
	if key == ord("q"):
		#if 'q' key-pressed break out
		break

cv2.destroyAllWindows()
# close output window

stream.stop()
# safely close video stream.

[abhiTronix]

Closed. Feel free to reopen if it doesn't work for you.

[TerehinAV]

Good day!
I continue to try to create a stream with the processed video.
Question: can I use vidgear with ffserver?
In this case, an audio track is not needed.

The case is:

1. The url of the stream is transmitted to the input.
2. The script processes the frames.
3. frames are transmitted to ffserver

In the console without processing, this could be done by a command like:

ffmpeg -i <source_url> -vcodec libx264 -tune zerolatency -crf 18 http://localhost:1234/feed1.ffm

Where http://localhost:1234/feed1.ffm - from ffserver config

The final goal is to create processed video stream (rtmp) with URL, which can be opened in any player that supports this (for example, VLC)

[abhiTronix]

@TerehinAV

can I use vidgear with ffserver?

Nope, only the FFmpeg pipeline is accessible with vidgear.

In the console without processing, this could be done by a command like:

ffmpeg -i <source_url> -vcodec libx264 -tune zerolatency -crf 18 http://localhost:1234/feed1.ffm

If you want to implement this command then follow following steps as before:

• Kindly install the related PR(#77) as follows:

git clone https://github.com/abhiTronix/vidgear.git
cd vidgear
git checkout development
sudo pip3 install .
cd

• Then run following code, ⚠️ Change streaming URLs below with yours

from vidgear.gears import WriteGear
from vidgear.gears import VideoGear
import cv2


#type your url here
source_url = "www/forexample.com/r.mp4"
output_url = "http://localhost:1234/feed1.ffm"


#open stream
stream = VideoGear(source=source_url).start() #Open input video stream for getting framerate

#ready your parameters
output_params = {"-input_framerate":stream.framerate} #assign framerate

#close stream
stream.stop()


#define writer
writer = WriteGear(output_filename = 'Output.mp4', logging = True, **output_params) #Define writer 

#define parameter
ffmpeg_command = ['-y', '-i', source_url, '-vcodec', 'libx264', '-tune', 'zerolatency', '-crf', '18', output_url]
# `-y` parameter is to overwrite outputfile if exists

#execute FFmpeg command
writer.execute_ffmpeg_cmd(ffmpeg_command)

#clean resources
writer.close()

[TerehinAV]

This is not exactly what I'm looking for. I know how to implement original command, but I don't know how to add cv2 processing in it.
In common example cv2 processing is in "while True" loop, and execute_ffmpeg_cmd is calling after writer's close method is called.
And I'm looking for a way to process frames and stream it "on the go" like NetGear's send method.

[abhiTronix]

WriteGear API now supports URLs as input. Successfully resolved and merged in commit d76c8be.

[JacobBothell]

I have followed your example that is in the code and tried to replicate what your function test is doing but i am still not able to stream to a local rtmp server the line i am erroring on is:

writer = WriteGear(output_filename = 'rtmp://localhost/relay/test", logging = True)

i am getting the error:

AssertionError: [WriteGear:ERROR] :: Permission Denied: Cannot write to directory: [...]/rtmp:/localhost/relay

My system is Ubuntu 18.04 Python 3.6.9

[abhiTronix]

AssertionError: [WriteGear:ERROR] :: Permission Denied: Cannot write to directory: [...]/rtmp:/localhost/relay

@JacobBothell This feature hasn't been merged into master branch yet. Install vidgear with testing branch using these instructions: https://abhitronix.github.io/vidgear/installation/source_install/#installation for trying it out early.

[RTY0310]

WriteGear :: WARNING :: The given path:rtmp://192.6.94.12/live/test does not have write access permission. Skipped!
WriteGear :: DEBUG :: Compression Mode is enabled therefore checking for valid FFmpeg executables.
WriteGear :: DEBUG :: Output_params Dict: {'-vcodec': 'h264_nvmpi'}
Helper :: DEBUG :: Final FFmpeg Path: ffmpeg
Helper :: DEBUG :: FFmpeg validity Test Passed!
Helper :: DEBUG :: Found valid FFmpeg Version: b'd359b75' installed on this system
WriteGear :: DEBUG :: Found valid FFmpeg executables: ffmpeg.
Helper :: DEBUG :: URL scheme rtmp is supported by FFmpeg.
WriteGear :: DEBUG :: URL:rtmp://192.6.94.12/live/test is sucessfully configured for streaming.
WriteGear :: DEBUG :: Compression Mode is configured properly!
WriteGear :: DEBUG :: InputFrame => Height:720 Width:1280 Channels:1
WriteGear :: DEBUG :: Executing FFmpeg command: ffmpeg -y -f rawvideo -vcodec rawvideo -s 1280x720 -pix_fmt gray -i - -vcodec h264_nvmpi rtmp://192.6.94.12/live/test
ffmpeg version d359b75 Copyright (c) 2000-2020 the FFmpeg developers
built with gcc 7 (Ubuntu/Linaro 7.5.0-3ubuntu1~18.04)
configuration: --enable-nvmpi
libavutil 56. 31.100 / 56. 31.100
libavcodec 58. 54.100 / 58. 54.100
libavformat 58. 29.100 / 58. 29.100
libavdevice 58. 8.100 / 58. 8.100
libavfilter 7. 57.100 / 7. 57.100
libswscale 5. 5.100 / 5. 5.100
libswresample 3. 5.100 / 3. 5.100
Input #0, rawvideo, from 'pipe:':
Duration: N/A, start: 0.000000, bitrate: 184320 kb/s
Stream #0:0: Video: rawvideo (Y800 / 0x30303859), gray, 1280x720, 184320 kb/s, 25 tbr, 25 tbn, 25 tbc
[NULL @ 0x558ad71ad0] Unable to find a suitable output format for 'rtmp://192.6.94.12/live/test'
rtmp://192.6.94.12/live/test: Invalid argument
WriteGear :: ERROR :: BrokenPipeError caught, Wrong values passed to FFmpeg Pipe, Kindly Refer Docs!
Traceback (most recent call last):
File "/home/keti/.local/lib/python3.6/site-packages/vidgear/gears/writegear.py", line 311, in write
self.__process.stdin.write(frame.tostring())
BrokenPipeError: [Errno 32] Broken pipe

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "testvv.py", line 26, in
writer.write(gray)
File "/home/keti/.local/lib/python3.6/site-packages/vidgear/gears/writegear.py", line 317, in write
raise ValueError # for testing purpose only
ValueError

When I reinstall and run it, it does not work with the above error.

[abhiTronix]

[NULL @ 0x558ad71ad0] Unable to find a suitable output format for 'rtmp://192.6.94.12/live/test'
rtmp://192.6.94.12/live/test: Invalid argument

@nagneff You are not defining format for your RTMP stream. See FFmpeg StreamingGuide you atleast need -preset ultrafast -vcodec libx264 -tune zerolatency -b 900k -f mpegts like parameter (remember -f format is critical) at minimum for a valid RTMP stream.