Recherche avancée

Sur d’autres sites (11402)

• Capture CMOS video with FPGA, encode and send over Ethernet

  23 décembre 2015, par ya_urock

  I am planning a open source university project for my students based on Zynq Xilinx FPGA that will capture CMOS video, encode it into transport stream and send it over Ethernet to remote PC. Basically I want to design yet another IP camera. I have strong FPGA experience, but lack knowledge regarding encoding and transfering video data. Here is my plan :

  1. Connect CMOS camera to FPGA, recieve video frames and save them to external DDR memory, verify using HDMI output to monitor. I have no problems with that.

  2. I understand that I have to compress my video stream for example to H.264 format and put into transport stream. Here I have little knowledge and require some hints.

  3. After I form transport stream I can send it over network using UDP packets. I have working hardware solution that reads data from FIFO and sends it to remote PC as UDP papckets.

  4. And finally I plan to receive and play video using ffmpeg library.

     ffplay udp://localhost:5678

  My question is basically regarding 2 step. How do I convert pixel frames to transport stream ? My options are :

  1. Use commercial IP, like
     • http://www.xilinx.com/products/intellectual-property/1-4iso32.html
     • http://www.xilinx.com/products/intellectual-property/1-1lk9j1.html#overview

  Here I doubt that they are free to use and we don’t have much funds.

  2. Use open cores like

     • http://sourceforge.net/projects/hardh264/ - here core generates only h264 output, but how to encapsulate it into transport stream ?
     • I have searched opencores.org but with no success on this topic
     • Maybe somebody knows some good open source relevant FPGA projects ?

  3. Develop harware encoder by myself using Vivado HLS (C Language). But here is the problem that I don’t know the algorithm. Maybe I could gig ffmpeg or Cisco openh264 library and find there a function that converts raw pixel frames to H.264 format and then puts it into transport stream ? Any help would be appriciated here also.

  Also I am worried about format compatibility of stream I might generate inside FPGA and the one expected at host by ffplay utility. Any help, hints, links and books are appriciated !

• avio_open2 fails randomly for RTMPS Facebook live streaming

  3 janvier, par Usama

  I am trying to re stream a video to Facebook RTMPS endpoint and , facing an issue specifically with Facebook's RTMPS endpoint . I have tried with linkedin RTMPS endpoint and its working fine , but Facebook end point some times works and fails some times its totally random . The avio_open2 call sometimes fails randomly, returning a -5 error. This only seems to happen with the Facebook endpoint .on ffmpeg log side I see that the handshake was successful , I don't understand the reason for failure here. (i am running in multithreaded environment )

  


  int ret = avformat.avio_open2(pb, url , AVIO_FLAG_WRITE, null, getOptionDictionary()) ;

  


  [rtmps @ 0x7a5978023640] Handshaking...
[rtmps @ 0x7a5978023640] Type answer 3
[rtmps @ 0x7a5978023640] Server version 1.0.5.4
[rtmps @ 0x7a5978023640] Proto = rtmps, path = /rtmp/FB-1709082269638040-0-test-KRmT_Y, app = rtmp, fname = FB-1709082269638040-0-AbyNzKGtN-KRmT_Y
[rtmps @ 0x7a5978023640] Window acknowledgement size = 5000000
[rtmps @ 0x7a5978023640] Max sent, unacked = 5000000
[rtmps @ 0x7a5978023640] New incoming chunk size = 4096
[rtmps @ 0x7a5978023640] Releasing stream...
[rtmps @ 0x7a5978023640] FCPublish stream...
[rtmps @ 0x7a5978023640] Creating stream...
[rtmps @ 0x7a5978023640] Sending publish command for 'FB-test-0-test-KRmT_Y'
[rtmps @ 0x7a5964021780] No default whitelist set
[tls @ 0x7a596402a900] No default whitelist set
[tcp @ 0x7a596402ab00] No default whitelist set
[tcp @ 0x7a596402ab00] Original list of addresses:
[tcp @ 0x7a596402ab00] Address 57.144.176.149 port 443
[tcp @ 0x7a596402ab00] Address 2a03:2880:f358:95:face:b00c:0:1411 port 443
[tcp @ 0x7a596402ab00] Interleaved list of addresses:
[tcp @ 0x7a596402ab00] Address 57.144.176.149 port 443
[tcp @ 0x7a596402ab00] Address 2a03:2880:f358:95:face:b00c:0:1411 port 443
[tcp @ 0x7a596402ab00] Starting connection attempt to 57.144.176.149 port 443
[tcp @ 0x7a596402ab00] Successfully connected to 57.144.176.149 port 443



  


  My java cpp and ffmpeg version is

  


  1.5.11
7.1-${javacpp.version}


  


• Receive RTSP stream within docker container

  12 août 2021, par Wayne

  I am trying to decode a camera rtsp stream using ffmpeg_libs within a ubuntu docker container. The ffmpeg debug output seems to show that it successfully negotiates the rtsp-digest authentication (ie. RTSP/1.0 200 OK), and receives an SPS (nalu 7) and PPS (nalu 8), but nothing after that. It times out, retries, etc. That doesn’t really make sense to me.

  



  The same code compiled and run locally (not in docker) works fully.

  



  Also, if I decode a file, the code works fine both locally and in docker container. So, the basic ffmpeg_lib decode is working. The difficulty is with the stream interface running in docker.

  



  Is there additional authentication through the docker interface, or maybe port access, or something ? I’m not much of a networking guy, so I’m really lost at this point.

  



  The ffmpeg logs is below, and my docker run command is :

  



  docker run -it --name VideoRx videorx:latest (also tried with -p 554)


  



  Any help will be very much appreciated.
  
Thanks,
Wayne

  



  avformat_version(): 3756900  Build: 3756900  Ident: Lavf57.83.100
avformat_open_input(): rtsp://admin:public_pwd@192.168.1.237
Probing rtsp score:100 size:0
[tcp @ 0x56263b430a20] No default whitelist set
[rtsp @ 0xaddr1] Sending:
OPTIONS rtsp://192.168.1.237:554 RTSP/1.0

... [snipped]
Initial authentication handshake (OPTIONS, DESCRIBE, SETUP).
All success, server replies: 'RTSP/1.0 200 OK'
....

[rtsp @ 0xaddr1] Sending:
PLAY rtsp://192.168.1.237:554/ RTSP/1.0
Range: npt=0.000-
CSeq: 5
User-Agent: Lavf57.83.100
Session: 420467284
Authorization: Digest username="admin", realm="IP Camera(C1003)", nonce="129b254c8da4e0ffb530f64f79938bcd", uri="rtsp://192.168.1.237:554/", response="82c6c0f1fadea3739846866e8e50e855"

--
[rtsp @ 0xaddr1] line='RTSP/1.0 200 OK' 
[rtsp @ 0xaddr1] line='CSeq: 5'
[rtsp @ 0xaddr1] line='Session:        420467284'
[rtsp @ 0xaddr1] line='RTP-Info: url=rtsp://192.168.1.237:554/trackID=1;seq=43938;rtptime=4022155312'
[rtsp @ 0xaddr1] line='Date:  Thu, Aug 02 2018 15:53:00 GMT'
[rtsp @ 0xaddr1] line=''
avformat_open_input(): Success erc: 0
avformat_find_stream_info()
[h264 @ 0xaddr2] nal_unit_type: 7, nal_ref_idc: 3
[h264 @ 0xaddr2] nal_unit_type: 8, nal_ref_idc: 3
[rtsp @ 0xaddr1] UDP timeout, retrying with TCP 
[rtsp @ 0xaddr1] ...
... Stalls waiting for additional packets