Sur d’autres sites (5335)

• FFMPEG does HTTP range request only once (HTML5 MediaStream/WebM)

  17 décembre 2018, par Youssef Gamil

  The Issue

  I am trying to pass HTML5 MediaStream coming from a browser’s webcam to a Socket.IO namespace which is buffered and be accessible to FFMPEG through HTTP endpoint in form of HTTP partial/range requests. Although, it works on perfectly on Firefox/Chrome.

  Here, I have wrapped a sample and pushed it to a GitHub repo

  Environment

  • FireFox or Chrome (but not Safari)
  • Node & NPM

  Install

  • npm i from the project directory

  Run

  • npm start : to start the express server
  • Open http://localhost:3000 in Firefox or Chrome, and accept the webcam access dialog.
  • npm run ffmpeg -i http://localhost:3000/view output.webm : TODO : this doesn’t output the full stream
    • http://localhost:3000/view will be visible once it was opened in Firefox/Chrome and they’ll keep requesting till the end of stream or server down.
    • note, npm run ffmpeg ... is a just a shortcut to ffmpeg executable dependency which should be installed at startup in node_modules/@ffmpeg-installer/linux-x64/ffmpeg (which may differ depending on your OS)

  FFMPEG Log

  What I get after running ffmpeg -v trace -i http://localhost:3000/view -y tmp.mp4 :

  Reading option '-v' ... matched as option 'v' (set logging level) with argument 'trace'.
  
  Reading option '-i' ... matched as input url with argument 'http://localhost:3000/view'.
  
  Reading option '-y' ... matched as option 'y' (overwrite output files) with argument '1'.
  
  Reading option 'tmp.mp4' ... matched as output url.
  
  Finished splitting the commandline.
  
  Parsing a group of options: global .
  
  Applying option v (set logging level) with argument trace.
  
  Applying option y (overwrite output files) with argument 1.
  
  Successfully parsed a group of options.
  
  Parsing a group of options: input url http://localhost:3000/view.
  
  Successfully parsed a group of options.
  
  Opening an input file: http://localhost:3000/view.
  
  [NULL @ 0x65f1c40] Opening 'http://localhost:3000/view' for reading
  
  [http @ 0x65f2540] Setting default whitelist 'http,https,tls,rtp,tcp,udp,crypto,httpproxy'
  
  [tcp @ 0x65f4000] Original list of addresses:
  
  [tcp @ 0x65f4000] Address 127.0.0.1 port 3000
  
  [tcp @ 0x65f4000] Interleaved list of addresses:
  
  [tcp @ 0x65f4000] Address 127.0.0.1 port 3000
  
  [tcp @ 0x65f4000] Starting connection attempt to 127.0.0.1 port 3000
  
  [tcp @ 0x65f4000] Successfully connected to 127.0.0.1 port 3000
  
  [http @ 0x65f2540] request: GET /view HTTP/1.1
  
  User-Agent: Lavf/58.18.104
  
  Accept: */*
  
  Range: bytes=0-
  
  Connection: close
  
  Host: localhost:3000
  
  Icy-MetaData: 1
  
  
  
  
  
  [http @ 0x65f2540] header='HTTP/1.1 206 Partial Content'
  
  [http @ 0x65f2540] http_code=206
  
  [http @ 0x65f2540] header='X-Powered-By: Express'
  
  [http @ 0x65f2540] header='Access-Control-Allow-Origin: *'
  
  [http @ 0x65f2540] header='Content-Range: bytes 0-1391616/1073741824'
  
  [http @ 0x65f2540] header='Accept-Ranges: bytes'
  
  [http @ 0x65f2540] header='Content-Length: 1391616'
  
  [http @ 0x65f2540] header='Connection: close'
  
  [http @ 0x65f2540] header='Content-Type: video/webm'
  
  [http @ 0x65f2540] header='Date: Mon, 17 Dec 2018 10:15:14 GMT'
  
  [http @ 0x65f2540] header=''
  
  Probing matroska,webm score:100 size:2048
  
  Probing mp3 score:1 size:2048
  
  [matroska,webm @ 0x65f1c40] Format matroska,webm probed with size=2048 and score=100
  
  st:0 removing common factor 1000000 from timebase
  
  st:1 removing common factor 1000000 from timebase
  
  [matroska,webm @ 0x65f1c40] Before avformat_find_stream_info() pos: 317 bytes read:3837 seeks:0 nb_streams:2
  
  [matroska,webm @ 0x65f1c40] All info found
  
  [matroska,webm @ 0x65f1c40] rfps: 29.750000 0.016025
  
  [matroska,webm @ 0x65f1c40] rfps: 29.833333 0.013167
  
  [matroska,webm @ 0x65f1c40] rfps: 29.916667 0.012378
  
  [matroska,webm @ 0x65f1c40] rfps: 30.000000 0.013659
  
  [matroska,webm @ 0x65f1c40] rfps: 29.970030 0.012960
  
  [matroska,webm @ 0x65f1c40] stream 0: start_time: 0.000 duration: -9223372036854776.000
  
  [matroska,webm @ 0x65f1c40] stream 1: start_time: -0.001 duration: -9223372036854776.000
  
  [matroska,webm @ 0x65f1c40] format: start_time: -0.001 duration: -9223372036854.775 bitrate=0 kb/s
  
  [matroska,webm @ 0x65f1c40] After avformat_find_stream_info() pos: 467388 bytes read:469955 seeks:0 frames:115
  
  Input #0, matroska,webm, from 'http://localhost:3000/view':
  
    Metadata:
  
      encoder         : QTmuxingAppLibWebM-0.0.1
  
    Duration: N/A, start: -0.001000, bitrate: N/A
  
      Stream #0:0(eng), 41, 1/1000: Video: vp8, 1 reference frame, yuv420p(progressive), 640x480, 0/1, SAR 1:1 DAR 4:3, 1k tbr, 1k tbn, 1k tbc (default)
  
      Stream #0:1(eng), 74, 1/1000: Audio: opus, 48000 Hz, stereo, fltp, delay 312 (default)
  
  Successfully opened the file.
  
  Parsing a group of options: output url tmp.mp4.

• How can I recieve an RTP stream with JavaCV ?

  11 janvier 2019, par c.berger

  I’m trying to stream video from an RTP server (currently VLC for testing) and decode it in Java. To do this, I’m using JavaCV to decode the incoming stream. Here’s what I have so far :

  try {
  
      grabber = new FFmpegFrameGrabber("rtp://localhost:5004/test");
  
      grabber.setFormat("h264");
  
      grabber.setFrameRate(30.0);
  
      grabber.start();
  
      Java2DFrameConverter converter = new Java2DFrameConverter();
  
      while (true) {
  
          Frame frame = grabber.grab();
  
          imageToDraw = frame != null ? converter.convert(frame) : null;
  
          // goes off to paint a widget on a window, see https://git.io/fhZSr for more context
  
          repaint();
  
      }
  
  } catch (Exception e) {
  
      // TODO: Discover what circumstances cause this
  
      e.printStackTrace(System.out);
  
  }

  On VLC, my stream settings are set like this :

  • Destination stream : RTP/TS (address localhost, port 5004, and stream name test.)
  • Transcoding active, set to "Video - H.264 + MP3 (TS)" preset :
    • MPEG-TS encapsulation
    • h.264 video with MPEG audio
  • Stream all elementary streams is off.

  I can get one VLC instance to stream to another with these settings (with the "client" VLC receiving from rtp://localhost:5004/test), and it works just fine. (The only issues arise from having a weak test machine not suited transcoding high res video.)

  Switch over to Java, and all I can see is gray frames with a spat of color here and there. The console is also screaming the whole way through. Some snippets (the full log is too long to be a reasonable post, but it can be found here if you really want it) :

  [h264 @ 0x7f6c4c3502c0] cabac decode of qscale diff failed at 8 12
  
  [h264 @ 0x7f6c4c3502c0] error while decoding MB 8 12, bytestream 670
  
  [h264 @ 0x7f6c4c3502c0] concealing 421 DC, 421 AC, 421 MV errors in P frame

  ---

  [h264 @ 0x7f6c4c3502c0] Reference 4 >= 2
  
  [h264 @ 0x7f6c4c3502c0] error while decoding MB 25 8, bytestream 416
  
  [h264 @ 0x7f6c4c3502c0] concealing 556 DC, 556 AC, 556 MV errors in B frame

  ---

  [h264 @ 0x7f6c4c3502c0] Reference 5 >= 4
  
  [h264 @ 0x7f6c4c3502c0] error while decoding MB 21 1, bytestream 6042
  
  [h264 @ 0x7f6c4c3502c0] concealing 826 DC, 826 AC, 826 MV errors in P frame
  
  [h264 @ 0x7f6c4c3502c0] Invalid NAL unit 8, skipping.
  
  [above line repeats 5x]
  
  [h264 @ 0x7f6c4c3502c0] top block unavailable for requested intra mode
  
  [h264 @ 0x7f6c4c3502c0] error while decoding MB 3 0, bytestream 730
  
  [h264 @ 0x7f6c4c3502c0] concealing 836 DC, 836 AC, 836 MV errors in P frame

  Is there something I am clearly doing wrong ?

• Save a RTSP stream to mp4 file in android

  13 février 2019, par avi

  I am working on a project where I need to read input stream from an IPCamera. I am able to fetch this in through an rtsp url.

  Display the IPCamera stream. I am able to do same by using -

      videoView = (VideoView) this.findViewById(R.id.videoView1);
  
      MediaController mc = new MediaController(this);
  
      videoView.setMediaController(mc);
  
      videoView.setVideoURI(Uri.parse("rtsp://xxxxxxxx/camera1"));
  
      videoView.requestFocus();

  Now I want to record this stream to an MP4 file. For same I am using mediarecorder.Here I am stuck.

      MediaRecorder mediaRecorder = new MediaRecorder();
  
      //mediaRecorder.setAudioSource(MediaRecorder.AudioSource.DEFAULT);
  
      mediaRecorder.setVideoSource(MediaRecorder.VideoSource.CAMERA);
  
      mediaRecorder.setOutputFormat(MediaRecorder.OutputFormat.DEFAULT);
  
      mediaRecorder.setOutputFile("rtsp://xxxxxxxxx/camera1");
  
      try {
  
          mediaRecorder.prepare();
  
      } catch (IllegalStateException e) {
  
          // TODO Auto-generated catch block
  
          e.printStackTrace();
  
      } catch (IOException e) {
  
          // TODO Auto-generated catch block
  
          e.printStackTrace();
  
      }
  
      mediaRecorder.start();

  Thanks