Recherche avancée

Sur d’autres sites (11380)

• JavaFX MediaPlayer unable to play local m3u8 file

  3 mai 2017, par Lennart

  I want to show a live stream of a web cam in my JavaFX application using the MediaPlayer/MediaView. My attempt was to use ffmpeg to record a HLS and to play the resulting m3u8 file, but that throws the following exception (VLC plays the video without problems) :

  MediaException: UNKNOWN : com.sun.media.jfxmedia.MediaException: Could not create player! : com.sun.media.jfxmedia.MediaException: Could not create player!
  
      at javafx.scene.media.MediaException.exceptionToMediaException(MediaException.java:146)
  
      at javafx.scene.media.MediaPlayer.init(MediaPlayer.java:511)
  
      at javafx.scene.media.MediaPlayer.<init>(MediaPlayer.java:414)
  
      at de.fraunhofer.iosb.ias.flow.assessment.management.monitor.MonitorViewController.testStream(MonitorViewController.java:203)
  
      ... 58 more
  
  Caused by: com.sun.media.jfxmedia.MediaException: Could not create player!
  
      at com.sun.media.jfxmediaimpl.NativeMediaManager.getPlayer(NativeMediaManager.java:274)
  
      at com.sun.media.jfxmedia.MediaManager.getPlayer(MediaManager.java:118)
  
      at javafx.scene.media.MediaPlayer.init(MediaPlayer.java:467)
  
      ... 60 more
  
  </init>

  I debugged the player creation and the error occurs inside the constructor of GSTMediaPlayer when GSTMediaPlayer.gstInitPlayer() is called. This native method returns the error code 257, which javafx maps to MediaError.ERROR_MEDIA_NULL.

  I used the following ffmpeg command to record the video :

  ffmpeg -hide_banner -y -rtbufsize 250MB -f dshow -pixel_format yuv420p -video_size 960x720 -i video="Logitech HD Pro Webcam C920" -c:v libx264 -crf 20 -pix_fmt yuv420p out.m3u8

  I’m pretty sure that the encoding matches the requirements of javafx, because if I change the output container from m3u8 to mp4, the video is played without problems using the exact same ffmpeg command.

  This is the output of ffprobe for the m3u8 file :

  Input #0, hls,applehttp, from 'out.m3u8':
  
    Duration: 00:00:24.23, start: 1.466667, bitrate: 0 kb/s
  
    Program 0
  
      Metadata:
  
        variant_bitrate : 0
  
      Stream #0:0: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 960x720, 30 fps, 30 tbr, 90k tbn, 60 tbc

  And for the mp4 file :

  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'out.mp4':
  
    Metadata:
  
      major_brand     : isom
  
      minor_version   : 512
  
      compatible_brands: isomiso2avc1mp41
  
      encoder         : Lavf57.41.100
  
    Duration: 00:01:04.93, start: 0.000000, bitrate: 1676 kb/s
  
      Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 960x720, 1673 kb/s, 30 fps, 30 tbr, 10000k tbn, 60 tbc (default)
  
      Metadata:
  
        handler_name    : VideoHandler

  The resulting m3u8 file looks like this :

  #EXTM3U
  
  #EXT-X-VERSION:3
  
  #EXT-X-TARGETDURATION:9
  
  #EXT-X-MEDIA-SEQUENCE:0
  
  #EXTINF:8.333322,
  
  out0.ts
  
  #EXTINF:8.333333,
  
  out1.ts
  
  #EXTINF:7.133322,
  
  out2.ts
  
  #EXTINF:0.433333,
  
  out3.ts
  
  #EXT-X-ENDLIST

  Update : After I found this reference m3u file, I think that the problem is that the file is stored locally and isn’t delivered via HTTP. The video plays fine with this :

  Media media = new Media("http://download.oracle.com/otndocs/products/javafx/JavaRap/prog_index.m3u8");
  
  MediaPlayer player = new MediaPlayer(media);
  
  player.setAutoPlay(true);
  
  mediaView.setMediaPlayer(player);

  But after I downloaded the reference m3u and all of its segments and tried to open the local file like this, the error occurred again :

  File video = new File("H://Projects//Tools//ref//prog_index.m3u8");
  
  Media media = new Media(video.toURI().toString());
  
  MediaPlayer player = new MediaPlayer(media);
  
  player.setAutoPlay(true);
  
  mediaView.setMediaPlayer(player);

  I tried to change my m3u file so that the segements are referenced with absolute paths. I tried different notations (H:\f\out0.ts, H:/f/out0.ts, H://f//out0.ts, file:/H:/f/out0.ts, file:///H:/f/out0.ts), but I couldn’t get it to work.

• JavaFX MediaPlayer unable to play local m3u8 file

  22 février 2020, par Lennart

  I want to show a live stream of a web cam in my JavaFX application using the MediaPlayer/MediaView. My attempt was to use ffmpeg to record a HLS and to play the resulting m3u8 file, but that throws the following exception (VLC plays the video without problems) :

  MediaException: UNKNOWN : com.sun.media.jfxmedia.MediaException: Could not create player! : com.sun.media.jfxmedia.MediaException: Could not create player!
  
      at javafx.scene.media.MediaException.exceptionToMediaException(MediaException.java:146)
  
      at javafx.scene.media.MediaPlayer.init(MediaPlayer.java:511)
  
      at javafx.scene.media.MediaPlayer.<init>(MediaPlayer.java:414)
  
      at de.fraunhofer.iosb.ias.flow.assessment.management.monitor.MonitorViewController.testStream(MonitorViewController.java:203)
  
      ... 58 more
  
  Caused by: com.sun.media.jfxmedia.MediaException: Could not create player!
  
      at com.sun.media.jfxmediaimpl.NativeMediaManager.getPlayer(NativeMediaManager.java:274)
  
      at com.sun.media.jfxmedia.MediaManager.getPlayer(MediaManager.java:118)
  
      at javafx.scene.media.MediaPlayer.init(MediaPlayer.java:467)
  
      ... 60 more
  
  </init>

  I debugged the player creation and the error occurs inside the constructor of GSTMediaPlayer when GSTMediaPlayer.gstInitPlayer() is called. This native method returns the error code 257, which javafx maps to MediaError.ERROR_MEDIA_NULL.

  I used the following ffmpeg command to record the video :

  ffmpeg -hide_banner -y -rtbufsize 250MB -f dshow -pixel_format yuv420p -video_size 960x720 -i video="Logitech HD Pro Webcam C920" -c:v libx264 -crf 20 -pix_fmt yuv420p out.m3u8

  I’m pretty sure that the encoding matches the requirements of javafx, because if I change the output container from m3u8 to mp4, the video is played without problems using the exact same ffmpeg command.

  This is the output of ffprobe for the m3u8 file :

  Input #0, hls,applehttp, from 'out.m3u8':
  
    Duration: 00:00:24.23, start: 1.466667, bitrate: 0 kb/s
  
    Program 0
  
      Metadata:
  
        variant_bitrate : 0
  
      Stream #0:0: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 960x720, 30 fps, 30 tbr, 90k tbn, 60 tbc

  And for the mp4 file :

  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'out.mp4':
  
    Metadata:
  
      major_brand     : isom
  
      minor_version   : 512
  
      compatible_brands: isomiso2avc1mp41
  
      encoder         : Lavf57.41.100
  
    Duration: 00:01:04.93, start: 0.000000, bitrate: 1676 kb/s
  
      Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 960x720, 1673 kb/s, 30 fps, 30 tbr, 10000k tbn, 60 tbc (default)
  
      Metadata:
  
        handler_name    : VideoHandler

  The resulting m3u8 file looks like this :

  #EXTM3U
  
  #EXT-X-VERSION:3
  
  #EXT-X-TARGETDURATION:9
  
  #EXT-X-MEDIA-SEQUENCE:0
  
  #EXTINF:8.333322,
  
  out0.ts
  
  #EXTINF:8.333333,
  
  out1.ts
  
  #EXTINF:7.133322,
  
  out2.ts
  
  #EXTINF:0.433333,
  
  out3.ts
  
  #EXT-X-ENDLIST

  Update : After I found this reference m3u file, I think that the problem is that the file is stored locally and isn’t delivered via HTTP. The video plays fine with this :

  Media media = new Media("http://download.oracle.com/otndocs/products/javafx/JavaRap/prog_index.m3u8");
  
  MediaPlayer player = new MediaPlayer(media);
  
  player.setAutoPlay(true);
  
  mediaView.setMediaPlayer(player);

  But after I downloaded the reference m3u and all of its segments and tried to open the local file like this, the error occurred again :

  File video = new File("H://Projects//Tools//ref//prog_index.m3u8");
  
  Media media = new Media(video.toURI().toString());
  
  MediaPlayer player = new MediaPlayer(media);
  
  player.setAutoPlay(true);
  
  mediaView.setMediaPlayer(player);

  I tried to change my m3u file so that the segements are referenced with absolute paths. I tried different notations (H:\f\out0.ts, H:/f/out0.ts, H://f//out0.ts, file:/H:/f/out0.ts, file:///H:/f/out0.ts), but I couldn’t get it to work.

• varying RTP stream result from custom SIP implementation

  1er février, par Nik Hendricks

  I am in the process of creating my own SIP implementation in Node.js. As well as a b2bua as a learning project.

  


  Finding people wise in the ways of SIP has proved to be difficult elsewhere but here I have had good results

  


  this is the GitHub of my library so far node.js-sip

  


  this is the GitHub of my PBX so far FlowPBX

  


  Currently, everything is working as I expect. Although I really have some questions on possible errors in my implementation.

  


  My main issue is with RTP streams. Currently I am utilizing ffmpeg.

  


  my function goes as follows

  


  start_stream(call_id, sdp){
        console.log('Starting Stream')
        let port = sdp.match(/m=audio (\d+) RTP/)[1];
        let ip = sdp.match(/c=IN IP4 (\d+\.\d+\.\d+\.\d+)/)[1];
        let codec_ids = sdp.match(/m=audio \d+ RTP\/AVP (.+)/)[1].split(' ');
        let ffmpeg_codec_map = {
            'opus': 'libopus',
            'PCMU': 'pcm_mulaw',
            'PCMA': 'pcm_alaw',
            'telephone-event': 'pcm_mulaw',
            'speex': 'speex',
            'G722': 'g722',
            'G729': 'g729',
            'GSM': 'gsm',
            'AMR': 'amr',
            'AMR-WB': 'amr_wb',
            'iLBC': 'ilbc',
            'iSAC': 'isac',
        }

        let codecs = [];
        sdp.split('\n').forEach(line => {
            if(line.includes('a=rtpmap')){
                let codec = line.match(/a=rtpmap:(\d+) (.+)/)[2];
                let c_id = line.match(/a=rtpmap:(\d+) (.+)/)[1];
                codecs.push({                    
                    name: codec.split('/')[0],
                    rate: codec.split('/')[1],
                    channels: codec.split('/')[2] !== undefined ? codec.split('/')[2] : 1,
                    id: c_id
                })
            }
        })

        console.log('codecs')
        console.log(codecs)

        let selected_codec = codecs[0]
        if(selected_codec.name == 'telephone-event'){
            selected_codec = codecs[1]
            console.log(selected_codec)
        }

        //see if opus is available
        codecs.forEach(codec => {
            if(codec.name == 'opus'){
                selected_codec = codec;
            }
        })

        if(selected_codec.name != 'opus'){
            //check if g729 is available
            codecs.forEach(codec => {
                if(codec.name == 'G729'){
                    selected_codec = codec;
                }
            })
        }

        console.log('selected_codec')
        console.log(selected_codec)

        let spawn = require('child_process').spawn;
        let ffmpegArgs = [
            '-re',
            '-i', 'song.mp3',
            '-acodec', ffmpeg_codec_map[selected_codec.name],
            '-ar', selected_codec.rate,
            '-ac', selected_codec.channels,
            '-payload_type', selected_codec.id,
            '-f', 'rtp', `rtp://${ip}:${port}`
        ];

        let ffmpeg = spawn('ffmpeg', ffmpegArgs);

        ffmpeg.stdout.on('data', (data) => {
            console.log(`stdout: ${data}`);
        });
        ffmpeg.stderr.on('data', (data) => {
            console.error(`stderr: ${data}`);
        });




}


  


  When using zoiper to test it works great. I have seen the mobile version negotiate speex
and the desktop version negotiate opus mostly for the codec.

  


  today I tried to register a grandstream phone to my pbx and the rtp stream is blank audio.
opus is available and I have tried to prefer that in my stream but still even when selecting that I cannot get audio to the grandstream phone. This is the same case for a yealink phone. I can only get zoiper to work so far.

  


  what could be causing this behavior ? there is a clear path of communication between everything just like the zoiper client's I have used.

  


  Additionally in my sip implementation,
how important is the concept of a dialog ? currently, I just match messages by Call-ID

  


  and then choose what to send based on the method or response. is there any other underlying dialog functionality that I may need to implement ?

  


  It would just be awesome to get someone who really knows what they are talking about eyes on some of my code to direct this large codebase in the right direction but I realize that a big ask lol.