Recherche avancée

Sur d’autres sites (11995)

• Final Rendered Video is Sped Up Compared to Animation Played in Processing

  15 janvier 2016, par Nightlife

  Recently I made an Audio Visualizer in Processing. From there I wanted to render the animation created in Processing into a mp4 file. I am on a windows computer, and am using ffmpeg to convert my TIF files produced in Processing into mp4.

  When I do this I am able to render the images into an mp4 file, but when I playback this file the animation is sped up compared to the animation when I play it on Processing. Because of this the animation does not sync with the audio when I combine the mp4 file and audio on a video editing program.

  When I set my frame rate to 25 and have the limit on the number of frames to be 250 and render it into a mp4 file it is 10 seconds long like it should be, but it contains more than 10 seconds of the animation when compared to the animation played directly in Processing.

  I have no idea why this is so any help will be much appreciated.

  My Processing code :

  import ddf.minim.*;
  
  import ddf.minim.analysis.*;
  
  
  
  Minim minim;
  
  AudioPlayer player;
  
  PImage img;
  
  FFT fft;
  
  
  
  void setup() {
  
    size(728, 546);
  
  
  
    minim = new Minim(this);
  
  
  
    // this loads mysong.wav from the data folder as a stream with a internal buffer of size 1024
  
    player = minim.loadFile("new_years_good.mp3");
  
    fft = new FFT(player.bufferSize(), player.sampleRate());
  
    player.play();
  
    img= loadImage("cat-in-shades-.jpg");
  
    frameRate(25);
  
  }
  
  
  
  void draw() {
  
  
  
  
  
    image(img, 0, 0);
  
    //tint(0, 100, 150);
  
    stroke(255);
  
  
  
    strokeWeight(4);
  
    float a = 0;
  
  
  
    float angle = (2*PI) / 200;
  
  
  
  
  
    fft.forward(player.mix);
  
  
  
  
  
    for(int i=0; i < player.bufferSize() - 1; i++) {
  
  
  
     //player.mix.get(i) is a value between [-1,1]
  
  
  
      float x = 250 + cos(a) * (20 * player.mix.get(i) + 100);
  
      float x2 = 540 + cos(a) * (20 * player.mix.get(i) + 100);    
  
  
  
      float y = 230 + sin(a) * (20 * player.mix.get(i) + 100);
  
      float y2 = 240 + sin(a) * (20 * player.mix.get(i) + 100);
  
  
  
  
  
      float xFinal = 250 + cos(a+angle) * (20 * player.mix.get(i+1) + 100);
  
      float x2Final = 540 + cos(a+angle) * (20 * player.mix.get(i+1) + 100);
  
  
  
  
  
      float yFinal = 230 + sin(a+angle) * (20 * player.mix.get(i+1) + 100);    
  
      float y2Final = 240 + sin(a+angle) * (20 * player.mix.get(i+1) + 100);    
  
  
  
  
  
      line(x,y,xFinal,yFinal);
  
      line(x2,y2,x2Final,y2Final);
  
      a += angle;  
  
  
  
  
  
  
  
    }
  
    noStroke();  
  
    fill(255, 0, 0, 128);
  
    for(int i = 0; i < 250; i++)
  
    {
  
      float b = fft.getBand(i);
  
      float yAxis = random(-b, b) + 480;
  
      float xAxis = i*3;
  
      ellipse(xAxis, yAxis, b, b);
  
    }
  
    saveFrame("frame-####.tif");
  
    if(frameCount>250)
  
      {
  
        noLoop();
  
        stop();
  
      }
  
  
  
  }
  
  
  
  void stop() {
  
    player.close();
  
    minim.stop();
  
  
  
    super.stop();
  
  }

  What I input into the command line (as one line) on the cmd :

  C:\Users\Robert\Documents\Processing\AudioVisulizer>ffmpeg -i C:\Users\Robert\Do
  
  cuments\Processing\AudioVisulizer\frame-%04d.tif -r 25 -pix_fmt yuv420p smallVid
  
  .mp4

  What it outputted :

      ffmpeg version N-77836-g62dfe1d Copyright (c) 2000-2016 the FFmpeg developers
  
        built with gcc 5.2.0 (GCC)
  
        configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-av
  
      isynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enab
  
      le-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --
  
      enable-libdcadec --enable-libfreetype --enable-libgme --enable-libgsm --enable-l
  
      ibilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enab
  
      le-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --en
  
      able-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --ena
  
      ble-libtwolame --enable-libvidstab --enable-libvo-aacenc --enable-libvo-amrwbenc
  
       --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enabl
  
      e-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --
  
      enable-lzma --enable-decklink --enable-zlib
  
        libavutil      55. 13.100 / 55. 13.100
  
        libavcodec     57. 22.100 / 57. 22.100
  
        libavformat    57. 21.101 / 57. 21.101
  
        libavdevice    57.  0.100 / 57.  0.100
  
        libavfilter     6. 23.100 /  6. 23.100
  
        libswscale      4.  0.100 /  4.  0.100
  
        libswresample   2.  0.101 /  2.  0.101
  
        libpostproc    54.  0.100 / 54.  0.100
  
      Input #0, image2, from 'C:\Users\Robert\Documents\Processing\AudioVisulizer\fram
  
      e-%04d.tif':
  
        Duration: 00:00:10.04, start: 0.000000, bitrate: N/A
  
          Stream #0:0: Video: tiff, rgb24, 728x546, 25 fps, 25 tbr, 25 tbn, 25 tbc
  
      [libx264 @ 00000092cd5e3700] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2
  
      AVX FMA3 AVX2 LZCNT BMI2
  
      [libx264 @ 00000092cd5e3700] profile High, level 3.0
  
      [libx264 @ 00000092cd5e3700] 264 - core 148 r2638 7599210 - H.264/MPEG-4 AVC cod
  
      ec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 r
  
      ef=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed
  
      _ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pski
  
      p=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 deci
  
      mate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_
  
      adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=2
  
      5 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.6
  
      0 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
      Output #0, mp4, to 'smallVid.mp4':
  
        Metadata:
  
          encoder         : Lavf57.21.101
  
          Stream #0:0: Video: h264 (libx264) ([33][0][0][0] / 0x0021), yuv420p, 728x54
  
      6, q=-1--1, 25 fps, 12800 tbn, 25 tbc
  
          Metadata:
  
            encoder         : Lavc57.22.100 libx264
  
          Side data:
  
            unknown side data type 10 (24 bytes)
  
      Stream mapping:
  
        Stream #0:0 -> #0:0 (tiff (native) -> h264 (libx264))
  
      Press [q] to stop, [?] for help
  
      frame=   52 fps=0.0 q=28.0 size=      77kB time=00:00:00.00 bitrate=N/A speed=
  
      frame=   74 fps= 65 q=28.0 size=     127kB time=00:00:00.88 bitrate=1178.0kbits/
  
      frame=   93 fps= 57 q=28.0 size=     164kB time=00:00:01.64 bitrate= 820.0kbits/
  
      frame=  113 fps= 52 q=28.0 size=     201kB time=00:00:02.44 bitrate= 676.3kbits/
  
      frame=  136 fps= 51 q=28.0 size=     245kB time=00:00:03.36 bitrate= 596.3kbits/
  
      frame=  157 fps= 49 q=28.0 size=     282kB time=00:00:04.20 bitrate= 550.2kbits/
  
      frame=  178 fps= 48 q=28.0 size=     324kB time=00:00:05.04 bitrate= 527.2kbits/
  
      frame=  199 fps= 47 q=28.0 size=     362kB time=00:00:05.88 bitrate= 504.1kbits/
  
      frame=  219 fps= 46 q=28.0 size=     403kB time=00:00:06.68 bitrate= 494.2kbits/
  
      frame=  242 fps= 46 q=28.0 size=     452kB time=00:00:07.60 bitrate= 486.8kbits/
  
      frame=  251 fps= 38 q=-1.0 Lsize=     623kB time=00:00:09.96 bitrate= 512.3kbits
  
      /s speed=1.52x
  
      video:619kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing o
  
      verhead: 0.607807%
  
      [libx264 @ 00000092cd5e3700] frame I:2     Avg QP:21.74  size: 56596
  
      [libx264 @ 00000092cd5e3700] frame P:66    Avg QP:23.36  size:  2523
  
      [libx264 @ 00000092cd5e3700] frame B:183   Avg QP:31.50  size:  1932
  
      [libx264 @ 00000092cd5e3700] consecutive B-frames:  0.8%  4.0%  6.0% 89.2%
  
      [libx264 @ 00000092cd5e3700] mb I  I16..4: 10.9% 72.6% 16.5%
  
      [libx264 @ 00000092cd5e3700] mb P  I16..4:  0.0%  0.0%  0.2%  P16..4:  4.4%  2.3
  
      %  3.3%  0.0%  0.0%    skip:89.7%
  
      [libx264 @ 00000092cd5e3700] mb B  I16..4:  0.0%  0.0%  0.5%  B16..8:  3.2%  2.0
  
      %  2.3%  direct: 1.3%  skip:90.7%  L0:50.9% L1:42.2% BI: 7.0%
  
      [libx264 @ 00000092cd5e3700] 8x8 transform intra:50.2% inter:10.1%
  
      [libx264 @ 00000092cd5e3700] coded y,uvDC,uvAC intra: 83.4% 32.6% 14.2% inter: 3
  
      .5% 0.2% 0.0%
  
      [libx264 @ 00000092cd5e3700] i16 v,h,dc,p: 22%  8%  8% 62%
  
      [libx264 @ 00000092cd5e3700] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 19% 12% 19%  6%  9%
  
       9%  9%  9%  9%
  
      [libx264 @ 00000092cd5e3700] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 22% 14% 22%  6%  9%
  
       8%  8%  5%  6%
  
      [libx264 @ 00000092cd5e3700] i8c dc,h,v,p: 74% 12% 12%  2%
  
      [libx264 @ 00000092cd5e3700] Weighted P-Frames: Y:0.0% UV:0.0%
  
      [libx264 @ 00000092cd5e3700] ref P L0: 41.8%  3.9% 24.3% 30.0%
  
      [libx264 @ 00000092cd5e3700] ref B L0: 64.5% 25.0% 10.5%
  
      [libx264 @ 00000092cd5e3700] ref B L1: 82.2% 17.8%
  
      [libx264 @ 00000092cd5e3700] kb/s:504.56

• FFMPEG — using 'amix' to combine short audio clip with a video results in final video's sound cutting off early

  12 avril 2022, par kilika

  I am trying to combine the following :

  


  (a) : 29s video clip that has its own audio that lasts the entire duration

  


  (b) : audio clip I want to play at the start of the video, in conjunction with original audio, and is 2 seconds long

  


  I successfully use 'amix' to obtain a video at the end with combined audio, but the problem is that the final video's audio cuts off at around 26 out of the 29 seconds of the video and goes silent.

  


  What doesn't make any sense is that the resulting video plays as it should, with the audio successfully mixed. But the output video's audio stream loses the last 3 seconds.

  


  Here's the 'amix' command I'm using (sending via subprocess) :

  


  subprocess.call(['ffmpeg','-i', input.mp4', '-i', "audioclip.mp3", '-filter_complex', 'amix', output.mp4'])


  


  I've also used versions of this command that spell out the -map "0:a" and -map "1:a", or tried using 'amix=inputs=2:duration:longest' among many other additions. All lead to the same problem : the final combined video's audio drops out with 3 seconds remaining in the video, even though the initial 'input.mp4' video has a full 29 out of 29 seconds of audio.

  


  Does anyone know why these last several seconds of audio from [a] are missing in the final video ?

  


  _________________________________________________________________

  


  edit : Below is my output when I run the amix command listed above :

  


  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'RuneBearinstakill_advanced.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf59.20.101
  Duration: 00:00:29.77, start: 0.000000, bitrate: 5441 kb/s
  Stream #0:0[0x1](eng): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt470bg/bt470bg/smpte170m, progressive), 1920x1080 [SAR 1:1 DAR 16:9], 5304 kb/s, 30 fps, 30 tbr, 15360 tbn (default)
    Metadata:
      handler_name    : Bento4 Video Handler
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s (default)
    Metadata:
      handler_name    : Bento4 Sound Handler
      vendor_id       : [0][0][0][0]
[mp3 @ 000001f0c8ec2040] Estimating duration from bitrate, this may be inaccurate
Input #1, mp3, from 'TTS_clip.mp3':
  Duration: 00:00:01.90, start: 0.000000, bitrate: 32 kb/s
  Stream #1:0: Audio: mp3, 24000 Hz, mono, fltp, 32 kb/s
Stream mapping:
  Stream #0:1 (aac) -> amix (graph 0)
  Stream #1:0 (mp3float) -> amix (graph 0)
  amix:default (graph 0) -> Stream #0:0 (aac)
  Stream #0:0 -> #0:1 (h264 (native) -> h264 (libx264))
Press [q] to stop, [?] for help
[libx264 @ 000001f0c8cbe5c0] using SAR=1/1
[libx264 @ 000001f0c8cbe5c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 000001f0c8cbe5c0] profile High, level 4.0, 4:2:0, 8-bit
[libx264 @ 000001f0c8cbe5c0] 264 - core 164 r3094 bfc87b7 - H.264/MPEG-4 AVC codec - Copyleft 2003-2022 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=24 lookahead_threads=4 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'RuneBearinstakill_advancedwithtts.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf59.20.101
  Stream #0:0: Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s
    Metadata:
      encoder         : Lavc59.25.100 aac
  Stream #0:1(eng): Video: h264 (avc1 / 0x31637661), yuv420p(tv, bt470bg/bt470bg/smpte170m, progressive), 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 30 fps, 15360 tbn (default)
    Metadata:
      handler_name    : Bento4 Video Handler
      vendor_id       : [0][0][0][0]
      encoder         : Lavc59.25.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
frame=  893 fps=110 q=-1.0 Lsize=   18717kB time=00:00:29.66 bitrate=5168.5kbits/s speed=3.66x    
video:18256kB audio:433kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.150179%
[aac @ 000001f0c8f9ebc0] Qavg: 921.259
[libx264 @ 000001f0c8cbe5c0] frame I:4     Avg QP:21.33  size: 71366
[libx264 @ 000001f0c8cbe5c0] frame P:633   Avg QP:23.32  size: 23837
[libx264 @ 000001f0c8cbe5c0] frame B:256   Avg QP:25.22  size: 12968
[libx264 @ 000001f0c8cbe5c0] consecutive B-frames: 57.2% 10.3% 10.1% 22.4%
[libx264 @ 000001f0c8cbe5c0] mb I  I16..4: 17.9% 71.4% 10.8%
[libx264 @ 000001f0c8cbe5c0] mb P  I16..4:  6.9% 17.6%  0.8%  P16..4: 43.1%  6.5%  1.5%  0.0%  0.0%    skip:23.6%
[libx264 @ 000001f0c8cbe5c0] mb B  I16..4:  1.5%  4.2%  0.3%  B16..8: 39.7%  4.6%  0.5%  direct: 1.6%  skip:47.6%  L0:55.9% L1:41.8% BI: 2.3%
[libx264 @ 000001f0c8cbe5c0] 8x8 transform intra:69.5% inter:87.3%
[libx264 @ 000001f0c8cbe5c0] coded y,uvDC,uvAC intra: 35.6% 26.8% 0.8% inter: 13.4% 10.8% 0.0%
[libx264 @ 000001f0c8cbe5c0] i16 v,h,dc,p: 21% 37% 12% 30%
[libx264 @ 000001f0c8cbe5c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 25% 26% 21%  4%  5%  5%  6%  4%  5%
[libx264 @ 000001f0c8cbe5c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 24% 28% 15%  5%  7%  7%  7%  5%  4%
[libx264 @ 000001f0c8cbe5c0] i8c dc,h,v,p: 67% 18% 14%  1%
[libx264 @ 000001f0c8cbe5c0] Weighted P-Frames: Y:0.2% UV:0.0%
[libx264 @ 000001f0c8cbe5c0] ref P L0: 72.3% 15.4%  8.7%  3.6%  0.0%
[libx264 @ 000001f0c8cbe5c0] ref B L0: 88.9%  9.5%  1.6%
[libx264 @ 000001f0c8cbe5c0] ref B L1: 97.7%  2.3%
[libx264 @ 000001f0c8cbe5c0] kb/s:5024.13


  


  And here is the output when I check the stream durations for the input video and the output video, showing how the output video's audio stream is somehow reduced by several seconds after the amix :

  


  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'RuneBearinstakill_advanced.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf59.20.101
  Duration: 00:00:29.77, start: 0.000000, bitrate: 5403 kb/s
  Stream #0:0[0x1](eng): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt470bg/bt470bg/smpte170m, progressive), 1920x1080 [SAR 1:1 DAR 16:9], 5266 kb/s, 30 fps, 30 tbr, 15360 tbn (default)
    Metadata:
      handler_name    : Bento4 Video Handler
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s (default)
    Metadata:
      handler_name    : Bento4 Sound Handler
      vendor_id       : [0][0][0][0]
[STREAM]
duration=29.766667
[/STREAM]
[STREAM]
duration=29.738000
[/STREAM]

Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'RuneBearinstakill_advancedwithtts.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf59.20.101
  Duration: 00:00:29.77, start: 0.000000, bitrate: 5098 kb/s
  Stream #0:0[0x1](und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](eng): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt470bg/bt470bg/smpte170m, progressive), 1920x1080 [SAR 1:1 DAR 16:9], 4971 kb/s, 30 fps, 30 tbr, 15360 tbn (default)
    Metadata:
      handler_name    : Bento4 Video Handler
      vendor_id       : [0][0][0][0]
[STREAM]
duration=27.477000
[/STREAM]
[STREAM]
duration=29.766667


  


• Use specific channels from specific streams for the final stream using FFMPEG [closed]

  9 juin 2024, par Kazu-kun

  I want to create a 5.1ch audio stream from a 2ch audio stream. However I want to put a negative delay to LFE, SL and SR channels since they will be played from my bluetooth speaker, so I want to make up for the delay by giving it a negative delay.

  


  


  ffmpeg -itsoffset 0.1 -i input.mkv -i input.mkv

  


  -filter_complex “

  


  [1:a]pan=5.1(side)|FL=FL|FR=FR|LFEp>


  [0:a]pan=5.1(side)|FL=FL|FR=FR|LFEp>


  [orig5_1][delayed5_1]amerge=inputs=2,pan=5.1(side)|FL=c6|FR=c7|LFE=c2|SL=c3|SR=c4[a]”

  


  -map "[a]" -map 0:v -map 0:s -c:v copy -c:a flac -c:s copy output.mkv

  


  


  I tried taking the same input twice with the first one being delayed by 0.1 secs. With the delayed input a 5.1 audio is created and with the original another 5.1 audio is created as well. Then the two audio streams are merged with amerge and combined into a single 5.1 audio by taking delayed channels for FL and FR(These will be played from my MacBook) and by taking original channels for LFE, SL and SR(These will be played from my bluetooth JBL). Finally the video and subs streams are taken from the delayed.

  


  The above command gave a "pipe pipe pipe dqoute" error and when I entered the command again it said :

  


  


  zsh : unknown file attribute : i

  


  zsh : no such file or directory : FL+FR

  


  zsh : unknown file attribute : i

  


  zsh : no such file or directory : FL+FR

  


  zsh : unknown file attribute : i

  


  zsh : command not found : -map

  


  


  Please give me a command for my requirement !