Recherche avancée

Sur d’autres sites (5878)

• How to crop and scale multiple landscape regions into a new portrait video ? FFmpeg

  27 août 2023, par 3V1LXD

  I have an electron program that selects multiple regions of a landscape video and lets you rearrange them in a portrait canvas. I'm having trouble building the proper ffmpeg command to create the video. I have this somewhat working. I can export 2 layers, but i can't export if i only have 1 layer or if i have 3 or more layers selected.

  


  2 regions of video selected

  


  layers [
  { top: 0, left: 658, width: 576, height: 1080 },
  { top: 262, left: 0, width: 576, height: 324 }
]
newPositions [
  { top: 0, left: 0, width: 576, height: 1080 },
  { top: 0, left: 0, width: 576, height: 324 }
]
filtergraph [0]crop=576:1080:658:0,scale=576:1080[v0];[0]crop=576:324:0:262,scale=576:324[v1];[v0][v1]overlay=0:0:0:0[out]

No Error export successful


  


  1 region selected

  


  layers [ { top: 0, left: 650, width: 576, height: 1080 } ]
newPositions [ { top: 0, left: 0, width: 576, height: 1080 } ]
filtergraph [0]crop=576:1080:650:0,scale=576:1080[v0];[v0]overlay=0:0[out]

FFmpeg error: [fc#0 @ 000001dd3b6db0c0] Cannot find a matching stream for unlabeled input pad overlay
Error initializing complex filters: Invalid argument


  


  3 regions of video selected

  


  layers [
  { top: 0, left: 641, width: 576, height: 1080 },
  { top: 250, left: 0, width: 576, height: 324 },
  { top: 756, left: 0, width: 576, height: 324 }
]
newPositions [
  { top: 0, left: 0, width: 576, height: 1080 },
  { top: 0, left: 0, width: 576, height: 324 },
  { top: 756, left: 0, width: 576, height: 324 }
]
filtergraph [0]crop=576:1080:641:0,scale=576:1080[v0];[0]crop=576:324:0:250,scale=576:324[v1];[0]crop=576:324:0:756,scale=576:324[v2];[v0][v1][v2]overlay=0:0:0:0:0:756[out]

FFmpeg error: [AVFilterGraph @ 0000018faf2189c0] More input link labels specified for filter 'overlay' than it has inputs: 3 > 2
[AVFilterGraph @ 0000018faf2189c0] Error linking filters

FFmpeg error: Failed to set value '[0]crop=576:1080:698:0,scale=576:1080[v0];[0]crop=576:324:0:264,scale=576:324[v1];[0]crop=576:324:0:756,scale=576:324[v2];[v0][v1][v2]overlay=0:0:0:0:0:0[out]' for option 'filter_complex': Invalid argument
Error parsing global options: Invalid argument


  


  I can't figure out how to construct the proper overlay command. Here is the js code i'm using from my electron app.

  


  ipcMain.handle('export-video', async (_event, args) => {
  const { videoFile, outputName, layers, newPositions } = args;
  const ffmpegPath = path.join(__dirname, 'bin', 'ffmpeg');
  const outputDir = checkOutputDir();
  
  // use same video for each layer as input
  // crop, scale, and position each layer
  // overlay each layer on top of each other

  // export video
  console.log('layers', layers);
  console.log('newPositions', newPositions);

  let filtergraph = '';

  for (let i = 0; i < layers.length; i++) {
    const { top, left, width, height } = layers[i];
    const { width: newWidth, height: newHeight } = newPositions[i];
    const filter = `[0]crop=${width}:${height}:${left}:${top},scale=${newWidth}:${newHeight}[v${i}];`;
    filtergraph += filter;
  }

  for (let i = 0; i < layers.length; i++) {
    const filter = `[v${i}]`;
    filtergraph += filter;
  }

  filtergraph += `overlay=`;
  for (let i = 0; i < layers.length; i++) {
    const { top: newTop, left: newLeft } = newPositions[i];
    const overlay = `${newLeft}:${newTop}:`;
    filtergraph += overlay;
  }

  filtergraph = filtergraph.slice(0, -1); // remove last comma
  filtergraph += `[out]`;
  
  console.log('filtergraph', filtergraph);

  const ffmpeg = spawn(ffmpegPath, [
    '-i', videoFile,
    '-filter_complex', filtergraph,
    '-map', '[out]',
    '-c:v', 'libx264',
    '-preset', 'ultrafast',
    '-crf', '18',
    '-y',
    path.join(outputDir, `${outputName}`)
  ]);  

  ffmpeg.stdout.on('data', (data) => {
    console.log(`FFmpeg output: ${data}`);
  });

  ffmpeg.stderr.on('data', (data) => {
    console.error(`FFmpeg error: ${data}`);
  });

  ffmpeg.on('close', (code) => {
    console.log(`FFmpeg process exited with code ${code}`);
    // event.reply('ffmpeg-export-done'); // Notify the renderer process
  });
});


  


  Any advice might be helpful, The docs are confusing, Thanks.

  


• Why DASH video fragments are not reproducible nor readable with ffmpeg ?

  21 mai 2020, par salgarji

  I'm streaming live video using DASH through FFmpeg. Everything's OK, fragments are generated, and the mpd file, but I wanted to have reproducible independent fragments. Video players won't open those fragments. I guess it's because they are mpd file dependant. My question would be : can those fragments be generated in a way that they are reproducible ? I don't know if it has something to do to the frames I P B or just the way dash cuts video information, in a way that it only saves 'timeline' on the mpd...

  



  My purpose is not only being able to reproduce them sepparately, but I need to insert information in a metadata tag of the video, and ffmpeg won't let me read those live streaming generated fragments.

  



  FFmpeg input information command will behave like this :

  



  input :

  



  ffmpeg -i /path/video0-0-1.mp4


  



  output :

  



  ffmpeg version N-97777-g3b5a36c56d Copyright (c) 2000-2020 the FFmpeg developers
  built with Apple clang version 11.0.3 (clang-1103.0.32.59)
  configuration: --enable-gpl --enable-libx264
  libavutil      56. 45.100 / 56. 45.100
  libavcodec     58. 84.100 / 58. 84.100
  libavformat    58. 43.100 / 58. 43.100
  libavdevice    58.  9.103 / 58.  9.103
  libavfilter     7. 81.100 /  7. 81.100
  libswscale      5.  6.101 /  5.  6.101
  libswresample   3.  6.100 /  3.  6.100
  libpostproc    55.  6.100 / 55.  6.100
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x7fb324009400] could not find corresponding track id 1
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x7fb324009400] could not find corresponding trex (id 1)
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x7fb324009400] could not find corresponding track id 0
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x7fb324009400] trun track id unknown, no tfhd was found
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x7fb324009400] error reading header
/path/video0-0-1.mp4: Invalid data found when processing input


  



  I execute this FFmpeg code using fluent-ffmpeg over JS to generate the fragments :

  



  var ffmpeg = require('fluent-ffmpeg');

var grabacion = new ffmpeg();

grabacion.addInput('0')
.inputOptions(['-y -nostdin', '-f avfoundation', '-video_size 1280x720', '-pix_fmt nv12', '-framerate 30'])
.outputOptions(['-vcodec libx264', '-keyint_min 0', '-g 100', '-map 0:v', '-b:v 1000k', '-f dash',
 '-use_template 1', '-use_timeline 0', '-init_seg_name video0-$RepresentationID$-$Number$.mp4',
 '-media_seg_name video0-$RepresentationID$-$Number$.mp4', '-remove_at_exit 0', '-window_size 20', '-seg_duration 4'])
.output('/path/path/path/video.mpd')
.run();


  



  So, the final purpose would be to be able to insert a tag like this :

  



  ffmpeg -i video0-0-0.mp4 -movflags use_metadata_tags -metadata sample_tag=whateveryouwanttoadd video0-0-0-tagged.mp4


  



  Is there any way to do it ? Thank you in advance !

  


• Convert ffmpeg frame into array of YUV pixels in C

  9 juin 2016, par loneraver

  I’m using the ffmpeg C libraries and trying to convert an AVFrame into a 2d array of pixels with YUV* components for analysis. I figured out how to convert the Y component for each pixel. :

  uint8_t y_val = pFrame->data[0][pFrame->linesize[0] * y + x]; 

  Since all frames have a Y component this is easy. However most digital video do not have a 4:4:4 chroma subsampling, so getting the UV components is stumping me.

  I’m using straight C for this project. No C++. An ideas ?

  *Note : Yes, I know it’s technically YCbCr and not YUV.

  Edit :

  I’m rather new to C so it might not be the prettiest code out there.

  When I try :

  VisYUVFrame *VisCreateYUVFrame(const AVFrame *pFrame){
  
      VisYUVFrame *tmp = (VisYUVFrame*)malloc(sizeof(VisYUVFrame));
  
      if(tmp == NULL){ return NULL;}
  
      tmp->height = pFrame->height;
  
      tmp->width = pFrame->width;
  
  
  
      tmp->data = (PixelYUV***)malloc(sizeof(PixelYUV**) * pFrame->height);
  
      if(tmp->data == NULL) { return NULL;};
  
  
  
      for(int y = 0; y < pFrame->height; y++){
  
          tmp->data[y] = (PixelYUV**)malloc(sizeof(PixelYUV*) * pFrame->width);
  
          if(tmp->data[y] == NULL) { return NULL;}
  
  
  
          for(int x = 0; x < pFrame->width; x++){
  
              tmp->data[y][x] = (PixelYUV*)malloc(sizeof(PixelYUV*));
  
              if(tmp->data[y][x] == NULL){ return NULL;};
  
              tmp->data[y][x]->Y = pFrame->data[0][pFrame->linesize[0] * y + x];
  
              tmp->data[y][x]->U = pFrame->data[1][pFrame->linesize[1] * y + x];
  
              tmp->data[y][x]->V = pFrame->data[2][pFrame->linesize[2] * y + x];
  
  
  
          }
  
      }
  
  
  
      return tmp;

  Luma works but when I run Valgrind, I get

  0x26
  1
  InvalidRead
  Invalid read of size 1

  0x100003699
  /Users/hborcher/Library/Caches/CLion2016.2/cmake/generated/borcherscope-8e83e7dd/8e83e7dd/Debug/VisCreator2
  VisCreateYUVFrame
  /Users/hborcher/ClionProjects/borcherscope/lib
  visualization.c
  145

  0x100006B5B
  /Users/hborcher/Library/Caches/CLion2016.2/cmake/generated/borcherscope-8e83e7dd/8e83e7dd/Debug/VisCreator2
  render
  /Users/hborcher/ClionProjects/borcherscope/lib/decoder
  simpleDecoder2.c
  253

  0x100002D24
  /Users/hborcher/Library/Caches/CLion2016.2/cmake/generated/borcherscope-8e83e7dd/8e83e7dd/Debug/VisCreator2
  main
  /Users/hborcher/ClionProjects/borcherscope/src
  createvisual2.c
  93

  Address 0x10e9f91ef is 0 bytes after a block of size 92,207 alloc’d

  0x100013EEA
  /usr/local/Cellar/valgrind/3.11.0/lib/valgrind/vgpreload_memcheck-amd64-darwin.so
  malloc_zone_memalign

  0x1084B5416
  /usr/lib/system/libsystem_malloc.dylib
  posix_memalign

  0x10135D317
  /usr/local/Cellar/ffmpeg/3.0.2/lib/libavutil.55.17.103.dylib
  av_malloc

  0x27
  1
  InvalidRead
  Invalid read of size 1

  0x1000036BA
  /Users/hborcher/Library/Caches/CLion2016.2/cmake/generated/borcherscope-8e83e7dd/8e83e7dd/Debug/VisCreator2
  VisCreateYUVFrame
  /Users/hborcher/ClionProjects/borcherscope/lib
  visualization.c
  147

  0x100006B5B
  /Users/hborcher/Library/Caches/CLion2016.2/cmake/generated/borcherscope-8e83e7dd/8e83e7dd/Debug/VisCreator2
  render
  /Users/hborcher/ClionProjects/borcherscope/lib/decoder
  simpleDecoder2.c
  253

  0x100002D24
  /Users/hborcher/Library/Caches/CLion2016.2/cmake/generated/borcherscope-8e83e7dd/8e83e7dd/Debug/VisCreator2
  main
  /Users/hborcher/ClionProjects/borcherscope/src
  createvisual2.c
  93

  Address 0x10e9f91ef is 0 bytes after a block of size 92,207 alloc’d

  0x100013EEA
  /usr/local/Cellar/valgrind/3.11.0/lib/valgrind/vgpreload_memcheck-amd64-darwin.so
  malloc_zone_memalign

  0x1084B5416
  /usr/lib/system/libsystem_malloc.dylib
  posix_memalign

  0x10135D317
  /usr/local/Cellar/ffmpeg/3.0.2/lib/libavutil.55.17.103.dylib
  av_malloc